-- Logs begin at Tue 2022-07-12 13:44:34 UTC, end at Tue 2022-07-12 15:06:39 UTC. -- Jul 12 14:20:01.874896 dv-cinder-820027-12-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 12 14:20:01.883197 dv-cinder-820027-12-smb devstack@keystone.service[80620]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 12 14:20:01.885961 dv-cinder-820027-12-smb devstack@keystone.service[80620]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 14:20:01 2022] *** Jul 12 14:20:01.886114 dv-cinder-820027-12-smb devstack@keystone.service[80620]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 14:20:01.886224 dv-cinder-820027-12-smb devstack@keystone.service[80620]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 14:20:01.886320 dv-cinder-820027-12-smb devstack@keystone.service[80620]: nodename: dv-cinder-820027-12-smb Jul 12 14:20:01.886427 dv-cinder-820027-12-smb devstack@keystone.service[80620]: machine: x86_64 Jul 12 14:20:01.886532 dv-cinder-820027-12-smb devstack@keystone.service[80620]: clock source: unix Jul 12 14:20:01.886625 dv-cinder-820027-12-smb devstack@keystone.service[80620]: pcre jit disabled Jul 12 14:20:01.886718 dv-cinder-820027-12-smb devstack@keystone.service[80620]: detected number of CPU cores: 4 Jul 12 14:20:01.886816 dv-cinder-820027-12-smb devstack@keystone.service[80620]: current working directory: / Jul 12 14:20:01.886916 dv-cinder-820027-12-smb devstack@keystone.service[80620]: detected binary path: /usr/bin/uwsgi-core Jul 12 14:20:01.887022 dv-cinder-820027-12-smb devstack@keystone.service[80620]: your processes number limit is 47680 Jul 12 14:20:01.887130 dv-cinder-820027-12-smb devstack@keystone.service[80620]: your memory page size is 4096 bytes Jul 12 14:20:01.887232 dv-cinder-820027-12-smb devstack@keystone.service[80620]: detected max file descriptor number: 2048 Jul 12 14:20:01.887372 dv-cinder-820027-12-smb devstack@keystone.service[80620]: lock engine: pthread robust mutexes Jul 12 14:20:01.887633 dv-cinder-820027-12-smb devstack@keystone.service[80620]: thunder lock: enabled Jul 12 14:20:01.887931 dv-cinder-820027-12-smb devstack@keystone.service[80620]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 12 14:20:01.888109 dv-cinder-820027-12-smb devstack@keystone.service[80620]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 14:20:01.932283 dv-cinder-820027-12-smb devstack@keystone.service[80620]: Python main interpreter initialized at 0x5582c061d9c0 Jul 12 14:20:01.932283 dv-cinder-820027-12-smb devstack@keystone.service[80620]: python threads support enabled Jul 12 14:20:01.932283 dv-cinder-820027-12-smb devstack@keystone.service[80620]: your server socket listen backlog is limited to 100 connections Jul 12 14:20:01.932283 dv-cinder-820027-12-smb devstack@keystone.service[80620]: your mercy for graceful operations on workers is 90 seconds Jul 12 14:20:01.932662 dv-cinder-820027-12-smb devstack@keystone.service[80620]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 14:20:01.932741 dv-cinder-820027-12-smb devstack@keystone.service[80620]: *** Operational MODE: preforking *** Jul 12 14:20:01.932986 dv-cinder-820027-12-smb devstack@keystone.service[80620]: *** uWSGI is running in multiple interpreter mode *** Jul 12 14:20:01.932986 dv-cinder-820027-12-smb devstack@keystone.service[80620]: spawned uWSGI master process (pid: 80620) Jul 12 14:20:01.933200 dv-cinder-820027-12-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 12 14:20:01.938917 dv-cinder-820027-12-smb devstack@keystone.service[80620]: spawned uWSGI worker 1 (pid: 80633, cores: 1) Jul 12 14:20:01.938917 dv-cinder-820027-12-smb devstack@keystone.service[80620]: spawned uWSGI worker 2 (pid: 80634, cores: 1) Jul 12 14:20:01.938917 dv-cinder-820027-12-smb devstack@keystone.service[80620]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 14:20:07.450689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:20:07.450689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: from cryptography.utils import int_from_bytes Jul 12 14:20:07.451514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:20:07.451514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: from cryptography.utils import int_from_bytes Jul 12 14:20:07.452097 dv-cinder-820027-12-smb devstack@keystone.service[80633]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:20:07.452097 dv-cinder-820027-12-smb devstack@keystone.service[80633]: from cryptography.utils import int_from_bytes Jul 12 14:20:07.452552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 14:20:07.452552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: from cryptography.utils import int_from_bytes Jul 12 14:20:07.501032 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 14:20:07.501187 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 14:20:07.501382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] command line args: [] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 14:20:07.501675 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 14:20:07.501878 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ================================================================================ {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 14:20:07.502154 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] admin_token = **** {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.502436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] config_dir = [] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.502518 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 14:20:07.502663 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.502748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 14:20:07.502879 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] config_source = [] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.502963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] command line args: [] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 14:20:07.503097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] debug = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.503181 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 14:20:07.503321 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.503581 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ================================================================================ {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 14:20:07.503581 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] admin_token = **** {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.503705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.503835 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] config_dir = [] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.503917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.503988 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.504103 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.504182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] config_source = [] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.504355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] debug = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.504443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.504564 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.504666 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] list_limit = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.504778 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] log_config_append = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.504863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.504928 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.504986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.505095 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] log_dir = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.505217 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.505300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] log_file = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.505483 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.505590 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.505710 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] list_limit = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.505850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.505935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] log_config_append = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.506008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.506086 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.506217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.506312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] log_dir = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.506387 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.506454 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] log_file = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.506551 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.506685 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.506784 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.506844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.507015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.507125 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.507246 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.507346 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.507504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.507640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.507766 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.507847 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.507974 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.508055 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.508169 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.508244 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.508383 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.508462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.508622 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.508708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.508905 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.509149 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.509233 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.509355 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] publish_errors = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.509439 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.509610 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.509703 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.509820 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.509959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.510043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.510209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.510385 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.510473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.510578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] publish_errors = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.510655 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] standard_threads = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.510814 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.510907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.511048 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.511132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.511231 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.511328 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.511458 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] use_journal = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.511545 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.511618 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] use_json = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.511732 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.511814 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] use_stderr = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.511960 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] use_syslog = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.512037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] standard_threads = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.512191 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.512274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.512435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.512510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.512616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.512698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.512839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] use_journal = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.512912 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.512981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] use_json = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.513127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] use_stderr = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.513209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.513307 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] use_syslog = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.513392 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.513543 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 14:20:07.513620 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.513801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.513877 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.514053 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.514137 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.514298 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.514374 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.514545 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.514621 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.514795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.514880 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.515025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.515099 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.515289 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.515379 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.515531 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.515616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.515777 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.515855 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.516024 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.516111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.516262 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.516340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.516499 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.516576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.516752 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.516834 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.516994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.517077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.517230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.517320 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.517481 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.517557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.517725 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.517809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.517977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.518051 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.518223 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.518299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.518442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.518515 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.518670 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.518747 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.518899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.518975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.519133 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.519306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.519396 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.519571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.519647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.519829 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.519913 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.520069 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.520145 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.520307 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.520384 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.520550 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.520638 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.520786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.520862 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.521034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.521111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.521266 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.521354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.521507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.521582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.521741 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.521815 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.521972 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.522055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.522203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.522280 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.522438 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.522552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.522700 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.522810 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.522936 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.523039 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.523178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.523324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.523448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.523533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.523668 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.523746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.523907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.523993 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.524143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.524230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.524382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.524460 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.524671 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.524747 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.524933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.525058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.525206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.525293 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.525403 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.525482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.525642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.525723 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.525883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.525972 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.526120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.526203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.526352 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.526428 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.526609 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.526686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.526848 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.526947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.527085 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.527192 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.527338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.527419 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.527585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.527669 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.527829 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.527907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.528060 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.528145 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.528300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.528387 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.528539 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.528623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.528777 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.528853 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.529016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.529099 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.529263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.529338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.529509 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.529585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.529744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.529818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.529978 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.530053 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.530196 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.530276 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.530446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.530522 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.530683 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.530759 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.530920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.530997 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.531165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.531240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.531427 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.531522 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.531666 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.531753 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.531897 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.531973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.532132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.532207 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.532366 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.532448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.532604 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.532688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.532853 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.532936 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.533092 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.533179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.533329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.533404 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.533564 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.533639 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.533797 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.533878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.534035 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.534121 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.534268 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.534351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.534505 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.534589 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.534734 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.534811 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.534962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.535038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.535195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.535301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.535449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.535527 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.535689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.535764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.535924 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.536012 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.536157 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.536242 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.536393 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.536469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.536626 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.536708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.536869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.536945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.537111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.537187 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.537340 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] auth.external = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.537423 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.537568 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.537645 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.537818 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.537892 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.538065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.538149 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.538295 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] auth.password = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.538371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.538525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] auth.token = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.538601 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.538771 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.538858 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.539007 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.539092 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] auth.external = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.539249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.539348 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.539503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.539582 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.539750 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.539837 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.539996 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.540557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] auth.password = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.540789 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] auth.token = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.540871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.541042 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.541209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] credential.caching = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.541287 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.541525 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.541603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.541763 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.541844 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.542016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.542095 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.542261 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.542337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.542496 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.542578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.542733 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.542817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] credential.caching = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.542982 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.543057 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.543234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.543345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.543497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.543575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.543738 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.543813 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.543986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.544076 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.544225 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.544302 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.544497 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.544579 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.544737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.544900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.544974 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.545042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.545212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] federation.caching = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.545288 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.545446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.545530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.545692 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.545773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.545943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.546020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.546173 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.546258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.546419 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.546497 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.546655 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.546730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] federation.caching = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.546907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.546995 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.547146 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.547223 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.547418 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.547496 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.547654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.547742 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.547900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.547977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.548134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] identity.caching = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.548211 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.548382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.548466 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.548620 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.548703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.548853 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.548930 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.549088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.549172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.549333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.549410 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.549564 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.549641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] identity.caching = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.549799 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.549883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.550047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.550123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.550286 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.550367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.550514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.550598 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.550743 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.550820 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.550973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.551050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.551217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.551335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.551490 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.551567 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.551743 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.551848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.551975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.552104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.552214 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.552294 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.552451 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.552529 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.552700 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.552787 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.552933 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.553010 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.553162 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.553240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.553398 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.553478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.553636 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.553713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.553870 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.553948 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.554110 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.554191 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.554351 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.554435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.554598 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.554675 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.554827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.554905 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.555064 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.555141 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.555327 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.555409 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.555567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.555648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.556439 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.556704 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.556782 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.556963 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.557118 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.557198 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.557390 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.557467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.557644 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.557723 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.557885 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.557963 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.558120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.558197 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.558362 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.558477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.558599 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.558679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.558835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.558913 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.559066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.559145 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.559329 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.559411 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.559563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.559639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.559793 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.559870 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.560036 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.560115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.560277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.560356 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.560511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.560588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.560746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.560825 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.560980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.561057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.561209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.user = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.561287 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.561449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.561535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.561698 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.561816 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.561927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.562004 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.562164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.562242 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.562402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.562480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.562637 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.user = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.562715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.562868 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.562947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.563098 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.563175 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.563354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.563438 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.563591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.563672 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.563826 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.563903 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.564052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.564130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.564298 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.564377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.564536 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.564613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.564775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.564853 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.565014 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.565094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.565254 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.565331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.565483 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.565567 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.565728 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.565807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.565962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.566039 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.566196 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.566273 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.566429 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.566508 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.566663 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.566741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.566898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.566974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.567141 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.567219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.567403 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.567481 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.567645 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.567739 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.567880 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.567957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.568117 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.568192 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.568350 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.568500 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.568576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.568646 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.568809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.568887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.569053 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.569139 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.569294 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.569372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.569525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.569602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.569761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.569850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.569998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.570075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] resource.caching = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.570240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.570318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.570485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.570568 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.570720 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.570798 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.570959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.571035 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.571200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.571315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.571498 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.571576 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] resource.caching = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.571746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.571978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.572111 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.572209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.572283 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.572432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] role.caching = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.572511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.572679 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] role.driver = sql {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.572758 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.572909 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.573028 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.573153 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.573230 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.573391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.573469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.573638 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.573717 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.573881 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.573958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.574120 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] role.caching = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.574197 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.574362 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.574440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] role.driver = sql {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.574598 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.574674 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.574841 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.574923 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.575073 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.575153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.575339 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.575432 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.575587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.575665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.575835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.575915 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.576083 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.576161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.576336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.576477 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.576588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.576711 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.576826 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.577062 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.577139 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.577314 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.577394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.577560 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.577638 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.577806 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.577884 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.578045 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.578200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.578299 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.578443 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.578549 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.578698 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.578786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.578953 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.579031 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.579206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.579301 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.579467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.579558 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.579709 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.579786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.579959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.580035 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.580204 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.580291 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.580442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.580520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.580675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.580752 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.580904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.580989 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.581144 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.581220 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] token.caching = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.581380 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.581457 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.581628 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.581714 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.581863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.581941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.582116 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.582194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.582362 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.582453 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.582597 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.582675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.582840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.582917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] token.caching = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.583082 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.583166 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.583347 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.583429 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.583586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.583664 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.583824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.583914 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.584057 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.584136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.584302 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.584380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.584549 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.584634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.584776 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.584853 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.585017 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.585095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.585262 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.585347 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.585505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.585584 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.connection = **** {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.585745 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.585832 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.585996 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.586074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.586235 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.586314 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.586467 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.586544 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.586698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.586782 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.586932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.587523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.587696 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.587931 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.588140 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.connection = **** {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.588237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.588320 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.588468 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.588544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.588616 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.588767 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.588846 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.589032 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.589117 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.589257 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.589335 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.589500 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.589578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.589742 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.589829 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.589978 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.590055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.590211 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.590289 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.590383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 14:20:07.590469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.590685 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.590923 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.591174 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.591443 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.591695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.591930 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.592174 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.592412 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 14:20:07.592585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 14:20:07.621857 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.622086 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.622311 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.622825 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.623061 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.623308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.630704 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.631951 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.660668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.660889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.661150 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.661383 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.805684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.806532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.856105 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.856342 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.856474 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.856709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.923172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.923435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.923664 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.923750 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.923887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.923992 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.924107 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.924190 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.924322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.924403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.924550 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.924765 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.949083 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.949319 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.949428 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.949548 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.949632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.949777 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.949860 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.950000 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.950082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.950223 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.950307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.950442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.950525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.950670 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.961542 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.961828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.974940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.975175 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.975264 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.975424 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.975522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.975651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.975734 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.975872 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.975954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.976088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.976170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.976302 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.976383 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.976515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80634) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 14:20:07.993893 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:07.994322 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:07.994407 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 14:20:07.994533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 14:20:07.994682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:07.994864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:07.994946 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 14:20:07.995076 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 14:20:07.995158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:07.995435 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:07.995519 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:07.995694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:07.995775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:07.995946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:07.996024 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:07.996195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.006772 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.007055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.007137 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.007353 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.007437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.007642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.007737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.007958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.016442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.016837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80634) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.019746 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.020027 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.020111 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80634) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.020311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.020394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.020598 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.020689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.020883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.020965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.021146 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.021228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.021408 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.021497 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.021677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.021758 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.021946 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.022025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.022214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.022295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.022479 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.022558 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.022738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.049332 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.050205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.050935 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80634) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.051211 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.051852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.052133 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.056506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80634) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.056728 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.057006 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.057672 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.057952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.058351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.064431 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80634) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.064706 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.065696 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.065978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.069124 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80634) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.069408 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.069689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.069969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.070245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.070515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.070606 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.070787 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.070868 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.071051 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.071131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.071885 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.072268 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.072571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.072847 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.073120 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.092661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.092945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.093588 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.093870 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.097628 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.098375 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80634) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.101356 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.101652 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.102018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.102310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.107712 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.107937 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80634) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.111360 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.111545 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80634) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.114990 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.115141 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.115311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.115460 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.115625 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.115744 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.115914 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.116008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.116204 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.116293 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.116484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.116573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.136276 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80634) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.136556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.136639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.136823 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.136920 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.137083 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.137168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.137402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.144921 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.145325 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.146625 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.146900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.147045 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.147349 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.150205 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80634) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.150478 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.150593 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.150763 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.150876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.151043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.151161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.151405 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.151491 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.151747 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.164581 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80634) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.164855 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.165659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.165749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.165947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.166142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.166366 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.166457 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.166651 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.166742 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.166922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.167003 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.168728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.169026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.186868 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80634) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.187701 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.190132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80634) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.190963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.193456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.194299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.195032 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.196150 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.196833 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80634) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.197122 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.197412 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.198061 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.198343 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.198638 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.204811 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.205980 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.206411 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80634) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.207769 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.209643 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.209929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.210210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.210492 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.210999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.211310 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.211709 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.212036 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.219667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80634) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.219950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.220227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.221265 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.221554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.221837 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.228536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80634) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.228876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.229156 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.229432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.229702 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.229988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.230260 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.230341 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 14:20:08.230532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.230615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.230887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.230976 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.231158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.231248 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.231456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.231541 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.231728 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.231840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.232010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.232132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.232276 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80634) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.232386 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.232667 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.232939 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.233210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.233484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.233762 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.234032 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 14:20:08.270552 dv-cinder-820027-12-smb devstack@keystone.service[80634]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5582c061d9c0 pid: 80634 (default app) Jul 12 14:20:08.272725 dv-cinder-820027-12-smb devstack@keystone.service[80633]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5582c061d9c0 pid: 80633 (default app) Jul 12 14:20:08.274033 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b1db0-568b-4e98-9c79-16187c605ea9 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:08.274326 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b1db0-568b-4e98-9c79-16187c605ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:08.274630 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b1db0-568b-4e98-9c79-16187c605ea9 None None] PATH_INFO: `/v3` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:08.278846 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Tue Jul 12 14:20:08 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:17.019164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c420f57-4f6c-4f8c-9916-40b892475a2c None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:17.019767 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c420f57-4f6c-4f8c-9916-40b892475a2c None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:17.019767 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c420f57-4f6c-4f8c-9916-40b892475a2c None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:17.024072 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:17.029707 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c74339-15f9-441a-b146-43452b04500c None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:17.030142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c74339-15f9-441a-b146-43452b04500c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:17.030275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c74339-15f9-441a-b146-43452b04500c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:17.101682 dv-cinder-820027-12-smb devstack@keystone.service[80634]: INFO dbcounter [None req-c4c74339-15f9-441a-b146-43452b04500c None None] Registered counter for database keystone Jul 12 14:20:17.125085 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG oslo_db.sqlalchemy.engines [None req-c4c74339-15f9-441a-b146-43452b04500c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:20:17.131301 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writer thread running {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:20:17.314309 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG passlib.handlers.bcrypt [None req-c4c74339-15f9-441a-b146-43452b04500c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80634) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 14:20:17.314732 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG passlib.handlers.bcrypt [None req-c4c74339-15f9-441a-b146-43452b04500c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80634) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 14:20:17.369857 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-c4c74339-15f9-441a-b146-43452b04500c None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:17.371482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-c4c74339-15f9-441a-b146-43452b04500c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:17.496993 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 12 14:20:17.682888 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c420f57-4f6c-4f8c-9916-40b892475a2c None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:17.754033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: INFO dbcounter [None req-4c420f57-4f6c-4f8c-9916-40b892475a2c None None] Registered counter for database keystone Jul 12 14:20:17.774002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG oslo_db.sqlalchemy.engines [None req-4c420f57-4f6c-4f8c-9916-40b892475a2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 14:20:17.781292 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writer thread running {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 14:20:17.905276 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c420f57-4f6c-4f8c-9916-40b892475a2c None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:17.909695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673825cd-8677-4596-82e0-5e230e84e7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:17.910370 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673825cd-8677-4596-82e0-5e230e84e7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:17.910661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673825cd-8677-4596-82e0-5e230e84e7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:17.910948 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673825cd-8677-4596-82e0-5e230e84e7a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:17.920262 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673825cd-8677-4596-82e0-5e230e84e7a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:17.973757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: WARNING keystone.common.rbac_enforcer.enforcer [None req-673825cd-8677-4596-82e0-5e230e84e7a1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 14:20:17.974042 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673825cd-8677-4596-82e0-5e230e84e7a1 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:17.984700 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1324 bytes} [Tue Jul 12 14:20:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:20:17.991200 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c74339-15f9-441a-b146-43452b04500c None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:18.006607 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c74339-15f9-441a-b146-43452b04500c None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:18.012191 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9016f-b593-46fa-97b3-62ec78ff0844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:18.013318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9016f-b593-46fa-97b3-62ec78ff0844 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:18.013612 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9016f-b593-46fa-97b3-62ec78ff0844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:18.013893 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9016f-b593-46fa-97b3-62ec78ff0844 admin admin] PATH_INFO: `/v3/projects/e19a2306c9b043c3b84bdeaf0a418bdb` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:18.018032 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9016f-b593-46fa-97b3-62ec78ff0844 admin admin] RBAC: Authorizing `identity:get_project(project_id=e19a2306c9b043c3b84bdeaf0a418bdb)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:18.070253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: WARNING keystone.common.rbac_enforcer.enforcer [None req-63f9016f-b593-46fa-97b3-62ec78ff0844 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 14:20:18.070817 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9016f-b593-46fa-97b3-62ec78ff0844 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:18.076300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 3/5] 10.222.0.40 () {56 vars in 1207 bytes} [Tue Jul 12 14:20:17 2022] GET /identity/v3/projects/e19a2306c9b043c3b84bdeaf0a418bdb => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:20.177301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2a675-80d0-4aac-b0ed-afcb5ac96e56 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:20.177842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2a675-80d0-4aac-b0ed-afcb5ac96e56 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:20.177842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2a675-80d0-4aac-b0ed-afcb5ac96e56 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:20.182087 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 3/6] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:20:20.187546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e13d2-8e05-4d25-be8e-66b6318c4083 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:20.188030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e13d2-8e05-4d25-be8e-66b6318c4083 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:20.188115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e13d2-8e05-4d25-be8e-66b6318c4083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:20.207446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-6e4e13d2-8e05-4d25-be8e-66b6318c4083 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:20.208969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-6e4e13d2-8e05-4d25-be8e-66b6318c4083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:20.217541 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 12 14:20:20.239418 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2a675-80d0-4aac-b0ed-afcb5ac96e56 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:20.252178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2a675-80d0-4aac-b0ed-afcb5ac96e56 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:20.256426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514b10e-a2af-4d2a-aee8-41e65cb95cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:20.257073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514b10e-a2af-4d2a-aee8-41e65cb95cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:20.257362 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514b10e-a2af-4d2a-aee8-41e65cb95cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:20.257645 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514b10e-a2af-4d2a-aee8-41e65cb95cd0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:20.266224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514b10e-a2af-4d2a-aee8-41e65cb95cd0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:20.268050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514b10e-a2af-4d2a-aee8-41e65cb95cd0 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:20.277466 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1324 bytes} [Tue Jul 12 14:20:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:20:20.283053 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e13d2-8e05-4d25-be8e-66b6318c4083 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:20.292209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e13d2-8e05-4d25-be8e-66b6318c4083 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:20.296779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb882bc7-fcd1-4a38-a323-0adbd9d84e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:20.297684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb882bc7-fcd1-4a38-a323-0adbd9d84e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:20.297968 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb882bc7-fcd1-4a38-a323-0adbd9d84e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:20.298243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb882bc7-fcd1-4a38-a323-0adbd9d84e96 admin admin] PATH_INFO: `/v3/users/6f66109ae90a4460b768c8db1b53b02e` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:20.299664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb882bc7-fcd1-4a38-a323-0adbd9d84e96 admin admin] RBAC: Authorizing `identity:get_user(user_id=6f66109ae90a4460b768c8db1b53b02e)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:20.301499 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb882bc7-fcd1-4a38-a323-0adbd9d84e96 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:20.303196 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 5/9] 10.222.0.40 () {56 vars in 1198 bytes} [Tue Jul 12 14:20:20 2022] GET /identity/v3/users/6f66109ae90a4460b768c8db1b53b02e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:22.399768 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cec9b-2eac-4de3-8adf-4886ff3b4aab None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:22.400302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cec9b-2eac-4de3-8adf-4886ff3b4aab None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:22.400302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cec9b-2eac-4de3-8adf-4886ff3b4aab None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:22.402284 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:20:22.407540 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d52507-2e02-4a17-9085-bced7c094fb4 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:22.407962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d52507-2e02-4a17-9085-bced7c094fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:22.408226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d52507-2e02-4a17-9085-bced7c094fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:22.425305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-01d52507-2e02-4a17-9085-bced7c094fb4 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:22.426490 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-01d52507-2e02-4a17-9085-bced7c094fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:22.437805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ae8da-1f6c-4c35-b335-1de7f551c9c4 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:22.438097 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ae8da-1f6c-4c35-b335-1de7f551c9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:22.438377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ae8da-1f6c-4c35-b335-1de7f551c9c4 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:22.439799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 6/11] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:22.445085 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4cbd4-31ff-4db1-8a04-1c3372caf1a5 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:22.445372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4cbd4-31ff-4db1-8a04-1c3372caf1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:22.445651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4cbd4-31ff-4db1-8a04-1c3372caf1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:22.485017 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG passlib.handlers.bcrypt [None req-f2e4cbd4-31ff-4db1-8a04-1c3372caf1a5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80633) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 14:20:22.485431 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG passlib.handlers.bcrypt [None req-f2e4cbd4-31ff-4db1-8a04-1c3372caf1a5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80633) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 14:20:22.512579 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:22.531626 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-f2e4cbd4-31ff-4db1-8a04-1c3372caf1a5 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:22.533233 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f2e4cbd4-31ff-4db1-8a04-1c3372caf1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:22.535038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d52507-2e02-4a17-9085-bced7c094fb4 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:22.559949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:22.638062 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:20:22.642172 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d52507-2e02-4a17-9085-bced7c094fb4 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:22.660232 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4cbd4-31ff-4db1-8a04-1c3372caf1a5 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:22.677242 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791dcb2-356e-424e-ae98-cdc8358ac9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:22.678054 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791dcb2-356e-424e-ae98-cdc8358ac9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:22.678340 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791dcb2-356e-424e-ae98-cdc8358ac9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:22.678619 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791dcb2-356e-424e-ae98-cdc8358ac9e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:22.690759 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791dcb2-356e-424e-ae98-cdc8358ac9e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:22.702592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-3791dcb2-356e-424e-ae98-cdc8358ac9e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:22.702592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:22.702592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:22.702592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:22.702592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:22.702592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:22.702592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:22.702592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:22.702592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:22.702592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:22.702592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:22.702592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:22.702592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:22.702592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:22.702592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:22.702592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:22.703528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:22.703528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:22.703528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:22.703528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:22.703528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:22.703528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:22.703528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:22.703528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:22.703528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:22.703528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:22.703528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:22.703528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:22.703528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:22.703528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:22.703528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:22.703528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:22.704395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:22.704395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:22.704395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:22.704395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:22.704395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:22.704395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:22.704395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:22.704395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:22.704395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:22.704395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:22.704395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:22.704395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:20:22.704395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 7/14] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:20:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:22.709582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791dcb2-356e-424e-ae98-cdc8358ac9e1 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:22.762399 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4cbd4-31ff-4db1-8a04-1c3372caf1a5 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:22.765238 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:22.793312 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:22.798153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30584a40-c9d1-43f0-b235-755acdcfcb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:22.799064 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30584a40-c9d1-43f0-b235-755acdcfcb7e None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:22.799385 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30584a40-c9d1-43f0-b235-755acdcfcb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:22.799664 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30584a40-c9d1-43f0-b235-755acdcfcb7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:22.811666 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791dcb2-356e-424e-ae98-cdc8358ac9e1 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:22.846153 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4175f-ddbb-400f-befa-17d6609aad03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:22.846831 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4175f-ddbb-400f-befa-17d6609aad03 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:22.847121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4175f-ddbb-400f-befa-17d6609aad03 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:22.847450 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4175f-ddbb-400f-befa-17d6609aad03 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:22.848212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4175f-ddbb-400f-befa-17d6609aad03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:22.848520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4175f-ddbb-400f-befa-17d6609aad03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:22.849923 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4175f-ddbb-400f-befa-17d6609aad03 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:22.862039 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 8/15] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:22.867395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4175f-ddbb-400f-befa-17d6609aad03 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:22.867976 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30584a40-c9d1-43f0-b235-755acdcfcb7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:22.870683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30584a40-c9d1-43f0-b235-755acdcfcb7e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:22.967731 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4175f-ddbb-400f-befa-17d6609aad03 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:22.969293 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 14:20:22.974949 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30584a40-c9d1-43f0-b235-755acdcfcb7e None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:22.978520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:23.003193 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e6a75-2d2a-4d70-adfe-f0d401a870d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:23.004101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e6a75-2d2a-4d70-adfe-f0d401a870d5 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:23.004387 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e6a75-2d2a-4d70-adfe-f0d401a870d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:23.004665 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e6a75-2d2a-4d70-adfe-f0d401a870d5 None admin] PATH_INFO: `/v3/users/6f66109ae90a4460b768c8db1b53b02e` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:23.005864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e6a75-2d2a-4d70-adfe-f0d401a870d5 None admin] RBAC: Authorizing `identity:get_user(user_id=6f66109ae90a4460b768c8db1b53b02e)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:23.007409 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e6a75-2d2a-4d70-adfe-f0d401a870d5 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:23.009240 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 9/17] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:22 2022] GET /identity/v3/users/6f66109ae90a4460b768c8db1b53b02e => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:23.014531 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e6a75-2d2a-4d70-adfe-f0d401a870d5 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:23.029622 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:23.079112 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30584a40-c9d1-43f0-b235-755acdcfcb7e None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:23.113856 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3034aba-5341-4bee-acf0-80f796b08de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:23.114663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3034aba-5341-4bee-acf0-80f796b08de6 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:23.114948 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3034aba-5341-4bee-acf0-80f796b08de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:23.115055 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e6a75-2d2a-4d70-adfe-f0d401a870d5 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:23.115226 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3034aba-5341-4bee-acf0-80f796b08de6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:23.137709 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3034aba-5341-4bee-acf0-80f796b08de6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:23.138843 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3034aba-5341-4bee-acf0-80f796b08de6 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:23.151027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc871c3e-6bdf-4ae5-abeb-55c41c254066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:23.151852 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc871c3e-6bdf-4ae5-abeb-55c41c254066 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:23.152133 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc871c3e-6bdf-4ae5-abeb-55c41c254066 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:23.152406 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc871c3e-6bdf-4ae5-abeb-55c41c254066 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:23.153577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc871c3e-6bdf-4ae5-abeb-55c41c254066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:23.155029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc871c3e-6bdf-4ae5-abeb-55c41c254066 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:23.156661 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 10/18] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:23.159388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-a3034aba-5341-4bee-acf0-80f796b08de6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:23.159388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:23.159388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:23.159388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:23.159388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:23.159388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:23.159388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:23.159388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:23.159388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:23.159388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:23.159388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:23.159388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:23.159388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:23.159388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:23.159388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:23.160318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:23.160318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:23.160318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:23.160318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:23.160318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:23.160318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:23.160318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:23.160318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:23.160318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:23.160318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:23.160318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:23.160318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:23.160318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:23.160318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:23.160318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:23.160318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:23.160318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:23.161154 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:23.161154 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:23.161154 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:23.161154 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:20:23.161154 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 9/19] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:23.162420 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc871c3e-6bdf-4ae5-abeb-55c41c254066 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:23.166775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3034aba-5341-4bee-acf0-80f796b08de6 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:23.223893 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:23.244843 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:23.263429 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc871c3e-6bdf-4ae5-abeb-55c41c254066 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:23.272248 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3034aba-5341-4bee-acf0-80f796b08de6 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:23.298927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff3202-96eb-4254-b1a7-b20971b517c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:23.299540 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff3202-96eb-4254-b1a7-b20971b517c2 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:23.299824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff3202-96eb-4254-b1a7-b20971b517c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:23.300101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff3202-96eb-4254-b1a7-b20971b517c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:23.300934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff3202-96eb-4254-b1a7-b20971b517c2 None admin] RBAC: Adding query filter params (role.id=ae530119fc5c42358179521ce865b5d7, scope.domain.id=default, user.id=6f66109ae90a4460b768c8db1b53b02e) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:23.301246 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff3202-96eb-4254-b1a7-b20971b517c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:23.302677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff3202-96eb-4254-b1a7-b20971b517c2 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:23.306422 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee65a07-35be-4077-9852-9e67371ab0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:23.307089 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee65a07-35be-4077-9852-9e67371ab0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:23.307421 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee65a07-35be-4077-9852-9e67371ab0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:23.307711 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee65a07-35be-4077-9852-9e67371ab0f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:23.308446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee65a07-35be-4077-9852-9e67371ab0f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:23.308759 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee65a07-35be-4077-9852-9e67371ab0f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:23.310144 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee65a07-35be-4077-9852-9e67371ab0f6 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:23.310634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 11/20] 10.222.0.40 () {56 vars in 1322 bytes} [Tue Jul 12 14:20:23 2022] GET /identity/v3/role_assignments?user.id=6f66109ae90a4460b768c8db1b53b02e&scope.domain.id=default&role.id=ae530119fc5c42358179521ce865b5d7 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:23.329592 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 10/21] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:25.636863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f38869-e7d1-4b47-8902-8fdbd2c24607 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:25.637906 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f38869-e7d1-4b47-8902-8fdbd2c24607 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:25.638429 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f38869-e7d1-4b47-8902-8fdbd2c24607 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:25.640096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 12/22] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:25.645801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514f48f-ca18-4875-948b-1e9c4e98176f None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:25.646661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514f48f-ca18-4875-948b-1e9c4e98176f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:25.647157 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514f48f-ca18-4875-948b-1e9c4e98176f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:25.669895 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-3514f48f-ca18-4875-948b-1e9c4e98176f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:25.671543 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-3514f48f-ca18-4875-948b-1e9c4e98176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:25.770962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 11/23] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:25.806428 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f38869-e7d1-4b47-8902-8fdbd2c24607 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:25.944637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f38869-e7d1-4b47-8902-8fdbd2c24607 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:25.979243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9e166-f01b-4921-ae7b-447bb11c86e2 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:25.980034 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9e166-f01b-4921-ae7b-447bb11c86e2 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:25.980531 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9e166-f01b-4921-ae7b-447bb11c86e2 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:25.982862 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 12/24] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:20:25.990650 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dff6d-f464-49b6-9782-bdff5770e3e9 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:25.991260 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dff6d-f464-49b6-9782-bdff5770e3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:25.991800 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dff6d-f464-49b6-9782-bdff5770e3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.000049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c217732-1fec-42bb-aed5-82849297327e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:26.000877 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c217732-1fec-42bb-aed5-82849297327e None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.001167 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c217732-1fec-42bb-aed5-82849297327e None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.001446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c217732-1fec-42bb-aed5-82849297327e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.026789 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-ce8dff6d-f464-49b6-9782-bdff5770e3e9 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:26.028290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c217732-1fec-42bb-aed5-82849297327e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:26.029401 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ce8dff6d-f464-49b6-9782-bdff5770e3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:26.036091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-4c217732-1fec-42bb-aed5-82849297327e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:26.036091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:26.036091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:26.036091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:26.036091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:26.036091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:26.036091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:26.036091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:26.036091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:26.036091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:26.036091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:26.036091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:26.036091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:26.036091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:26.036091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:26.036091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:26.036959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:26.036959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:26.036959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:26.036959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:26.036959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:26.036959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:26.036959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:26.036959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:26.036959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:26.036959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:26.036959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:26.036959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:26.036959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:26.036959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:26.036959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:26.036959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:26.037708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:26.037708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:26.037708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:26.037708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:26.037708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:26.037708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:26.037708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:26.037708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:26.037708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:26.037708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:26.037708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:26.037708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:20:26.043457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 13/25] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:20:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:26.049402 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c217732-1fec-42bb-aed5-82849297327e None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:26.075315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:26.130173 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:26.174610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 13/26] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:26.176950 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaac3e-43e3-477a-914e-ea71b0793860 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.177451 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaac3e-43e3-477a-914e-ea71b0793860 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.177973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaaac3e-43e3-477a-914e-ea71b0793860 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.180016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 14/27] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:26.188007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8500b6-70c8-4c25-8496-683db4bc5691 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.188007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8500b6-70c8-4c25-8496-683db4bc5691 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.188007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8500b6-70c8-4c25-8496-683db4bc5691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.217090 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-6f8500b6-70c8-4c25-8496-683db4bc5691 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:26.218205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-6f8500b6-70c8-4c25-8496-683db4bc5691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:26.253962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c217732-1fec-42bb-aed5-82849297327e None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:26.293412 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c39df7-0dc1-475f-9685-7594c74b8429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:26.294613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c39df7-0dc1-475f-9685-7594c74b8429 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.295207 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c39df7-0dc1-475f-9685-7594c74b8429 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.295791 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c39df7-0dc1-475f-9685-7594c74b8429 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.296760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c39df7-0dc1-475f-9685-7594c74b8429 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:26.297309 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c39df7-0dc1-475f-9685-7594c74b8429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:26.299074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c39df7-0dc1-475f-9685-7594c74b8429 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:26.308833 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 14/28] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:26.309953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c39df7-0dc1-475f-9685-7594c74b8429 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:26.316260 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 15/29] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:26.318291 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0a410-04cc-47f3-b44f-b4eb14c2f73f None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.318291 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0a410-04cc-47f3-b44f-b4eb14c2f73f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.318291 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0a410-04cc-47f3-b44f-b4eb14c2f73f None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.319633 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:26.320139 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0a410-04cc-47f3-b44f-b4eb14c2f73f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:26.391049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:26.429392 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c39df7-0dc1-475f-9685-7594c74b8429 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:26.435854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0a410-04cc-47f3-b44f-b4eb14c2f73f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:26.443913 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:26.468149 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95be15-d9d1-4a09-bbdc-dccda4f2ba54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:26.469191 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95be15-d9d1-4a09-bbdc-dccda4f2ba54 None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.469695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95be15-d9d1-4a09-bbdc-dccda4f2ba54 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.470169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95be15-d9d1-4a09-bbdc-dccda4f2ba54 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.471158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95be15-d9d1-4a09-bbdc-dccda4f2ba54 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:26.472883 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95be15-d9d1-4a09-bbdc-dccda4f2ba54 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:26.474114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42835362-317b-44ce-b7e7-c309ea1b6797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:26.475006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42835362-317b-44ce-b7e7-c309ea1b6797 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.475303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42835362-317b-44ce-b7e7-c309ea1b6797 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.475581 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42835362-317b-44ce-b7e7-c309ea1b6797 None admin] PATH_INFO: `/v3/users/6f66109ae90a4460b768c8db1b53b02e` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.477284 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42835362-317b-44ce-b7e7-c309ea1b6797 None admin] RBAC: Authorizing `identity:get_user(user_id=6f66109ae90a4460b768c8db1b53b02e)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:26.478845 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42835362-317b-44ce-b7e7-c309ea1b6797 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:26.481385 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 17/31] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:26 2022] GET /identity/v3/users/6f66109ae90a4460b768c8db1b53b02e => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:26.486879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcabee3-d0df-493a-be0a-9982c041af4f None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.487175 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcabee3-d0df-493a-be0a-9982c041af4f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.487481 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcabee3-d0df-493a-be0a-9982c041af4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.506255 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-adcabee3-d0df-493a-be0a-9982c041af4f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:26.507488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-adcabee3-d0df-493a-be0a-9982c041af4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:26.589679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 18/32] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:26.590711 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcabee3-d0df-493a-be0a-9982c041af4f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:26.678116 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 15/33] 10.222.0.40 () {60 vars in 1131 bytes} [Tue Jul 12 14:20:26 2022] POST /identity/v3/roles => generated 219 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:26.679989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95be15-d9d1-4a09-bbdc-dccda4f2ba54 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:26.730925 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcabee3-d0df-493a-be0a-9982c041af4f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:26.735843 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:26.801380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff868b-15b7-459b-922a-af052a8a9c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:26.803265 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff868b-15b7-459b-922a-af052a8a9c36 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.804924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff868b-15b7-459b-922a-af052a8a9c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.805441 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff868b-15b7-459b-922a-af052a8a9c36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.828400 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff868b-15b7-459b-922a-af052a8a9c36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:26.831804 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff868b-15b7-459b-922a-af052a8a9c36 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:26.875773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-c2ff868b-15b7-459b-922a-af052a8a9c36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:26.875773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:26.875773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:26.875773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:26.875773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:26.875773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:26.875773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:26.875773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:26.875773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:26.875773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:26.875773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:26.875773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:26.875773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:20:26.875773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:20:26.875773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:20:26.876643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:20:26.876643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:26.876643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:26.876643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:26.876643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:26.876643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:26.876643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:26.876643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:26.876643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:26.876643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:26.876643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:26.876643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:26.876643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:26.876643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:26.876643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:26.876643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:26.876643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:26.877446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:20:26.877446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:20:26.877446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:20:26.877446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:20:26.877446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 19/34] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:26.878606 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff868b-15b7-459b-922a-af052a8a9c36 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:26.906673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95be15-d9d1-4a09-bbdc-dccda4f2ba54 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:26.943235 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:26.955553 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe09bcf-e826-49eb-b8df-84750598d888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:26.956412 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe09bcf-e826-49eb-b8df-84750598d888 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:26.956705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe09bcf-e826-49eb-b8df-84750598d888 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:26.956988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe09bcf-e826-49eb-b8df-84750598d888 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:26.958785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe09bcf-e826-49eb-b8df-84750598d888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:26.960767 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe09bcf-e826-49eb-b8df-84750598d888 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:26.963216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 16/35] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:26.965084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe09bcf-e826-49eb-b8df-84750598d888 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:27.032426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff868b-15b7-459b-922a-af052a8a9c36 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:27.074265 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3975cc-bb40-44d2-a8f3-4868772a0f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:27.075030 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3975cc-bb40-44d2-a8f3-4868772a0f78 None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.075368 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3975cc-bb40-44d2-a8f3-4868772a0f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.075853 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3975cc-bb40-44d2-a8f3-4868772a0f78 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.077263 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3975cc-bb40-44d2-a8f3-4868772a0f78 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:27.078802 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3975cc-bb40-44d2-a8f3-4868772a0f78 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:27.095318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe09bcf-e826-49eb-b8df-84750598d888 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:27.136292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d08ae-2d02-48a8-86e2-3cc7c20845f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:27.137035 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d08ae-2d02-48a8-86e2-3cc7c20845f9 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.137355 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d08ae-2d02-48a8-86e2-3cc7c20845f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.137648 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d08ae-2d02-48a8-86e2-3cc7c20845f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.138401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d08ae-2d02-48a8-86e2-3cc7c20845f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:27.138715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d08ae-2d02-48a8-86e2-3cc7c20845f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:27.140156 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d08ae-2d02-48a8-86e2-3cc7c20845f9 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:27.158475 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 17/36] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:27.159404 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d08ae-2d02-48a8-86e2-3cc7c20845f9 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:27.217977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:27.267899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d08ae-2d02-48a8-86e2-3cc7c20845f9 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:27.295680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 20/37] 10.222.0.40 () {60 vars in 1131 bytes} [Tue Jul 12 14:20:26 2022] POST /identity/v3/roles => generated 225 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:27.301119 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dbf58-4ac4-4e88-85ff-854f3eaa602f None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.301443 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dbf58-4ac4-4e88-85ff-854f3eaa602f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.301701 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dbf58-4ac4-4e88-85ff-854f3eaa602f None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.303379 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 21/38] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:27.304059 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dbf58-4ac4-4e88-85ff-854f3eaa602f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:27.317349 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440aa60-1e70-48d7-850b-8a8b6e327cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:27.318758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440aa60-1e70-48d7-850b-8a8b6e327cbd None admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.319266 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440aa60-1e70-48d7-850b-8a8b6e327cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.319801 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440aa60-1e70-48d7-850b-8a8b6e327cbd None admin] PATH_INFO: `/v3/domains/default/users/6f66109ae90a4460b768c8db1b53b02e/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.322771 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440aa60-1e70-48d7-850b-8a8b6e327cbd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6f66109ae90a4460b768c8db1b53b02e, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:27.324904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440aa60-1e70-48d7-850b-8a8b6e327cbd None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:27.327808 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:27.421375 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 18/39] 10.222.0.40 () {58 vars in 1361 bytes} [Tue Jul 12 14:20:27 2022] PUT /identity/v3/domains/default/users/6f66109ae90a4460b768c8db1b53b02e/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:20:27.423675 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf62a4-f254-4a84-ba33-9598e210f47c None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.424249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf62a4-f254-4a84-ba33-9598e210f47c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.425215 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf62a4-f254-4a84-ba33-9598e210f47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.434831 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dbf58-4ac4-4e88-85ff-854f3eaa602f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:27.450820 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-5bdf62a4-f254-4a84-ba33-9598e210f47c None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:27.454467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5bdf62a4-f254-4a84-ba33-9598e210f47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:27.491733 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0176fb-7197-4d8e-9592-4e021be7b7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:27.492670 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0176fb-7197-4d8e-9592-4e021be7b7f8 None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.492966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0176fb-7197-4d8e-9592-4e021be7b7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.493925 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0176fb-7197-4d8e-9592-4e021be7b7f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.495610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0176fb-7197-4d8e-9592-4e021be7b7f8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:27.498507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0176fb-7197-4d8e-9592-4e021be7b7f8 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:27.556385 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 19/40] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:27.569369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66710ff5-8684-4949-99f2-78bd6c412276 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.569663 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66710ff5-8684-4949-99f2-78bd6c412276 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.569945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66710ff5-8684-4949-99f2-78bd6c412276 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.571561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 20/41] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:20:27.577608 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85613e-3a82-465e-99fa-b7571ca45dc6 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.577905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85613e-3a82-465e-99fa-b7571ca45dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.578188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85613e-3a82-465e-99fa-b7571ca45dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.599961 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-dc85613e-3a82-465e-99fa-b7571ca45dc6 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:27.601267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-dc85613e-3a82-465e-99fa-b7571ca45dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:27.612943 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Jul 12 14:20:27 2022] POST /identity/v3/projects => generated 301 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:27.612943 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0176fb-7197-4d8e-9592-4e021be7b7f8 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:27.668404 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:27.711711 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:27.712682 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 21/43] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:20:27.738031 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85613e-3a82-465e-99fa-b7571ca45dc6 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:27.753185 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0176fb-7197-4d8e-9592-4e021be7b7f8 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:27.800416 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66a9a7-6ddb-47eb-af44-7e0213a9710f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:27.801504 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66a9a7-6ddb-47eb-af44-7e0213a9710f None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:27.801973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66a9a7-6ddb-47eb-af44-7e0213a9710f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:27.802442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66a9a7-6ddb-47eb-af44-7e0213a9710f None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:27.803890 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66a9a7-6ddb-47eb-af44-7e0213a9710f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:27.807161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66a9a7-6ddb-47eb-af44-7e0213a9710f None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:27.871835 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1131 bytes} [Tue Jul 12 14:20:27 2022] POST /identity/v3/roles => generated 223 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:27.981238 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85613e-3a82-465e-99fa-b7571ca45dc6 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:28.021098 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346635f9-f741-49ea-acf6-0985e4d6cfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:28.021916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346635f9-f741-49ea-acf6-0985e4d6cfc6 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:28.022208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346635f9-f741-49ea-acf6-0985e4d6cfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:28.022491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346635f9-f741-49ea-acf6-0985e4d6cfc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:28.023755 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346635f9-f741-49ea-acf6-0985e4d6cfc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:28.026304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346635f9-f741-49ea-acf6-0985e4d6cfc6 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:28.027996 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 22/45] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:28.033534 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66a9a7-6ddb-47eb-af44-7e0213a9710f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:28.140005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66a9a7-6ddb-47eb-af44-7e0213a9710f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:28.166340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:28.173969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c5963-8c94-4111-82c7-1029a3f79915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:28.174646 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c5963-8c94-4111-82c7-1029a3f79915 None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:28.174936 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c5963-8c94-4111-82c7-1029a3f79915 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:28.175216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c5963-8c94-4111-82c7-1029a3f79915 None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:28.175971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c5963-8c94-4111-82c7-1029a3f79915 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:28.177431 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c5963-8c94-4111-82c7-1029a3f79915 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:28.238007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Jul 12 14:20:28 2022] POST /identity/v3/projects => generated 312 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:20:29.592877 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9d7a9-0ce7-4371-a873-0d374597fdda None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:29.593392 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9d7a9-0ce7-4371-a873-0d374597fdda None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:29.593472 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9d7a9-0ce7-4371-a873-0d374597fdda None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:29.595017 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 23/47] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:29.600227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c66d4e-83ed-4052-85bf-c14bb45e1c34 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:29.606158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c66d4e-83ed-4052-85bf-c14bb45e1c34 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:29.606158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c66d4e-83ed-4052-85bf-c14bb45e1c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:29.619969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-24c66d4e-83ed-4052-85bf-c14bb45e1c34 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:29.621628 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-24c66d4e-83ed-4052-85bf-c14bb45e1c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:29.693405 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 25/48] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:29.717903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9d7a9-0ce7-4371-a873-0d374597fdda None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:29.764992 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:29.824266 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9d7a9-0ce7-4371-a873-0d374597fdda None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:29.859575 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ee791-d48c-42ef-90c5-03fa62dad374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:29.860298 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ee791-d48c-42ef-90c5-03fa62dad374 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:29.860587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ee791-d48c-42ef-90c5-03fa62dad374 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:29.860874 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ee791-d48c-42ef-90c5-03fa62dad374 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:29.873825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ee791-d48c-42ef-90c5-03fa62dad374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:29.881740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-114ee791-d48c-42ef-90c5-03fa62dad374 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:29.881740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:29.881740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:29.881740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:29.881740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:29.881740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:29.881740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:29.881740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:29.881740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:29.881740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:29.881740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:29.881740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:29.881740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:29.881740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:29.881740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:29.881740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:29.882573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:29.882573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:29.882573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:29.882573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:29.882573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:29.882573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:29.882573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:29.882573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:29.882573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:29.882573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:29.882573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:29.882573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:29.882573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:29.882573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:29.882573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:29.882573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:29.883323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:29.883323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:29.883323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:29.883323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:29.883323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:29.883323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:29.883323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:29.883323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:29.883323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:29.883323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:29.883323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:29.883323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:20:29.883323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 24/49] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:20:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:29.889378 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c66d4e-83ed-4052-85bf-c14bb45e1c34 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:29.992181 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c66d4e-83ed-4052-85bf-c14bb45e1c34 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:30.005646 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:30.031252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6138a9-8c1f-46a5-83ce-3ae3ed371ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:30.031962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6138a9-8c1f-46a5-83ce-3ae3ed371ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.032254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6138a9-8c1f-46a5-83ce-3ae3ed371ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.032540 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6138a9-8c1f-46a5-83ce-3ae3ed371ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.033319 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6138a9-8c1f-46a5-83ce-3ae3ed371ae3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:30.033637 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6138a9-8c1f-46a5-83ce-3ae3ed371ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:30.035193 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6138a9-8c1f-46a5-83ce-3ae3ed371ae3 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:30.051293 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 26/50] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:30.057818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ee791-d48c-42ef-90c5-03fa62dad374 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:30.166965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ee791-d48c-42ef-90c5-03fa62dad374 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:30.168507 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:30.202596 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2032f8-f210-4d15-b26e-88b7d1577f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:30.203518 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2032f8-f210-4d15-b26e-88b7d1577f45 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.203815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2032f8-f210-4d15-b26e-88b7d1577f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.204101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2032f8-f210-4d15-b26e-88b7d1577f45 None admin] PATH_INFO: `/v3/users/6f66109ae90a4460b768c8db1b53b02e` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.205317 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2032f8-f210-4d15-b26e-88b7d1577f45 None admin] RBAC: Authorizing `identity:get_user(user_id=6f66109ae90a4460b768c8db1b53b02e)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:30.206786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2032f8-f210-4d15-b26e-88b7d1577f45 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:30.208474 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 25/51] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:30 2022] GET /identity/v3/users/6f66109ae90a4460b768c8db1b53b02e => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:30.214399 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6138a9-8c1f-46a5-83ce-3ae3ed371ae3 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:30.296862 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cbdb7-c5ae-48e7-aca4-e24852e4aabb None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.297158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cbdb7-c5ae-48e7-aca4-e24852e4aabb None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.297537 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cbdb7-c5ae-48e7-aca4-e24852e4aabb None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.298986 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 26/52] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:20:30.304864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187b40a-8ee9-4dcd-a9e9-c33b5bb789e6 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.305154 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187b40a-8ee9-4dcd-a9e9-c33b5bb789e6 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.305437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187b40a-8ee9-4dcd-a9e9-c33b5bb789e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.325256 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-2187b40a-8ee9-4dcd-a9e9-c33b5bb789e6 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:30.326528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2187b40a-8ee9-4dcd-a9e9-c33b5bb789e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:30.402966 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 27/53] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:20:30.426633 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187b40a-8ee9-4dcd-a9e9-c33b5bb789e6 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:30.432807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6138a9-8c1f-46a5-83ce-3ae3ed371ae3 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:30.468126 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf7766-7222-4176-87e2-46170d34d3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:30.468964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf7766-7222-4176-87e2-46170d34d3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.469253 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf7766-7222-4176-87e2-46170d34d3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.469535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf7766-7222-4176-87e2-46170d34d3d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.470739 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf7766-7222-4176-87e2-46170d34d3d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:30.472244 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf7766-7222-4176-87e2-46170d34d3d7 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:30.473887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 27/54] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:30.480400 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf7766-7222-4176-87e2-46170d34d3d7 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:30.524831 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:30.528646 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:30.531760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187b40a-8ee9-4dcd-a9e9-c33b5bb789e6 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:30.567745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5edd7-564c-4ed1-928d-96769286e215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:30.568593 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5edd7-564c-4ed1-928d-96769286e215 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.569795 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5edd7-564c-4ed1-928d-96769286e215 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.569795 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5edd7-564c-4ed1-928d-96769286e215 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.570669 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5edd7-564c-4ed1-928d-96769286e215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:30.572785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5edd7-564c-4ed1-928d-96769286e215 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:30.574533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 28/55] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:30.580177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5edd7-564c-4ed1-928d-96769286e215 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:30.587473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf7766-7222-4176-87e2-46170d34d3d7 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:30.625106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c9240-69e8-492b-b263-8eff0461e091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:30.625793 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c9240-69e8-492b-b263-8eff0461e091 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.626048 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c9240-69e8-492b-b263-8eff0461e091 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.626322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c9240-69e8-492b-b263-8eff0461e091 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.627176 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c9240-69e8-492b-b263-8eff0461e091 None admin] RBAC: Adding query filter params (role.id=ae530119fc5c42358179521ce865b5d7, scope.domain.id=default, user.id=6f66109ae90a4460b768c8db1b53b02e) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:30.627530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c9240-69e8-492b-b263-8eff0461e091 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:30.629026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c9240-69e8-492b-b263-8eff0461e091 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:30.643310 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 28/56] 10.222.0.40 () {56 vars in 1322 bytes} [Tue Jul 12 14:20:30 2022] GET /identity/v3/role_assignments?user.id=6f66109ae90a4460b768c8db1b53b02e&scope.domain.id=default&role.id=ae530119fc5c42358179521ce865b5d7 => generated 530 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:30.694340 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5edd7-564c-4ed1-928d-96769286e215 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:30.753274 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a643d4e-fc26-4dd4-86e1-11ec0481d890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:30.754362 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a643d4e-fc26-4dd4-86e1-11ec0481d890 None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:30.754836 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a643d4e-fc26-4dd4-86e1-11ec0481d890 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:30.755336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a643d4e-fc26-4dd4-86e1-11ec0481d890 None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:30.756596 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a643d4e-fc26-4dd4-86e1-11ec0481d890 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:30.759806 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a643d4e-fc26-4dd4-86e1-11ec0481d890 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:30.843794 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 29/57] 10.222.0.40 () {60 vars in 1140 bytes} [Tue Jul 12 14:20:30 2022] POST /identity/v3/projects => generated 298 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:20:32.887755 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da46bd3-a8cf-4df3-8f16-42fc31cd1ba7 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:32.888269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da46bd3-a8cf-4df3-8f16-42fc31cd1ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:32.888353 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da46bd3-a8cf-4df3-8f16-42fc31cd1ba7 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:32.889695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 29/58] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:32.895070 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705da7c-7799-45c0-b313-e2f7c2c7ac7c None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:32.895457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705da7c-7799-45c0-b313-e2f7c2c7ac7c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:32.895689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705da7c-7799-45c0-b313-e2f7c2c7ac7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:32.913041 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-0705da7c-7799-45c0-b313-e2f7c2c7ac7c None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:32.914239 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0705da7c-7799-45c0-b313-e2f7c2c7ac7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:32.928206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:32.980941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 30/59] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:33.005469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da46bd3-a8cf-4df3-8f16-42fc31cd1ba7 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:33.106286 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da46bd3-a8cf-4df3-8f16-42fc31cd1ba7 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:33.108582 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:33.139604 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cc784-ab1e-4484-8635-6d51b09000ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:33.140326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cc784-ab1e-4484-8635-6d51b09000ca None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:33.140613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cc784-ab1e-4484-8635-6d51b09000ca None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:33.140890 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cc784-ab1e-4484-8635-6d51b09000ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:33.142097 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cc784-ab1e-4484-8635-6d51b09000ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:33.143572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cc784-ab1e-4484-8635-6d51b09000ca None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:33.145170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 30/60] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:33.150851 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705da7c-7799-45c0-b313-e2f7c2c7ac7c None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:33.249315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705da7c-7799-45c0-b313-e2f7c2c7ac7c None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:33.283662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65e204-7061-4a2a-9667-674f573b96a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:33.284338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65e204-7061-4a2a-9667-674f573b96a4 None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:33.284628 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65e204-7061-4a2a-9667-674f573b96a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:33.284909 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65e204-7061-4a2a-9667-674f573b96a4 None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:33.285647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65e204-7061-4a2a-9667-674f573b96a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:33.287098 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65e204-7061-4a2a-9667-674f573b96a4 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:33.395102 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 31/61] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Jul 12 14:20:33 2022] POST /identity/v3/users => generated 275 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:36.763223 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bd077-5694-429d-9f7a-3e66e8173075 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:36.763783 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bd077-5694-429d-9f7a-3e66e8173075 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:36.763858 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bd077-5694-429d-9f7a-3e66e8173075 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:36.765553 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 31/62] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:36.772916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee28495-f119-49d7-8111-9e6eb0710f70 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:36.773390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee28495-f119-49d7-8111-9e6eb0710f70 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:36.773581 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee28495-f119-49d7-8111-9e6eb0710f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:36.786944 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:36.796305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-fee28495-f119-49d7-8111-9e6eb0710f70 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:36.803141 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fee28495-f119-49d7-8111-9e6eb0710f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:36.890059 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e0b72-57e7-4fe7-93ca-6ff8305a13e5 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:36.890687 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e0b72-57e7-4fe7-93ca-6ff8305a13e5 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:36.891204 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e0b72-57e7-4fe7-93ca-6ff8305a13e5 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:36.891949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 32/63] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:20:36.893257 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 32/64] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:36.909042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9979a90-dc56-4c0c-84bb-aed6fbe57bed None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:36.909343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9979a90-dc56-4c0c-84bb-aed6fbe57bed None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:36.909627 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9979a90-dc56-4c0c-84bb-aed6fbe57bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:36.934973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e0b72-57e7-4fe7-93ca-6ff8305a13e5 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:36.939997 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-a9979a90-dc56-4c0c-84bb-aed6fbe57bed None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:36.941226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-a9979a90-dc56-4c0c-84bb-aed6fbe57bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:37.017740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 33/65] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:20:37.034386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdea6f2-bfb2-41e0-aab9-daa92f76ee27 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.034994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdea6f2-bfb2-41e0-aab9-daa92f76ee27 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.035527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdea6f2-bfb2-41e0-aab9-daa92f76ee27 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.037120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 34/66] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:20:37.043323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4017a-3b54-4c4e-92bf-ec243f65cc13 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.043919 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4017a-3b54-4c4e-92bf-ec243f65cc13 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.044203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4017a-3b54-4c4e-92bf-ec243f65cc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.068189 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-a4d4017a-3b54-4c4e-92bf-ec243f65cc13 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:37.070318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-a4d4017a-3b54-4c4e-92bf-ec243f65cc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:37.112370 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e0b72-57e7-4fe7-93ca-6ff8305a13e5 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:37.153318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:37.161143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 35/67] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:37.162132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313599a-57be-4cc6-af90-ea44dd5b4982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:37.162436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4017a-3b54-4c4e-92bf-ec243f65cc13 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.163098 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313599a-57be-4cc6-af90-ea44dd5b4982 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.163473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313599a-57be-4cc6-af90-ea44dd5b4982 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.169741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313599a-57be-4cc6-af90-ea44dd5b4982 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.179901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313599a-57be-4cc6-af90-ea44dd5b4982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:37.191839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-3313599a-57be-4cc6-af90-ea44dd5b4982 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:37.191839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:37.191839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:37.191839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:37.191839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:37.191839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:37.191839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:37.191839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:37.191839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:37.191839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:37.191839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:37.191839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:37.191839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:37.191839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:37.191839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:37.191839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:37.192728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:37.192728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:37.192728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:37.192728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:37.192728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:37.192728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:37.192728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:37.192728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:37.192728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:37.192728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:37.192728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:37.192728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:37.192728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:37.192728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:37.192728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:37.192728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:37.193477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:37.193477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:37.193477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:37.193477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:37.193477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:37.193477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:37.193477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:37.193477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:37.193477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:37.193477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:37.193477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:37.193477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:20:37.193477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 33/68] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:37.201089 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313599a-57be-4cc6-af90-ea44dd5b4982 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.243829 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:37.282939 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4017a-3b54-4c4e-92bf-ec243f65cc13 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:37.311811 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313599a-57be-4cc6-af90-ea44dd5b4982 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:37.319448 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee32e-d991-4fd1-a31e-0d14097f587b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:37.320293 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee32e-d991-4fd1-a31e-0d14097f587b None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.320576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee32e-d991-4fd1-a31e-0d14097f587b None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.320847 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee32e-d991-4fd1-a31e-0d14097f587b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.331506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ee32e-d991-4fd1-a31e-0d14097f587b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:37.339922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-fc5ee32e-d991-4fd1-a31e-0d14097f587b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:37.339922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:37.339922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:37.339922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:37.339922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:37.339922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:37.339922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:37.339922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:37.339922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:37.339922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:37.339922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:37.339922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:37.339922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:37.339922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:37.339922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:37.339922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:37.340891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:37.340891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:37.340891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:37.340891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:37.340891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:37.340891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:37.340891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:37.340891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:37.340891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:37.340891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:37.340891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:37.340891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:37.340891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:37.340891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:37.340891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:37.340891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:37.341660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:37.341660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:37.341660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:37.341660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:37.341660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:37.341660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:37.341660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:37.341660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:37.341660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:37.341660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:37.341660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:37.341660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:20:37.341660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 36/69] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:37.342275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee32e-d991-4fd1-a31e-0d14097f587b None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.352090 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27015f-d0f0-4a93-9b6c-c30519afcf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:37.353432 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27015f-d0f0-4a93-9b6c-c30519afcf6c None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.353710 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27015f-d0f0-4a93-9b6c-c30519afcf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.353983 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27015f-d0f0-4a93-9b6c-c30519afcf6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.364153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27015f-d0f0-4a93-9b6c-c30519afcf6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:37.373152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-3f27015f-d0f0-4a93-9b6c-c30519afcf6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:37.373152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:37.373152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:37.373152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:37.373152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:37.373152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:37.373152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:37.373152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:37.373152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:37.373152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:37.373152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:37.373152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:37.373152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:37.373152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:37.373152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:37.373152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:37.374122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:37.374122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:37.374122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:37.374122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:37.374122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:37.374122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:37.374122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:37.374122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:37.374122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:37.374122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:37.374122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:37.374122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:37.374122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:37.374122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:37.374122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:37.374122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:37.374960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:37.374960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:37.374960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:37.374960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:37.374960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:37.374960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:37.374960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:37.374960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:37.374960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:37.374960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:37.374960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:37.374960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:20:37.374960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 34/70] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:37.375633 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af17fa0-d913-4b42-b52f-0b7f6847d697 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.376148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af17fa0-d913-4b42-b52f-0b7f6847d697 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.376305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af17fa0-d913-4b42-b52f-0b7f6847d697 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.377651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 35/71] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:37.380034 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708a166-228a-47b7-99c9-aebb70f8c3df None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.380601 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708a166-228a-47b7-99c9-aebb70f8c3df None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.381071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708a166-228a-47b7-99c9-aebb70f8c3df None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.382456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 36/72] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:37.383740 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708a166-228a-47b7-99c9-aebb70f8c3df None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.400272 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:37.448498 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee32e-d991-4fd1-a31e-0d14097f587b None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:37.483188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:37.486523 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3a3a0-8bdd-40de-a9ad-d7157f571f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:37.487215 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3a3a0-8bdd-40de-a9ad-d7157f571f73 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.487537 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3a3a0-8bdd-40de-a9ad-d7157f571f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.487822 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3a3a0-8bdd-40de-a9ad-d7157f571f73 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.488589 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3a3a0-8bdd-40de-a9ad-d7157f571f73 None admin] RBAC: Adding query filter params (name=member) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:37.488905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3a3a0-8bdd-40de-a9ad-d7157f571f73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:37.490311 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3a3a0-8bdd-40de-a9ad-d7157f571f73 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:37.492465 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708a166-228a-47b7-99c9-aebb70f8c3df None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:37.500695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 37/73] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:37.502674 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3a3a0-8bdd-40de-a9ad-d7157f571f73 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.535299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ef82c-23eb-4310-975b-36e032d57522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:37.535895 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ef82c-23eb-4310-975b-36e032d57522 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.536188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ef82c-23eb-4310-975b-36e032d57522 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.536473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ef82c-23eb-4310-975b-36e032d57522 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.537242 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ef82c-23eb-4310-975b-36e032d57522 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:37.537561 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ef82c-23eb-4310-975b-36e032d57522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:37.538957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ef82c-23eb-4310-975b-36e032d57522 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:37.548463 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 37/74] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:37.549725 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4497fd-b181-4702-93e4-f1145591cd1e None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.550018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4497fd-b181-4702-93e4-f1145591cd1e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.550303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4497fd-b181-4702-93e4-f1145591cd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.568306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-4f4497fd-b181-4702-93e4-f1145591cd1e None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:37.569757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-4f4497fd-b181-4702-93e4-f1145591cd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:37.609711 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3a3a0-8bdd-40de-a9ad-d7157f571f73 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:37.627005 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:37.641137 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 38/75] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:37.655487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62cde8-8f34-4e25-ac17-4e230ab1465e None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.655487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62cde8-8f34-4e25-ac17-4e230ab1465e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.655487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62cde8-8f34-4e25-ac17-4e230ab1465e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.655805 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d18b7-9d27-4222-af7f-e9ca28decee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:37.655805 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d18b7-9d27-4222-af7f-e9ca28decee7 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.655805 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d18b7-9d27-4222-af7f-e9ca28decee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.655805 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d18b7-9d27-4222-af7f-e9ca28decee7 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.656055 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d18b7-9d27-4222-af7f-e9ca28decee7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:37.656055 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d18b7-9d27-4222-af7f-e9ca28decee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:37.656055 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d18b7-9d27-4222-af7f-e9ca28decee7 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:37.659458 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 38/76] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:37.662083 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d18b7-9d27-4222-af7f-e9ca28decee7 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.662220 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-3f62cde8-8f34-4e25-ac17-4e230ab1465e None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:37.662220 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-3f62cde8-8f34-4e25-ac17-4e230ab1465e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:37.747307 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 39/77] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:37.747307 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62cde8-8f34-4e25-ac17-4e230ab1465e None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.756441 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:37.772756 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d18b7-9d27-4222-af7f-e9ca28decee7 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:37.808943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7c8bd-6502-4df9-8736-84ec1b82e150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:37.809837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7c8bd-6502-4df9-8736-84ec1b82e150 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.810138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7c8bd-6502-4df9-8736-84ec1b82e150 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.810423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7c8bd-6502-4df9-8736-84ec1b82e150 None admin] PATH_INFO: `/v3/users/8c1a31a288804174b0c5662f15125f80` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.824922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7c8bd-6502-4df9-8736-84ec1b82e150 None admin] RBAC: Authorizing `identity:get_user(user_id=8c1a31a288804174b0c5662f15125f80)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:37.826418 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7c8bd-6502-4df9-8736-84ec1b82e150 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:37.828225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 39/78] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/users/8c1a31a288804174b0c5662f15125f80 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:37.829005 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7c8bd-6502-4df9-8736-84ec1b82e150 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.855571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62cde8-8f34-4e25-ac17-4e230ab1465e None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:37.868929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:37.891074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c7340-7f8a-43da-bd34-939df7b00621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:37.891990 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7340-7f8a-43da-bd34-939df7b00621 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:37.892270 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7340-7f8a-43da-bd34-939df7b00621 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:37.892552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7340-7f8a-43da-bd34-939df7b00621 None admin] PATH_INFO: `/v3/users/6f66109ae90a4460b768c8db1b53b02e` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:37.893766 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c7340-7f8a-43da-bd34-939df7b00621 None admin] RBAC: Authorizing `identity:get_user(user_id=6f66109ae90a4460b768c8db1b53b02e)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:37.895230 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c7340-7f8a-43da-bd34-939df7b00621 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:37.896924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 40/79] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/users/6f66109ae90a4460b768c8db1b53b02e => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:37.897726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c7340-7f8a-43da-bd34-939df7b00621 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:37.929559 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7c8bd-6502-4df9-8736-84ec1b82e150 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.023560 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e4582-8025-4858-adac-32f54174d74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.023560 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e4582-8025-4858-adac-32f54174d74f None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.023560 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e4582-8025-4858-adac-32f54174d74f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.023560 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e4582-8025-4858-adac-32f54174d74f None admin] PATH_INFO: `/v3/users/8c1a31a288804174b0c5662f15125f80` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.023945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e4582-8025-4858-adac-32f54174d74f None admin] RBAC: Authorizing `identity:get_user(user_id=8c1a31a288804174b0c5662f15125f80)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:38.023945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e4582-8025-4858-adac-32f54174d74f None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:38.023945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 40/80] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/users/8c1a31a288804174b0c5662f15125f80 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:38.023945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e4582-8025-4858-adac-32f54174d74f None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:38.024214 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:38.024214 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c7340-7f8a-43da-bd34-939df7b00621 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.041099 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b73edd-911e-4e5c-a67c-081ad72154bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.041903 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b73edd-911e-4e5c-a67c-081ad72154bb None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.042187 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b73edd-911e-4e5c-a67c-081ad72154bb None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.042466 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b73edd-911e-4e5c-a67c-081ad72154bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.052596 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b73edd-911e-4e5c-a67c-081ad72154bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:38.061114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-99b73edd-911e-4e5c-a67c-081ad72154bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:38.061114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:38.061114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:38.061114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:38.061114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:38.061114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:38.061114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:38.061114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:38.061114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:38.061114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:38.061114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:38.061114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:38.061114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:38.061114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:38.061114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:38.061114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:38.062052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:38.062052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:38.062052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:38.062052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:38.062052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:38.062052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:38.062052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:38.062052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:38.062052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:38.062052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:38.062052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:38.062052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:38.062052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:38.062052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:38.062052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:38.062052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:38.062938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:38.062938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:38.062938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:38.062938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:38.062938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:38.062938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:38.062938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:38.062938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:38.062938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:38.062938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:38.062938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:38.062938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:20:38.062938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 41/81] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:38.063617 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b73edd-911e-4e5c-a67c-081ad72154bb None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:38.080398 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e4582-8025-4858-adac-32f54174d74f None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.088798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:38.118825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c00472-5739-4442-9cda-8e3c759477d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.120015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c00472-5739-4442-9cda-8e3c759477d2 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.120306 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c00472-5739-4442-9cda-8e3c759477d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.120588 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c00472-5739-4442-9cda-8e3c759477d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.124622 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c00472-5739-4442-9cda-8e3c759477d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:38.124622 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c00472-5739-4442-9cda-8e3c759477d2 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:38.124943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 41/82] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:38.125725 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c00472-5739-4442-9cda-8e3c759477d2 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:38.180169 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b73edd-911e-4e5c-a67c-081ad72154bb None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.214360 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bef1b-c7cb-4651-9624-f8ebaaebfa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.215018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bef1b-c7cb-4651-9624-f8ebaaebfa6f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.215335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bef1b-c7cb-4651-9624-f8ebaaebfa6f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.215619 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bef1b-c7cb-4651-9624-f8ebaaebfa6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.228042 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:38.234222 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c00472-5739-4442-9cda-8e3c759477d2 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.274708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e17fb-c3fa-4ea3-8f48-f332554f0c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.275406 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e17fb-c3fa-4ea3-8f48-f332554f0c6c None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.275702 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e17fb-c3fa-4ea3-8f48-f332554f0c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.275983 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e17fb-c3fa-4ea3-8f48-f332554f0c6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.290259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bef1b-c7cb-4651-9624-f8ebaaebfa6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:38.291899 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bef1b-c7cb-4651-9624-f8ebaaebfa6f None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:38.319262 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:38.344671 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e17fb-c3fa-4ea3-8f48-f332554f0c6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:38.346129 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e17fb-c3fa-4ea3-8f48-f332554f0c6c None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:38.391381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 42/83] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:38.392245 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bef1b-c7cb-4651-9624-f8ebaaebfa6f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:38.434922 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:38.447252 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 42/84] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:38.448141 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e17fb-c3fa-4ea3-8f48-f332554f0c6c None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:38.507653 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bef1b-c7cb-4651-9624-f8ebaaebfa6f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.528923 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:38.543825 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9f3fa-8e31-4b98-92d1-d94a20654dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.544572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9f3fa-8e31-4b98-92d1-d94a20654dca None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.544866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9f3fa-8e31-4b98-92d1-d94a20654dca None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.545152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9f3fa-8e31-4b98-92d1-d94a20654dca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.553756 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e17fb-c3fa-4ea3-8f48-f332554f0c6c None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.590363 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30897f2e-0602-42d2-adc6-bb75c93d377e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.590964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30897f2e-0602-42d2-adc6-bb75c93d377e None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.591247 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30897f2e-0602-42d2-adc6-bb75c93d377e None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.591562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30897f2e-0602-42d2-adc6-bb75c93d377e None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.592323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30897f2e-0602-42d2-adc6-bb75c93d377e None admin] RBAC: Adding query filter params (name=member) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:38.592630 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30897f2e-0602-42d2-adc6-bb75c93d377e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:38.594021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30897f2e-0602-42d2-adc6-bb75c93d377e None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:38.604288 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 43/85] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:38.605125 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30897f2e-0602-42d2-adc6-bb75c93d377e None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:38.623127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9f3fa-8e31-4b98-92d1-d94a20654dca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:38.624703 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f9f3fa-8e31-4b98-92d1-d94a20654dca None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:38.667140 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:38.709540 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30897f2e-0602-42d2-adc6-bb75c93d377e None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.726231 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 43/86] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:38.726866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9f3fa-8e31-4b98-92d1-d94a20654dca None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:38.744636 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0eed8-d61d-4032-b1fa-a8c6056cecf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.745564 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0eed8-d61d-4032-b1fa-a8c6056cecf8 None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.745851 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0eed8-d61d-4032-b1fa-a8c6056cecf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.746132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0eed8-d61d-4032-b1fa-a8c6056cecf8 None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.746847 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0eed8-d61d-4032-b1fa-a8c6056cecf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:38.748325 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0eed8-d61d-4032-b1fa-a8c6056cecf8 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:38.756655 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:38.828393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9f3fa-8e31-4b98-92d1-d94a20654dca None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:38.847835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 44/87] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Jul 12 14:20:38 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:38.847835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0eed8-d61d-4032-b1fa-a8c6056cecf8 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:38.865305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e353a53-e05e-4957-9401-dabd50263ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:38.867167 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e353a53-e05e-4957-9401-dabd50263ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:38.867729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e353a53-e05e-4957-9401-dabd50263ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:38.868200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e353a53-e05e-4957-9401-dabd50263ab9 None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:38.870519 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e353a53-e05e-4957-9401-dabd50263ab9 None admin] RBAC: Authorizing `identity:get_project(project_id=21f896d0c1d8492287fcd5e0801dec94)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:38.872364 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e353a53-e05e-4957-9401-dabd50263ab9 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:38.874632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 44/88] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:38 2022] GET /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:38.875752 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e353a53-e05e-4957-9401-dabd50263ab9 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:38.904784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:38.993301 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0eed8-d61d-4032-b1fa-a8c6056cecf8 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:39.007970 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e353a53-e05e-4957-9401-dabd50263ab9 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:39.041750 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9afd7-b626-4f05-91ac-2a4b87dc84b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:39.042879 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9afd7-b626-4f05-91ac-2a4b87dc84b5 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:39.043170 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9afd7-b626-4f05-91ac-2a4b87dc84b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:39.043551 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9afd7-b626-4f05-91ac-2a4b87dc84b5 None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:39.044802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9afd7-b626-4f05-91ac-2a4b87dc84b5 None admin] RBAC: Authorizing `identity:get_project(project_id=21f896d0c1d8492287fcd5e0801dec94)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:39.046422 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9afd7-b626-4f05-91ac-2a4b87dc84b5 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:39.048213 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 45/89] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:38 2022] GET /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:39.049290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9afd7-b626-4f05-91ac-2a4b87dc84b5 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:39.053644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3695df-c4e4-4365-b5eb-46eb2bd38f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:39.054557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3695df-c4e4-4365-b5eb-46eb2bd38f1f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:39.054847 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3695df-c4e4-4365-b5eb-46eb2bd38f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:39.055127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3695df-c4e4-4365-b5eb-46eb2bd38f1f None admin] PATH_INFO: `/v3/users/8c1a31a288804174b0c5662f15125f80` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:39.056669 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3695df-c4e4-4365-b5eb-46eb2bd38f1f None admin] RBAC: Authorizing `identity:get_user(user_id=8c1a31a288804174b0c5662f15125f80)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:39.058165 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3695df-c4e4-4365-b5eb-46eb2bd38f1f None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:39.060737 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 45/90] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:38 2022] GET /identity/v3/users/8c1a31a288804174b0c5662f15125f80 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:39.060877 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3695df-c4e4-4365-b5eb-46eb2bd38f1f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:39.126843 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:39.161837 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:39.182574 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9afd7-b626-4f05-91ac-2a4b87dc84b5 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:39.189612 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3695df-c4e4-4365-b5eb-46eb2bd38f1f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:39.219745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f165cd4-3758-4885-9b69-127bcfa8f5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:39.220628 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f165cd4-3758-4885-9b69-127bcfa8f5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:39.220962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f165cd4-3758-4885-9b69-127bcfa8f5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:39.221198 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f165cd4-3758-4885-9b69-127bcfa8f5a5 None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:39.222418 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f165cd4-3758-4885-9b69-127bcfa8f5a5 None admin] RBAC: Authorizing `identity:get_project(project_id=21f896d0c1d8492287fcd5e0801dec94)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:39.223938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f165cd4-3758-4885-9b69-127bcfa8f5a5 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:39.225799 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 46/91] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:39 2022] GET /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:39.226419 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f165cd4-3758-4885-9b69-127bcfa8f5a5 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:39.256362 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f9d10-4c52-42dc-9e26-f119c698e0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:39.257572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f9d10-4c52-42dc-9e26-f119c698e0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:39.258073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f9d10-4c52-42dc-9e26-f119c698e0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:39.259613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f9d10-4c52-42dc-9e26-f119c698e0b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:39.260979 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f9d10-4c52-42dc-9e26-f119c698e0b3 None admin] RBAC: Adding query filter params (role.id=5444412a1f604ebaa9282a244859c051, scope.project.id=21f896d0c1d8492287fcd5e0801dec94, user.id=8c1a31a288804174b0c5662f15125f80) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:39.261481 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f9d10-4c52-42dc-9e26-f119c698e0b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:39.263858 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f9d10-4c52-42dc-9e26-f119c698e0b3 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:39.272283 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 46/92] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:39 2022] GET /identity/v3/role_assignments?user.id=8c1a31a288804174b0c5662f15125f80&scope.project.id=21f896d0c1d8492287fcd5e0801dec94&role.id=5444412a1f604ebaa9282a244859c051 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:39.279316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f9d10-4c52-42dc-9e26-f119c698e0b3 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:39.484547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f165cd4-3758-4885-9b69-127bcfa8f5a5 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:39.487095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f9d10-4c52-42dc-9e26-f119c698e0b3 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:39.533008 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4249b3-f77b-47ad-99ff-7bae294f6b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:39.533673 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4249b3-f77b-47ad-99ff-7bae294f6b7a None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:39.534015 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4249b3-f77b-47ad-99ff-7bae294f6b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:39.534302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4249b3-f77b-47ad-99ff-7bae294f6b7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:39.548534 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:39.561498 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5a1bb-867b-40d8-8eda-300891c981bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:39.562177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5a1bb-867b-40d8-8eda-300891c981bc None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:39.562468 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5a1bb-867b-40d8-8eda-300891c981bc None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:39.566084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5a1bb-867b-40d8-8eda-300891c981bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:39.566084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5a1bb-867b-40d8-8eda-300891c981bc None admin] RBAC: Adding query filter params (role.id=ae530119fc5c42358179521ce865b5d7, scope.project.id=21f896d0c1d8492287fcd5e0801dec94, user.id=6f66109ae90a4460b768c8db1b53b02e) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:39.566084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5a1bb-867b-40d8-8eda-300891c981bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:39.566419 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:39.573436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5a1bb-867b-40d8-8eda-300891c981bc None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:39.583823 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 47/93] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:39 2022] GET /identity/v3/role_assignments?user.id=6f66109ae90a4460b768c8db1b53b02e&scope.project.id=21f896d0c1d8492287fcd5e0801dec94&role.id=ae530119fc5c42358179521ce865b5d7 => generated 259 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:39.587930 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5a1bb-867b-40d8-8eda-300891c981bc None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:39.692334 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4249b3-f77b-47ad-99ff-7bae294f6b7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:39.693924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4249b3-f77b-47ad-99ff-7bae294f6b7a None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:39.839050 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5a1bb-867b-40d8-8eda-300891c981bc None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:39.905954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332d8c5-34b8-4425-bb4c-e1b320a4cd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:39.906711 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332d8c5-34b8-4425-bb4c-e1b320a4cd78 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:39.906909 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332d8c5-34b8-4425-bb4c-e1b320a4cd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:39.907187 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332d8c5-34b8-4425-bb4c-e1b320a4cd78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:39.908065 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332d8c5-34b8-4425-bb4c-e1b320a4cd78 None admin] RBAC: Adding query filter params (role.id=6184586642114a188e13c695442669f8, scope.project.id=21f896d0c1d8492287fcd5e0801dec94, user.id=8c1a31a288804174b0c5662f15125f80) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:39.908380 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332d8c5-34b8-4425-bb4c-e1b320a4cd78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:39.909831 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332d8c5-34b8-4425-bb4c-e1b320a4cd78 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:39.914468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 47/94] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:39.919657 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 48/95] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:39 2022] GET /identity/v3/role_assignments?user.id=8c1a31a288804174b0c5662f15125f80&scope.project.id=21f896d0c1d8492287fcd5e0801dec94&role.id=6184586642114a188e13c695442669f8 => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:39.924421 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4249b3-f77b-47ad-99ff-7bae294f6b7a None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:39.983159 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:40.063262 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4249b3-f77b-47ad-99ff-7bae294f6b7a None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:40.114677 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a7d07-7b1c-4d95-a57a-86469305c1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:40.115501 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a7d07-7b1c-4d95-a57a-86469305c1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:40.115789 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a7d07-7b1c-4d95-a57a-86469305c1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:40.116070 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a7d07-7b1c-4d95-a57a-86469305c1c1 None admin] PATH_INFO: `/v3/projects/722e495737b64f63a913e644534fa749` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:40.117357 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a7d07-7b1c-4d95-a57a-86469305c1c1 None admin] RBAC: Authorizing `identity:get_project(project_id=722e495737b64f63a913e644534fa749)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:40.118908 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a7d07-7b1c-4d95-a57a-86469305c1c1 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:40.121220 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 48/96] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:39 2022] GET /identity/v3/projects/722e495737b64f63a913e644534fa749 => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:40.130265 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332d8c5-34b8-4425-bb4c-e1b320a4cd78 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:40.211509 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:40.272622 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332d8c5-34b8-4425-bb4c-e1b320a4cd78 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:40.319630 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36c7c2-6e51-4008-89ad-c94c98c1dda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:40.320650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36c7c2-6e51-4008-89ad-c94c98c1dda1 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:40.321350 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36c7c2-6e51-4008-89ad-c94c98c1dda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:40.321929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36c7c2-6e51-4008-89ad-c94c98c1dda1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:40.322984 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36c7c2-6e51-4008-89ad-c94c98c1dda1 None admin] RBAC: Adding query filter params (role.id=5444412a1f604ebaa9282a244859c051, scope.project.id=722e495737b64f63a913e644534fa749, user.id=8c1a31a288804174b0c5662f15125f80) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:40.323558 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36c7c2-6e51-4008-89ad-c94c98c1dda1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:40.325204 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36c7c2-6e51-4008-89ad-c94c98c1dda1 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:40.332629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 49/97] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:40 2022] GET /identity/v3/role_assignments?user.id=8c1a31a288804174b0c5662f15125f80&scope.project.id=722e495737b64f63a913e644534fa749&role.id=5444412a1f604ebaa9282a244859c051 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:41.600814 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e836fd0-eaaa-4698-8196-c1453f81d2f2 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:41.601900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e836fd0-eaaa-4698-8196-c1453f81d2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:41.602701 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e836fd0-eaaa-4698-8196-c1453f81d2f2 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:41.604462 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 49/98] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:41.611230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a37b7-40e8-4508-a2ea-5dc6a889941a None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:41.611230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a37b7-40e8-4508-a2ea-5dc6a889941a None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:41.611230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a37b7-40e8-4508-a2ea-5dc6a889941a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:41.636330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-f97a37b7-40e8-4508-a2ea-5dc6a889941a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:41.641275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-f97a37b7-40e8-4508-a2ea-5dc6a889941a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:41.722019 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 50/99] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:41.742170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077581e-4b9a-47da-b135-89bb8d516b58 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:41.742479 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077581e-4b9a-47da-b135-89bb8d516b58 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:41.742744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077581e-4b9a-47da-b135-89bb8d516b58 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:41.745888 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 50/100] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:41.750788 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae986191-9d6d-40ed-a00a-1bedd74b3ed2 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:41.751088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae986191-9d6d-40ed-a00a-1bedd74b3ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:41.751408 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae986191-9d6d-40ed-a00a-1bedd74b3ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:41.764648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077581e-4b9a-47da-b135-89bb8d516b58 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:41.783302 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-ae986191-9d6d-40ed-a00a-1bedd74b3ed2 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:41.783302 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ae986191-9d6d-40ed-a00a-1bedd74b3ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:41.846312 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:41.891140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 51/101] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:41.923341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae986191-9d6d-40ed-a00a-1bedd74b3ed2 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:42.000582 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077581e-4b9a-47da-b135-89bb8d516b58 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:42.020890 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:42.104748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1417545-aff2-44dc-bce0-e3ac3feb70be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:42.105614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1417545-aff2-44dc-bce0-e3ac3feb70be None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.105905 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1417545-aff2-44dc-bce0-e3ac3feb70be None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.106187 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1417545-aff2-44dc-bce0-e3ac3feb70be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.129687 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1417545-aff2-44dc-bce0-e3ac3feb70be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:42.137765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-c1417545-aff2-44dc-bce0-e3ac3feb70be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:20:42.137765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:42.137765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:42.137765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:42.137765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:42.137765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:42.137765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:42.137765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:42.137765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:42.137765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:42.137765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:42.137765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:42.137765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:42.137765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:42.137765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:42.137765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:42.138658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:42.138658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:42.138658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:42.138658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:42.138658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:42.138658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:42.138658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:42.138658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:42.138658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:42.138658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:42.138658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:42.138658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:42.138658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:42.138658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:42.138658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:42.138658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:42.139530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:42.139530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:42.139530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:42.139530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:42.139530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:42.139530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:42.139530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:42.139530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:42.139530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:42.139530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:42.139530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:20:42.139530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:20:42.147802 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 51/102] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:42.153894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1417545-aff2-44dc-bce0-e3ac3feb70be None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:42.173491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae986191-9d6d-40ed-a00a-1bedd74b3ed2 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:42.277013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7fabb-54ca-41f8-ad72-6c4dc00d8740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:42.277846 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7fabb-54ca-41f8-ad72-6c4dc00d8740 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.278134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7fabb-54ca-41f8-ad72-6c4dc00d8740 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.278417 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7fabb-54ca-41f8-ad72-6c4dc00d8740 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.279653 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7fabb-54ca-41f8-ad72-6c4dc00d8740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:42.281139 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7fabb-54ca-41f8-ad72-6c4dc00d8740 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:42.291774 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 52/103] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:42.293401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7fabb-54ca-41f8-ad72-6c4dc00d8740 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:42.358129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1417545-aff2-44dc-bce0-e3ac3feb70be None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:42.427375 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:42.428743 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c323818-e415-48c6-93fa-757b91bab966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:42.429435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c323818-e415-48c6-93fa-757b91bab966 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.429722 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c323818-e415-48c6-93fa-757b91bab966 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.430002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c323818-e415-48c6-93fa-757b91bab966 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.430844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c323818-e415-48c6-93fa-757b91bab966 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:42.431160 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c323818-e415-48c6-93fa-757b91bab966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:42.435622 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c323818-e415-48c6-93fa-757b91bab966 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:42.453559 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 52/104] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:42.454945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad50d7-1fa4-418f-8698-259e105cd76f None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.455240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad50d7-1fa4-418f-8698-259e105cd76f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.455550 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad50d7-1fa4-418f-8698-259e105cd76f None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.459636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 53/105] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:42.464954 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad50d7-1fa4-418f-8698-259e105cd76f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:42.518917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7fabb-54ca-41f8-ad72-6c4dc00d8740 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:42.557868 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7b0ef-716e-49af-a93d-cc954f590515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:42.558908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7b0ef-716e-49af-a93d-cc954f590515 None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.559386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7b0ef-716e-49af-a93d-cc954f590515 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.559934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7b0ef-716e-49af-a93d-cc954f590515 None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.560845 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7b0ef-716e-49af-a93d-cc954f590515 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:42.562774 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7b0ef-716e-49af-a93d-cc954f590515 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:42.578893 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:42.661283 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad50d7-1fa4-418f-8698-259e105cd76f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:42.689389 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 53/106] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Jul 12 14:20:42 2022] POST /identity/v3/projects => generated 302 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:42.690763 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac066e-31d6-4476-88df-9cdc9ed1117a None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.691066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac066e-31d6-4476-88df-9cdc9ed1117a None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.692549 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac066e-31d6-4476-88df-9cdc9ed1117a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.719151 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee68223-3504-4e50-a3ed-9f8824d5387b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:42.720098 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee68223-3504-4e50-a3ed-9f8824d5387b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.720444 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee68223-3504-4e50-a3ed-9f8824d5387b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.720732 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee68223-3504-4e50-a3ed-9f8824d5387b None admin] PATH_INFO: `/v3/users/1bed0cdc27f24d4c9ad3a8605eb8a1c5` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.741774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee68223-3504-4e50-a3ed-9f8824d5387b None admin] RBAC: Authorizing `identity:get_user(user_id=1bed0cdc27f24d4c9ad3a8605eb8a1c5)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:42.746693 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee68223-3504-4e50-a3ed-9f8824d5387b None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:42.746693 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 54/107] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:42 2022] GET /identity/v3/users/1bed0cdc27f24d4c9ad3a8605eb8a1c5 => generated 289 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:42.748312 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-4bac066e-31d6-4476-88df-9cdc9ed1117a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:42.749756 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-4bac066e-31d6-4476-88df-9cdc9ed1117a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:42.752840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee68223-3504-4e50-a3ed-9f8824d5387b None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:42.876829 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 54/108] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:42.878846 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf060cb5-1243-4a49-8e9b-b0f5294ed6de None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.879422 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf060cb5-1243-4a49-8e9b-b0f5294ed6de None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.879919 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf060cb5-1243-4a49-8e9b-b0f5294ed6de None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.881868 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 55/109] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:42.887429 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee68223-3504-4e50-a3ed-9f8824d5387b None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:42.888197 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f4ad5-3b8b-42c9-b401-4999475d7e3a None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.888708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f4ad5-3b8b-42c9-b401-4999475d7e3a None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.889191 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f4ad5-3b8b-42c9-b401-4999475d7e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.912472 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:42.922407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-cb2f4ad5-3b8b-42c9-b401-4999475d7e3a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:42.923805 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-cb2f4ad5-3b8b-42c9-b401-4999475d7e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:42.930817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb6d28-b369-4a77-a658-c17cef9f31b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:42.931549 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb6d28-b369-4a77-a658-c17cef9f31b3 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:42.939356 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb6d28-b369-4a77-a658-c17cef9f31b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:42.939356 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb6d28-b369-4a77-a658-c17cef9f31b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:42.959882 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:43.003101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 56/110] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:43.004226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f4ad5-3b8b-42c9-b401-4999475d7e3a None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:43.009237 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb6d28-b369-4a77-a658-c17cef9f31b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:43.010722 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb6d28-b369-4a77-a658-c17cef9f31b3 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:43.117351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:43.125292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f4ad5-3b8b-42c9-b401-4999475d7e3a None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:43.131011 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 55/111] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:43.131925 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb6d28-b369-4a77-a658-c17cef9f31b3 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:43.172619 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08206d27-9230-4f30-8ec3-44e6b3c90969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:43.173437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08206d27-9230-4f30-8ec3-44e6b3c90969 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.173719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08206d27-9230-4f30-8ec3-44e6b3c90969 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.174250 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08206d27-9230-4f30-8ec3-44e6b3c90969 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.193793 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08206d27-9230-4f30-8ec3-44e6b3c90969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:43.204476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-08206d27-9230-4f30-8ec3-44e6b3c90969 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:43.204476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:43.204476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:43.204476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:43.204476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:43.204476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:43.204476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:43.204476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:43.204476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:43.204476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:43.204476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:43.204476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:43.204476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:43.204476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:43.204476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:43.204476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:43.205569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:43.205569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:43.205569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:43.205569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:43.205569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:43.205569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:43.205569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:43.205569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:43.205569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:43.205569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:43.205569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:43.205569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:43.205569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:43.205569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:43.205569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:43.205569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:43.206491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:43.206491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:43.206491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:43.206491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:43.206491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:43.206491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:43.206491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:43.206491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:43.206491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:43.206491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:43.206491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:43.206491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:20:43.207338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 57/112] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:43.208135 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520203f-7a03-455d-b9fd-b10c032ca55d None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.208430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520203f-7a03-455d-b9fd-b10c032ca55d None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.208715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520203f-7a03-455d-b9fd-b10c032ca55d None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.210191 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 58/113] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:43.214710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520203f-7a03-455d-b9fd-b10c032ca55d None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:43.248501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:43.278250 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb6d28-b369-4a77-a658-c17cef9f31b3 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:43.319686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de3a0b-bef5-4cd4-a5f4-666dc684a99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:43.320876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de3a0b-bef5-4cd4-a5f4-666dc684a99b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.321389 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de3a0b-bef5-4cd4-a5f4-666dc684a99b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.321867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de3a0b-bef5-4cd4-a5f4-666dc684a99b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.331802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520203f-7a03-455d-b9fd-b10c032ca55d None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:43.333944 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de3a0b-bef5-4cd4-a5f4-666dc684a99b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:43.342644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-a1de3a0b-bef5-4cd4-a5f4-666dc684a99b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:43.342644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:43.342644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:43.342644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:43.342644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:43.342644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:43.342644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:43.342644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:43.342644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:43.342644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:43.342644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:43.342644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:43.342644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:43.342644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:43.342644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:43.342644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:43.343554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:43.343554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:43.343554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:43.343554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:43.343554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:43.343554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:43.343554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:43.343554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:43.343554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:43.343554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:43.343554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:43.343554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:43.343554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:43.343554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:43.343554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:43.343554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:43.344305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:43.344305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:43.344305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:43.344305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:43.344305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:43.344305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:43.344305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:43.344305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:43.344305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:43.344305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:43.344305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:43.344305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:20:43.346980 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 56/114] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:20:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:43.348150 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de3a0b-bef5-4cd4-a5f4-666dc684a99b None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:43.382672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c1a83-1f05-4f9b-bda7-aa03b48c8b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:43.384146 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c1a83-1f05-4f9b-bda7-aa03b48c8b90 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.384461 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c1a83-1f05-4f9b-bda7-aa03b48c8b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.384747 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c1a83-1f05-4f9b-bda7-aa03b48c8b90 None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.386824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c1a83-1f05-4f9b-bda7-aa03b48c8b90 None admin] RBAC: Authorizing `identity:get_project(project_id=21f896d0c1d8492287fcd5e0801dec94)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:43.389366 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c1a83-1f05-4f9b-bda7-aa03b48c8b90 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:43.392256 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 59/115] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:43 2022] GET /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:43.394430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7de260-309f-49fa-91b4-c1c5cc407e7f None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.394730 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7de260-309f-49fa-91b4-c1c5cc407e7f None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.395017 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7de260-309f-49fa-91b4-c1c5cc407e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.415657 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:43.417295 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-5f7de260-309f-49fa-91b4-c1c5cc407e7f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:43.418544 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5f7de260-309f-49fa-91b4-c1c5cc407e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:43.485252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de3a0b-bef5-4cd4-a5f4-666dc684a99b None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:43.516137 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 60/116] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:43.517482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7de260-309f-49fa-91b4-c1c5cc407e7f None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:43.533019 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c1429-17c5-482c-b379-445d7962214e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:43.533724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c1429-17c5-482c-b379-445d7962214e None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.534065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c1429-17c5-482c-b379-445d7962214e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.534352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c1429-17c5-482c-b379-445d7962214e None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.535176 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c1429-17c5-482c-b379-445d7962214e None admin] RBAC: Adding query filter params (name=member) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:43.535534 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c1429-17c5-482c-b379-445d7962214e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:43.537184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c1429-17c5-482c-b379-445d7962214e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:43.539313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:43.551621 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 57/117] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:43.558050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c1429-17c5-482c-b379-445d7962214e None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:43.649193 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7de260-309f-49fa-91b4-c1c5cc407e7f None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:43.677140 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c1429-17c5-482c-b379-445d7962214e None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:43.689626 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa0467-535b-4d7e-9cf0-b9ba2f2cdbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:43.690327 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa0467-535b-4d7e-9cf0-b9ba2f2cdbac None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.690685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa0467-535b-4d7e-9cf0-b9ba2f2cdbac None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.690888 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa0467-535b-4d7e-9cf0-b9ba2f2cdbac None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.691692 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa0467-535b-4d7e-9cf0-b9ba2f2cdbac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:43.692004 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa0467-535b-4d7e-9cf0-b9ba2f2cdbac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:43.693415 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa0467-535b-4d7e-9cf0-b9ba2f2cdbac None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:43.695840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:43.704974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 61/118] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:43.706259 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf14a9f-d044-4011-868b-f53839546766 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.706621 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf14a9f-d044-4011-868b-f53839546766 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.706970 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf14a9f-d044-4011-868b-f53839546766 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.708547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 62/119] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:43.714066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf14a9f-d044-4011-868b-f53839546766 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:43.726542 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fccbba-6078-41e3-8244-d0ceac962a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:43.728077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fccbba-6078-41e3-8244-d0ceac962a45 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.728348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fccbba-6078-41e3-8244-d0ceac962a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.728689 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fccbba-6078-41e3-8244-d0ceac962a45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.729580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fccbba-6078-41e3-8244-d0ceac962a45 None admin] RBAC: Adding query filter params (role.id=91418844a31b44b885804c221d52c38b, scope.project.id=21f896d0c1d8492287fcd5e0801dec94, user.id=1bed0cdc27f24d4c9ad3a8605eb8a1c5) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:43.730031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fccbba-6078-41e3-8244-d0ceac962a45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:43.731584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fccbba-6078-41e3-8244-d0ceac962a45 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:43.738579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 58/120] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:43 2022] GET /identity/v3/role_assignments?user.id=1bed0cdc27f24d4c9ad3a8605eb8a1c5&scope.project.id=21f896d0c1d8492287fcd5e0801dec94&role.id=91418844a31b44b885804c221d52c38b => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:43.739250 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fccbba-6078-41e3-8244-d0ceac962a45 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:43.813779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:43.846029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf14a9f-d044-4011-868b-f53839546766 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:43.891213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fccbba-6078-41e3-8244-d0ceac962a45 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:43.903785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3584a-f829-4767-a206-c148e677a36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:43.904637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3584a-f829-4767-a206-c148e677a36f None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.904932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3584a-f829-4767-a206-c148e677a36f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.905743 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3584a-f829-4767-a206-c148e677a36f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.920216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3584a-f829-4767-a206-c148e677a36f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:43.928532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-a8d3584a-f829-4767-a206-c148e677a36f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:43.928532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:43.928532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:43.928532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:43.928532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:43.928532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:43.928532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:43.928532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:43.928532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:43.928532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:43.928532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:43.928532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:43.928532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:43.928532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:43.928532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:43.928532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:43.929360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:43.929360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:43.929360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:43.929360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:43.929360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:43.929360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:43.929360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:43.929360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:43.929360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:43.929360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:43.929360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:43.929360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:43.929360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:43.929360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:43.929360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:43.929360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:43.930118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:43.930118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:43.930118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:43.930118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:43.930118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:43.930118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:43.930118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:43.930118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:43.930118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:43.930118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:43.930118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:43.930118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:20:43.930118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 63/121] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:20:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:43.931316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3584a-f829-4767-a206-c148e677a36f None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:43.937787 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5a6e8-945d-4b85-a378-48e34c99dfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:43.938694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5a6e8-945d-4b85-a378-48e34c99dfaa None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.938989 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5a6e8-945d-4b85-a378-48e34c99dfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.939270 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5a6e8-945d-4b85-a378-48e34c99dfaa None admin] PATH_INFO: `/v3/users/8c1a31a288804174b0c5662f15125f80` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.940563 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5a6e8-945d-4b85-a378-48e34c99dfaa None admin] RBAC: Authorizing `identity:get_user(user_id=8c1a31a288804174b0c5662f15125f80)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:43.942025 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5a6e8-945d-4b85-a378-48e34c99dfaa None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:43.944003 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 59/122] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:43 2022] GET /identity/v3/users/8c1a31a288804174b0c5662f15125f80 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:43.945209 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bf3fa-5a6f-4a07-a4be-17a260dbf3b1 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:43.945503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bf3fa-5a6f-4a07-a4be-17a260dbf3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:43.945786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bf3fa-5a6f-4a07-a4be-17a260dbf3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:43.964213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-769bf3fa-5a6f-4a07-a4be-17a260dbf3b1 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:43.965418 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-769bf3fa-5a6f-4a07-a4be-17a260dbf3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:44.010998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:44.041948 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 60/123] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:44.047314 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bf3fa-5a6f-4a07-a4be-17a260dbf3b1 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:44.067670 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3584a-f829-4767-a206-c148e677a36f None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:44.116026 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5cc4d-e6b2-428c-a1da-1130b28d3f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:44.117175 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5cc4d-e6b2-428c-a1da-1130b28d3f72 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.117601 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5cc4d-e6b2-428c-a1da-1130b28d3f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.118634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5cc4d-e6b2-428c-a1da-1130b28d3f72 None admin] PATH_INFO: `/v3/users/6f66109ae90a4460b768c8db1b53b02e` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.120323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5cc4d-e6b2-428c-a1da-1130b28d3f72 None admin] RBAC: Authorizing `identity:get_user(user_id=6f66109ae90a4460b768c8db1b53b02e)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:44.121973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5cc4d-e6b2-428c-a1da-1130b28d3f72 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:44.124211 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 64/124] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:43 2022] GET /identity/v3/users/6f66109ae90a4460b768c8db1b53b02e => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:44.125225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5cc4d-e6b2-428c-a1da-1130b28d3f72 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:44.137027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:44.165721 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bf3fa-5a6f-4a07-a4be-17a260dbf3b1 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:44.203740 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17bab3-c47b-414c-9615-510a312ffc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:44.204429 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17bab3-c47b-414c-9615-510a312ffc75 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.204771 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17bab3-c47b-414c-9615-510a312ffc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.205062 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17bab3-c47b-414c-9615-510a312ffc75 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.205836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17bab3-c47b-414c-9615-510a312ffc75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:44.206153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17bab3-c47b-414c-9615-510a312ffc75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:44.207592 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17bab3-c47b-414c-9615-510a312ffc75 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:44.217537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 61/125] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:44.222802 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17bab3-c47b-414c-9615-510a312ffc75 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:44.237124 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5cc4d-e6b2-428c-a1da-1130b28d3f72 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:44.272157 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:44.276186 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38a6ab-b115-41d7-8bc6-c4ca887f7a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:44.277320 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38a6ab-b115-41d7-8bc6-c4ca887f7a32 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.277804 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38a6ab-b115-41d7-8bc6-c4ca887f7a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.278292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38a6ab-b115-41d7-8bc6-c4ca887f7a32 None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.280048 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38a6ab-b115-41d7-8bc6-c4ca887f7a32 None admin] RBAC: Authorizing `identity:get_project(project_id=21f896d0c1d8492287fcd5e0801dec94)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:44.281717 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38a6ab-b115-41d7-8bc6-c4ca887f7a32 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:44.283628 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 65/126] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:44 2022] GET /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:44.284562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38a6ab-b115-41d7-8bc6-c4ca887f7a32 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:44.353761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17bab3-c47b-414c-9615-510a312ffc75 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:44.377890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:44.389232 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e28e44-a332-4f4d-b85b-aa5f91c5e2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:44.390118 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e28e44-a332-4f4d-b85b-aa5f91c5e2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.393707 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e28e44-a332-4f4d-b85b-aa5f91c5e2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.393707 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e28e44-a332-4f4d-b85b-aa5f91c5e2f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.402397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e28e44-a332-4f4d-b85b-aa5f91c5e2f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:44.404245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38a6ab-b115-41d7-8bc6-c4ca887f7a32 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:44.410648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-d9e28e44-a332-4f4d-b85b-aa5f91c5e2f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:44.410648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:44.410648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:44.410648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:44.410648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:44.410648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:44.410648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:44.410648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:44.410648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:44.410648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:44.410648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:44.410648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:44.410648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:44.410648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:44.410648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:44.410648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:44.411538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:44.411538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:44.411538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:44.411538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:44.411538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:44.411538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:44.411538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:44.411538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:44.411538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:44.411538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:44.411538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:44.411538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:44.411538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:44.411538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:44.411538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:44.411538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:44.412295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:44.412295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:44.412295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:44.412295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:44.412295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:44.412295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:44.412295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:44.412295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:44.412295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:44.412295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:44.412295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:44.412295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:20:44.412295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 62/127] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:44.412905 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e28e44-a332-4f4d-b85b-aa5f91c5e2f0 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:44.457375 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3087895-2088-4a1b-a339-439774b7eb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:44.458460 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3087895-2088-4a1b-a339-439774b7eb54 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.458761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3087895-2088-4a1b-a339-439774b7eb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.459046 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3087895-2088-4a1b-a339-439774b7eb54 None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.460984 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3087895-2088-4a1b-a339-439774b7eb54 None admin] RBAC: Authorizing `identity:get_project(project_id=21f896d0c1d8492287fcd5e0801dec94)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:44.462585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3087895-2088-4a1b-a339-439774b7eb54 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:44.465768 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 66/128] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:44 2022] GET /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:44.466561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3087895-2088-4a1b-a339-439774b7eb54 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:44.549015 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:44.558514 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e28e44-a332-4f4d-b85b-aa5f91c5e2f0 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:44.590372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3087895-2088-4a1b-a339-439774b7eb54 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:44.608452 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7e44a-8d2a-4e23-bb7c-f41a8f9cc540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:44.610765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7e44a-8d2a-4e23-bb7c-f41a8f9cc540 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.611255 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7e44a-8d2a-4e23-bb7c-f41a8f9cc540 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.615215 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7e44a-8d2a-4e23-bb7c-f41a8f9cc540 None admin] PATH_INFO: `/v3/users/8c1a31a288804174b0c5662f15125f80` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.615215 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7e44a-8d2a-4e23-bb7c-f41a8f9cc540 None admin] RBAC: Authorizing `identity:get_user(user_id=8c1a31a288804174b0c5662f15125f80)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:44.615215 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7e44a-8d2a-4e23-bb7c-f41a8f9cc540 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:44.617757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 63/129] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:44 2022] GET /identity/v3/users/8c1a31a288804174b0c5662f15125f80 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:44.618761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7e44a-8d2a-4e23-bb7c-f41a8f9cc540 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:44.636323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191f5c8-3c0a-4fc3-96b2-501054288e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:44.637218 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191f5c8-3c0a-4fc3-96b2-501054288e64 None admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.637578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191f5c8-3c0a-4fc3-96b2-501054288e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.638031 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191f5c8-3c0a-4fc3-96b2-501054288e64 None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94/users/8c1a31a288804174b0c5662f15125f80/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.640482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191f5c8-3c0a-4fc3-96b2-501054288e64 None admin] RBAC: Authorizing `identity:create_grant(project_id=21f896d0c1d8492287fcd5e0801dec94, user_id=8c1a31a288804174b0c5662f15125f80, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:44.644780 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191f5c8-3c0a-4fc3-96b2-501054288e64 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:44.721461 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 67/130] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:20:44 2022] PUT /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94/users/8c1a31a288804174b0c5662f15125f80/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:20:44.729066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191f5c8-3c0a-4fc3-96b2-501054288e64 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:44.736312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7e44a-8d2a-4e23-bb7c-f41a8f9cc540 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:44.737722 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:44.777357 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a5f16-a74d-474f-bdbf-9be224293515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:44.778397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a5f16-a74d-474f-bdbf-9be224293515 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.778839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a5f16-a74d-474f-bdbf-9be224293515 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.779320 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a5f16-a74d-474f-bdbf-9be224293515 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.780266 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a5f16-a74d-474f-bdbf-9be224293515 None admin] RBAC: Adding query filter params (name=member) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:44.780940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a5f16-a74d-474f-bdbf-9be224293515 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:44.782730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a5f16-a74d-474f-bdbf-9be224293515 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:44.793444 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 64/131] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:44.794653 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a5f16-a74d-474f-bdbf-9be224293515 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:44.834275 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:44.922056 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a5f16-a74d-474f-bdbf-9be224293515 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:44.945943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191f5c8-3c0a-4fc3-96b2-501054288e64 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:44.963554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c26266-1a94-4a37-833c-8d57869b9290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:44.964904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c26266-1a94-4a37-833c-8d57869b9290 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:44.965403 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c26266-1a94-4a37-833c-8d57869b9290 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:44.965871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c26266-1a94-4a37-833c-8d57869b9290 None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:44.967446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c26266-1a94-4a37-833c-8d57869b9290 None admin] RBAC: Authorizing `identity:get_project(project_id=21f896d0c1d8492287fcd5e0801dec94)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:44.969207 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c26266-1a94-4a37-833c-8d57869b9290 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:44.971249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 65/132] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:44 2022] GET /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:44.972380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c26266-1a94-4a37-833c-8d57869b9290 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:45.019725 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a83a6-ca86-410a-a124-e7332530d499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:45.020856 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a83a6-ca86-410a-a124-e7332530d499 None admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:45.021153 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a83a6-ca86-410a-a124-e7332530d499 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:45.021441 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a83a6-ca86-410a-a124-e7332530d499 None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94/users/6f66109ae90a4460b768c8db1b53b02e/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:45.025546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a83a6-ca86-410a-a124-e7332530d499 None admin] RBAC: Authorizing `identity:create_grant(project_id=21f896d0c1d8492287fcd5e0801dec94, user_id=6f66109ae90a4460b768c8db1b53b02e, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:45.027709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a83a6-ca86-410a-a124-e7332530d499 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:45.085575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:45.096326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c26266-1a94-4a37-833c-8d57869b9290 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:45.136848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d2f69-81e1-4e0d-b6c0-33d2e0833289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:45.137893 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d2f69-81e1-4e0d-b6c0-33d2e0833289 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:45.138191 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d2f69-81e1-4e0d-b6c0-33d2e0833289 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:45.138473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d2f69-81e1-4e0d-b6c0-33d2e0833289 None admin] PATH_INFO: `/v3/users/8c1a31a288804174b0c5662f15125f80` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:45.139863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d2f69-81e1-4e0d-b6c0-33d2e0833289 None admin] RBAC: Authorizing `identity:get_user(user_id=8c1a31a288804174b0c5662f15125f80)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:45.140838 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 68/133] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:20:44 2022] PUT /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94/users/6f66109ae90a4460b768c8db1b53b02e/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:20:45.141421 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d2f69-81e1-4e0d-b6c0-33d2e0833289 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:45.142167 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a83a6-ca86-410a-a124-e7332530d499 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:45.143202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 66/134] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:44 2022] GET /identity/v3/users/8c1a31a288804174b0c5662f15125f80 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:45.144533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605d8dc-af2c-4c86-a631-59c195ce4983 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:45.144958 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605d8dc-af2c-4c86-a631-59c195ce4983 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:45.145155 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605d8dc-af2c-4c86-a631-59c195ce4983 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:45.146725 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 67/135] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:45.152479 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605d8dc-af2c-4c86-a631-59c195ce4983 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:45.244384 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:45.281788 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a83a6-ca86-410a-a124-e7332530d499 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:45.327368 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271383be-1146-409b-a9fa-1adc47534634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:45.328680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271383be-1146-409b-a9fa-1adc47534634 None admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:45.329183 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271383be-1146-409b-a9fa-1adc47534634 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:45.329630 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271383be-1146-409b-a9fa-1adc47534634 None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94/users/8c1a31a288804174b0c5662f15125f80/roles/6184586642114a188e13c695442669f8` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:45.332466 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271383be-1146-409b-a9fa-1adc47534634 None admin] RBAC: Authorizing `identity:create_grant(project_id=21f896d0c1d8492287fcd5e0801dec94, user_id=8c1a31a288804174b0c5662f15125f80, role_id=6184586642114a188e13c695442669f8)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:45.335131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271383be-1146-409b-a9fa-1adc47534634 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:45.353121 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605d8dc-af2c-4c86-a631-59c195ce4983 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:45.396109 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd69285-2cb8-47a3-b42b-04076da3d9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:45.397486 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd69285-2cb8-47a3-b42b-04076da3d9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:45.397976 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd69285-2cb8-47a3-b42b-04076da3d9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:45.398454 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd69285-2cb8-47a3-b42b-04076da3d9d1 None admin] PATH_INFO: `/v3/projects/722e495737b64f63a913e644534fa749` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:45.401341 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd69285-2cb8-47a3-b42b-04076da3d9d1 None admin] RBAC: Authorizing `identity:get_project(project_id=722e495737b64f63a913e644534fa749)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:45.403123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd69285-2cb8-47a3-b42b-04076da3d9d1 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:45.405632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 68/136] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:45 2022] GET /identity/v3/projects/722e495737b64f63a913e644534fa749 => generated 312 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:45.407243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2c40f-8966-41c3-9f5b-50685ed978ad None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:45.407695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2c40f-8966-41c3-9f5b-50685ed978ad None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:45.408120 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2c40f-8966-41c3-9f5b-50685ed978ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:45.429877 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 69/137] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:20:45 2022] PUT /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94/users/8c1a31a288804174b0c5662f15125f80/roles/6184586642114a188e13c695442669f8 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:20:45.431535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271383be-1146-409b-a9fa-1adc47534634 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:45.439514 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-ffb2c40f-8966-41c3-9f5b-50685ed978ad None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:45.445490 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ffb2c40f-8966-41c3-9f5b-50685ed978ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:45.483327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:45.533943 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 69/138] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:45.573031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2c40f-8966-41c3-9f5b-50685ed978ad None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:45.624070 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271383be-1146-409b-a9fa-1adc47534634 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:45.679316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:45.701453 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a95c2-904b-46a9-a2a5-41eb34b91afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:45.702715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a95c2-904b-46a9-a2a5-41eb34b91afa None admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:45.703218 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a95c2-904b-46a9-a2a5-41eb34b91afa None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:45.703735 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a95c2-904b-46a9-a2a5-41eb34b91afa None admin] PATH_INFO: `/v3/projects/722e495737b64f63a913e644534fa749/users/8c1a31a288804174b0c5662f15125f80/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:45.706733 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a95c2-904b-46a9-a2a5-41eb34b91afa None admin] RBAC: Authorizing `identity:create_grant(project_id=722e495737b64f63a913e644534fa749, user_id=8c1a31a288804174b0c5662f15125f80, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:45.708477 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a95c2-904b-46a9-a2a5-41eb34b91afa None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:45.745824 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2c40f-8966-41c3-9f5b-50685ed978ad None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:45.784499 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 70/139] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:20:45 2022] PUT /identity/v3/projects/722e495737b64f63a913e644534fa749/users/8c1a31a288804174b0c5662f15125f80/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:20:45.793458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fe8b4-e4de-431a-b142-aad8cbafd78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:45.794682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fe8b4-e4de-431a-b142-aad8cbafd78b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:45.795252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fe8b4-e4de-431a-b142-aad8cbafd78b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:45.795829 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fe8b4-e4de-431a-b142-aad8cbafd78b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:45.797502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fe8b4-e4de-431a-b142-aad8cbafd78b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:45.799658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fe8b4-e4de-431a-b142-aad8cbafd78b None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:45.802392 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 70/140] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:45.809582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a95c2-904b-46a9-a2a5-41eb34b91afa None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:45.954524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a95c2-904b-46a9-a2a5-41eb34b91afa None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:46.004417 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ae0ad-087a-4bc0-8fa1-9aeef725cc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:46.005130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ae0ad-087a-4bc0-8fa1-9aeef725cc0a None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:46.005422 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ae0ad-087a-4bc0-8fa1-9aeef725cc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:46.005710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ae0ad-087a-4bc0-8fa1-9aeef725cc0a None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:46.006458 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ae0ad-087a-4bc0-8fa1-9aeef725cc0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:46.007996 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ae0ad-087a-4bc0-8fa1-9aeef725cc0a None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:46.054973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283f165-4f01-414a-ae5a-5537a14fd2a3 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:46.056191 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283f165-4f01-414a-ae5a-5537a14fd2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:46.058120 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283f165-4f01-414a-ae5a-5537a14fd2a3 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:46.061459 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 71/141] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:46.070393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda39e68-4483-46ad-8149-4c4e116ae58f None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:46.072489 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda39e68-4483-46ad-8149-4c4e116ae58f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:46.072489 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda39e68-4483-46ad-8149-4c4e116ae58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:46.095169 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-cda39e68-4483-46ad-8149-4c4e116ae58f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:46.096575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-cda39e68-4483-46ad-8149-4c4e116ae58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:46.123843 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:46.139150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 71/142] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Jul 12 14:20:45 2022] POST /identity/v3/users => generated 283 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:46.189062 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 72/143] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:46.230273 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ae0ad-087a-4bc0-8fa1-9aeef725cc0a None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:46.302835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:46.381733 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ae0ad-087a-4bc0-8fa1-9aeef725cc0a None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:46.436888 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cca21-4441-4bd4-9353-88b8939318eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:46.437743 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cca21-4441-4bd4-9353-88b8939318eb None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:46.438034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cca21-4441-4bd4-9353-88b8939318eb None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:46.438316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cca21-4441-4bd4-9353-88b8939318eb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:46.454685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cca21-4441-4bd4-9353-88b8939318eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:46.463803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-3f7cca21-4441-4bd4-9353-88b8939318eb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:20:46.463803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:46.463803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:46.463803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:46.463803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:46.463803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:46.463803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:46.463803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:46.463803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:46.463803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:46.463803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:46.463803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:46.463803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:46.463803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:46.463803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:46.463803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:46.464713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:46.464713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:46.464713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:46.464713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:46.464713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:46.464713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:46.464713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:46.464713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:46.464713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:46.464713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:46.464713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:46.464713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:46.464713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:46.464713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:46.464713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:46.464713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:46.465449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:46.465449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:46.465449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:46.465449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:46.465449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:46.465449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:46.465449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:46.465449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:46.465449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:46.465449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:46.465449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:20:46.465449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:20:46.465449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 72/144] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:46.471174 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda39e68-4483-46ad-8149-4c4e116ae58f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:46.627171 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda39e68-4483-46ad-8149-4c4e116ae58f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:46.673095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fd399-0ec3-4b60-bd5a-9d5fd939078f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:46.674138 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fd399-0ec3-4b60-bd5a-9d5fd939078f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:46.674623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fd399-0ec3-4b60-bd5a-9d5fd939078f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:46.675137 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fd399-0ec3-4b60-bd5a-9d5fd939078f None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:46.676121 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fd399-0ec3-4b60-bd5a-9d5fd939078f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:46.676630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fd399-0ec3-4b60-bd5a-9d5fd939078f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:46.678225 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fd399-0ec3-4b60-bd5a-9d5fd939078f None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:46.692358 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 73/145] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:46.698738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cca21-4441-4bd4-9353-88b8939318eb None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:46.858491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:46.862577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cca21-4441-4bd4-9353-88b8939318eb None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:46.909440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb54f31-9253-42cb-8a87-0b401e40260f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:46.910253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb54f31-9253-42cb-8a87-0b401e40260f None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:46.910537 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb54f31-9253-42cb-8a87-0b401e40260f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:46.910819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb54f31-9253-42cb-8a87-0b401e40260f None admin] PATH_INFO: `/v3/users/1bed0cdc27f24d4c9ad3a8605eb8a1c5` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:46.912073 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb54f31-9253-42cb-8a87-0b401e40260f None admin] RBAC: Authorizing `identity:get_user(user_id=1bed0cdc27f24d4c9ad3a8605eb8a1c5)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:46.913552 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb54f31-9253-42cb-8a87-0b401e40260f None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:46.915221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 73/146] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:46 2022] GET /identity/v3/users/1bed0cdc27f24d4c9ad3a8605eb8a1c5 => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:46.921287 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fd399-0ec3-4b60-bd5a-9d5fd939078f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:46.955171 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:47.060772 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fd399-0ec3-4b60-bd5a-9d5fd939078f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:47.103058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca72064-b56d-4576-a8b4-5aa8d60cef7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:47.103973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca72064-b56d-4576-a8b4-5aa8d60cef7d None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:47.104265 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca72064-b56d-4576-a8b4-5aa8d60cef7d None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:47.104547 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca72064-b56d-4576-a8b4-5aa8d60cef7d None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:47.107482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca72064-b56d-4576-a8b4-5aa8d60cef7d None admin] RBAC: Authorizing `identity:get_project(project_id=21f896d0c1d8492287fcd5e0801dec94)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:47.108973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca72064-b56d-4576-a8b4-5aa8d60cef7d None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:47.110718 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 74/147] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:46 2022] GET /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:47.116729 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb54f31-9253-42cb-8a87-0b401e40260f None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:47.253531 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb54f31-9253-42cb-8a87-0b401e40260f None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:47.293279 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc7694-a777-4df5-bb57-10c63e129182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:47.294566 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc7694-a777-4df5-bb57-10c63e129182 None admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:47.295044 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc7694-a777-4df5-bb57-10c63e129182 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:47.295565 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc7694-a777-4df5-bb57-10c63e129182 None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94/users/1bed0cdc27f24d4c9ad3a8605eb8a1c5/roles/91418844a31b44b885804c221d52c38b` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:47.297961 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc7694-a777-4df5-bb57-10c63e129182 None admin] RBAC: Authorizing `identity:create_grant(project_id=21f896d0c1d8492287fcd5e0801dec94, user_id=1bed0cdc27f24d4c9ad3a8605eb8a1c5, role_id=91418844a31b44b885804c221d52c38b)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:47.299720 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc7694-a777-4df5-bb57-10c63e129182 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:47.396070 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 74/148] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:20:47 2022] PUT /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94/users/1bed0cdc27f24d4c9ad3a8605eb8a1c5/roles/91418844a31b44b885804c221d52c38b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:20:47.603028 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16eed-6da2-44fe-b94c-c936d42046d3 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:47.603466 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16eed-6da2-44fe-b94c-c936d42046d3 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:47.603640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16eed-6da2-44fe-b94c-c936d42046d3 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:47.605178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 75/149] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:47.610993 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d1ea9-186b-4f7a-b6f9-cf9fc69fea1e None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:47.611615 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d1ea9-186b-4f7a-b6f9-cf9fc69fea1e None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:47.618424 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d1ea9-186b-4f7a-b6f9-cf9fc69fea1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:47.632581 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-3b3d1ea9-186b-4f7a-b6f9-cf9fc69fea1e None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:47.635140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-3b3d1ea9-186b-4f7a-b6f9-cf9fc69fea1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:47.663025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:47.716145 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 75/150] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:47.741253 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16eed-6da2-44fe-b94c-c936d42046d3 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:47.844219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:47.858622 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16eed-6da2-44fe-b94c-c936d42046d3 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:47.896003 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3058499-64eb-4e7e-84c9-c18b93f92985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:47.897253 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3058499-64eb-4e7e-84c9-c18b93f92985 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:47.897944 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3058499-64eb-4e7e-84c9-c18b93f92985 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:47.898438 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3058499-64eb-4e7e-84c9-c18b93f92985 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:47.911948 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3058499-64eb-4e7e-84c9-c18b93f92985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:47.920757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-f3058499-64eb-4e7e-84c9-c18b93f92985 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:47.920757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:47.920757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:47.920757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:47.920757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:47.920757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:47.920757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:47.920757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:47.920757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:47.920757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:47.920757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:47.920757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:47.920757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:47.920757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:47.920757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:47.920757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:47.922091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:47.922091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:47.922091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:47.922091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:47.922091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:47.922091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:47.922091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:47.922091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:47.922091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:47.922091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:47.922091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:47.922091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:47.922091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:47.922091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:47.922091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:47.922091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:47.922859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:47.922859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:47.922859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:47.922859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:47.922859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:47.922859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:47.922859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:47.922859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:47.922859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:47.922859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:47.922859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:47.922859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:20:47.925339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 76/151] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:47.931550 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d1ea9-186b-4f7a-b6f9-cf9fc69fea1e None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:48.047596 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d1ea9-186b-4f7a-b6f9-cf9fc69fea1e None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:48.087763 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e490b2-812e-496b-a738-bfe90c1f4a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:48.088869 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e490b2-812e-496b-a738-bfe90c1f4a84 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:48.089352 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e490b2-812e-496b-a738-bfe90c1f4a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:48.089912 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e490b2-812e-496b-a738-bfe90c1f4a84 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:48.090950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e490b2-812e-496b-a738-bfe90c1f4a84 None admin] RBAC: Adding query filter params (name=member) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:48.091476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e490b2-812e-496b-a738-bfe90c1f4a84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:48.093133 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e490b2-812e-496b-a738-bfe90c1f4a84 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:48.102952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 76/152] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:48.109000 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3058499-64eb-4e7e-84c9-c18b93f92985 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:48.219179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3058499-64eb-4e7e-84c9-c18b93f92985 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:48.256939 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bcada-ede4-4203-ab7b-4b2ed0276fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:48.257834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bcada-ede4-4203-ab7b-4b2ed0276fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:48.258122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bcada-ede4-4203-ab7b-4b2ed0276fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:48.258435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bcada-ede4-4203-ab7b-4b2ed0276fa5 None admin] PATH_INFO: `/v3/users/8c1a31a288804174b0c5662f15125f80` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:48.260404 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665bcada-ede4-4203-ab7b-4b2ed0276fa5 None admin] RBAC: Authorizing `identity:get_user(user_id=8c1a31a288804174b0c5662f15125f80)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:48.261867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665bcada-ede4-4203-ab7b-4b2ed0276fa5 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:48.263749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 77/153] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:48 2022] GET /identity/v3/users/8c1a31a288804174b0c5662f15125f80 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:48.269078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e490b2-812e-496b-a738-bfe90c1f4a84 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:48.293382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:48.378602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e490b2-812e-496b-a738-bfe90c1f4a84 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:48.415866 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039d29c-a6f8-4a3a-a5d4-ed1a4cba716a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:48.416542 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039d29c-a6f8-4a3a-a5d4-ed1a4cba716a None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:48.416825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039d29c-a6f8-4a3a-a5d4-ed1a4cba716a None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:48.417098 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039d29c-a6f8-4a3a-a5d4-ed1a4cba716a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:48.490145 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039d29c-a6f8-4a3a-a5d4-ed1a4cba716a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:48.491744 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039d29c-a6f8-4a3a-a5d4-ed1a4cba716a None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:48.519675 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:48.600713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 77/154] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:48.606836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bcada-ede4-4203-ab7b-4b2ed0276fa5 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:48.627116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:48.723379 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bcada-ede4-4203-ab7b-4b2ed0276fa5 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:48.766560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbe15a-37c7-407a-9f77-3464e2b1fe13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:48.767475 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbe15a-37c7-407a-9f77-3464e2b1fe13 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:48.768030 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbe15a-37c7-407a-9f77-3464e2b1fe13 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:48.768311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbe15a-37c7-407a-9f77-3464e2b1fe13 None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:48.769547 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbe15a-37c7-407a-9f77-3464e2b1fe13 None admin] RBAC: Authorizing `identity:get_project(project_id=21f896d0c1d8492287fcd5e0801dec94)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:48.771008 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbe15a-37c7-407a-9f77-3464e2b1fe13 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:48.772776 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 78/155] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:48 2022] GET /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:48.779194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039d29c-a6f8-4a3a-a5d4-ed1a4cba716a None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:48.885696 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039d29c-a6f8-4a3a-a5d4-ed1a4cba716a None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:48.908062 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:48.922771 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7d74a-c4ed-4e4c-8bc4-1d7412813f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:48.929651 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7d74a-c4ed-4e4c-8bc4-1d7412813f54 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:48.929651 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7d74a-c4ed-4e4c-8bc4-1d7412813f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:48.929651 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7d74a-c4ed-4e4c-8bc4-1d7412813f54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:48.929651 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7d74a-c4ed-4e4c-8bc4-1d7412813f54 None admin] RBAC: Adding query filter params (role.id=5444412a1f604ebaa9282a244859c051, scope.project.id=21f896d0c1d8492287fcd5e0801dec94, user.id=8c1a31a288804174b0c5662f15125f80) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:48.929651 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7d74a-c4ed-4e4c-8bc4-1d7412813f54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:48.929651 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7d74a-c4ed-4e4c-8bc4-1d7412813f54 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:48.933264 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 78/156] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:48 2022] GET /identity/v3/role_assignments?user.id=8c1a31a288804174b0c5662f15125f80&scope.project.id=21f896d0c1d8492287fcd5e0801dec94&role.id=5444412a1f604ebaa9282a244859c051 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:49.045363 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5b5ba-14a7-4ef0-ada3-de6ce42bdd5a None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:49.045858 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5b5ba-14a7-4ef0-ada3-de6ce42bdd5a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:49.045858 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5b5ba-14a7-4ef0-ada3-de6ce42bdd5a None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:49.047226 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 79/157] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:49.070737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c5103-32a0-4c4a-bdb9-d157d7b41e21 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:49.071071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c5103-32a0-4c4a-bdb9-d157d7b41e21 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:49.071371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c5103-32a0-4c4a-bdb9-d157d7b41e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:49.092998 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-f03c5103-32a0-4c4a-bdb9-d157d7b41e21 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:49.094225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-f03c5103-32a0-4c4a-bdb9-d157d7b41e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:49.177922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 79/158] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:49.201468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5b5ba-14a7-4ef0-ada3-de6ce42bdd5a None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:49.234649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cae6d-f022-4fea-aa4a-e90ca30b1df0 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:49.234979 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cae6d-f022-4fea-aa4a-e90ca30b1df0 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:49.235206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cae6d-f022-4fea-aa4a-e90ca30b1df0 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:49.238637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 80/159] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:49.256952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08e631-d411-4df5-90cd-4cc6177f0ec8 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:49.257245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08e631-d411-4df5-90cd-4cc6177f0ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:49.257514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08e631-d411-4df5-90cd-4cc6177f0ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:49.290533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-4e08e631-d411-4df5-90cd-4cc6177f0ec8 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:49.291775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-4e08e631-d411-4df5-90cd-4cc6177f0ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:49.322232 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:49.335953 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5b5ba-14a7-4ef0-ada3-de6ce42bdd5a None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:49.372674 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787ac49-9e65-4561-92d1-eca917913d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:49.373501 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787ac49-9e65-4561-92d1-eca917913d30 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:49.373796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787ac49-9e65-4561-92d1-eca917913d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:49.374078 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787ac49-9e65-4561-92d1-eca917913d30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:49.386284 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787ac49-9e65-4561-92d1-eca917913d30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:49.394332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-6787ac49-9e65-4561-92d1-eca917913d30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:49.394332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:49.394332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:49.394332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:49.394332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:49.394332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:49.394332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:49.394332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:49.394332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:49.394332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:49.394332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:49.394332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:49.394332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:49.394332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:49.394332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:49.394332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:49.395240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:49.395240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:49.395240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:49.395240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:49.395240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:49.395240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:49.395240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:49.395240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:49.395240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:49.395240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:49.395240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:49.395240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:49.395240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:49.395240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:49.395240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:49.395240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:49.396114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:49.396114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:49.396114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:49.396114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:49.396114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:49.396114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:49.396114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:49.396114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:49.396114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:49.396114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:49.396114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:49.396114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:20:49.396114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 80/160] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:20:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:49.404173 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787ac49-9e65-4561-92d1-eca917913d30 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:49.476570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 81/161] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:20:49.518903 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787ac49-9e65-4561-92d1-eca917913d30 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:49.523107 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08e631-d411-4df5-90cd-4cc6177f0ec8 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:49.579762 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:49.608323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14dbbad-432e-4923-9fc4-2ee32c5a17ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:49.609020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14dbbad-432e-4923-9fc4-2ee32c5a17ee None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:49.609306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14dbbad-432e-4923-9fc4-2ee32c5a17ee None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:49.609586 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14dbbad-432e-4923-9fc4-2ee32c5a17ee None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:49.610354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14dbbad-432e-4923-9fc4-2ee32c5a17ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:49.610666 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14dbbad-432e-4923-9fc4-2ee32c5a17ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:49.612087 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14dbbad-432e-4923-9fc4-2ee32c5a17ee None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:49.638786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 81/162] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:49.641616 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08e631-d411-4df5-90cd-4cc6177f0ec8 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:49.644130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14dbbad-432e-4923-9fc4-2ee32c5a17ee None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:49.658062 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:49.685785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8a9ce-8242-4132-adf2-0af654d32d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:49.686828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8a9ce-8242-4132-adf2-0af654d32d3c None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:49.687213 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8a9ce-8242-4132-adf2-0af654d32d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:49.687541 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8a9ce-8242-4132-adf2-0af654d32d3c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:49.701578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8a9ce-8242-4132-adf2-0af654d32d3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:49.711043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-6fc8a9ce-8242-4132-adf2-0af654d32d3c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:49.711043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:49.711043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:49.711043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:49.711043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:49.711043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:49.711043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:49.711043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:49.711043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:49.711043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:49.711043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:49.711043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:49.711043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:49.711043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:49.711043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:49.711043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:49.712042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:49.712042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:49.712042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:49.712042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:49.712042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:49.712042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:49.712042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:49.712042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:49.712042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:49.712042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:49.712042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:49.712042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:49.712042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:49.712042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:49.712042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:49.712042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:49.712955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:49.712955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:49.712955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:49.712955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:49.712955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:49.712955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:49.712955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:49.712955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:49.712955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:49.712955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:49.712955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:49.712955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:20:49.712955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 82/163] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:20:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:49.721513 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8a9ce-8242-4132-adf2-0af654d32d3c None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:49.871919 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8a9ce-8242-4132-adf2-0af654d32d3c None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:49.885104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:49.924554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd03595-c601-4589-9f47-442746522d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:49.925245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd03595-c601-4589-9f47-442746522d8d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:49.925534 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd03595-c601-4589-9f47-442746522d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:49.925880 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd03595-c601-4589-9f47-442746522d8d None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:49.926659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd03595-c601-4589-9f47-442746522d8d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:49.927021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd03595-c601-4589-9f47-442746522d8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:49.928473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd03595-c601-4589-9f47-442746522d8d None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:49.943154 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 83/164] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:49.950833 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd03595-c601-4589-9f47-442746522d8d None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:49.966767 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14dbbad-432e-4923-9fc4-2ee32c5a17ee None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:50.021567 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42ad52-3598-4dc9-aad4-b004c28d0702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:50.022480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42ad52-3598-4dc9-aad4-b004c28d0702 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:50.022873 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42ad52-3598-4dc9-aad4-b004c28d0702 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:50.023164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42ad52-3598-4dc9-aad4-b004c28d0702 None admin] PATH_INFO: `/v3/users/6f66109ae90a4460b768c8db1b53b02e` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:50.028315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42ad52-3598-4dc9-aad4-b004c28d0702 None admin] RBAC: Authorizing `identity:get_user(user_id=6f66109ae90a4460b768c8db1b53b02e)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:50.029868 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42ad52-3598-4dc9-aad4-b004c28d0702 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:50.032091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 82/165] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:49 2022] GET /identity/v3/users/6f66109ae90a4460b768c8db1b53b02e => generated 247 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:50.041153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42ad52-3598-4dc9-aad4-b004c28d0702 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:50.146569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd03595-c601-4589-9f47-442746522d8d None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:50.222978 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b369761-fe67-47dd-9f18-95b402126a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:50.223908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b369761-fe67-47dd-9f18-95b402126a0d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:50.224194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b369761-fe67-47dd-9f18-95b402126a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:50.224471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b369761-fe67-47dd-9f18-95b402126a0d None admin] PATH_INFO: `/v3/users/8c1a31a288804174b0c5662f15125f80` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:50.225777 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b369761-fe67-47dd-9f18-95b402126a0d None admin] RBAC: Authorizing `identity:get_user(user_id=8c1a31a288804174b0c5662f15125f80)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:50.236853 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b369761-fe67-47dd-9f18-95b402126a0d None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:50.240403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 84/166] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:49 2022] GET /identity/v3/users/8c1a31a288804174b0c5662f15125f80 => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:50.241229 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6b9f3-dae2-48b7-8776-82d4cbe9a845 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:50.241517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6b9f3-dae2-48b7-8776-82d4cbe9a845 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:50.241797 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6b9f3-dae2-48b7-8776-82d4cbe9a845 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:50.247179 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 85/167] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:50.258223 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f149e-66fd-4fcb-a2f8-c2f4a6391918 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:50.259212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:50.260226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f149e-66fd-4fcb-a2f8-c2f4a6391918 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:50.260226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f149e-66fd-4fcb-a2f8-c2f4a6391918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:50.295696 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-762f149e-66fd-4fcb-a2f8-c2f4a6391918 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:50.298267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-762f149e-66fd-4fcb-a2f8-c2f4a6391918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:50.313457 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42ad52-3598-4dc9-aad4-b004c28d0702 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:50.354433 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:50.380581 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a4482-01f3-49e4-b52b-8bbce4169366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:50.381294 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a4482-01f3-49e4-b52b-8bbce4169366 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:50.381581 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a4482-01f3-49e4-b52b-8bbce4169366 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:50.381911 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a4482-01f3-49e4-b52b-8bbce4169366 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:50.434071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 86/168] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:50.434675 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f149e-66fd-4fcb-a2f8-c2f4a6391918 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:50.539613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a4482-01f3-49e4-b52b-8bbce4169366 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:50.541811 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a4482-01f3-49e4-b52b-8bbce4169366 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:50.643897 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f149e-66fd-4fcb-a2f8-c2f4a6391918 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:50.688659 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:50.727960 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b7137-6d0e-4f3e-80b0-d2275a2b3ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:50.729224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b7137-6d0e-4f3e-80b0-d2275a2b3ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:50.729705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b7137-6d0e-4f3e-80b0-d2275a2b3ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:50.730173 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b7137-6d0e-4f3e-80b0-d2275a2b3ee3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:50.742414 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 83/169] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 14:20:50.743871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a4482-01f3-49e4-b52b-8bbce4169366 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:50.808740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:50.904464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b7137-6d0e-4f3e-80b0-d2275a2b3ee3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:50.905969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b7137-6d0e-4f3e-80b0-d2275a2b3ee3 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:50.961758 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a4482-01f3-49e4-b52b-8bbce4169366 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:51.028292 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916b016-ec9c-4657-87f4-9c961ee9ead4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:51.029123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916b016-ec9c-4657-87f4-9c961ee9ead4 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.029408 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916b016-ec9c-4657-87f4-9c961ee9ead4 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.029688 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916b016-ec9c-4657-87f4-9c961ee9ead4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.056861 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916b016-ec9c-4657-87f4-9c961ee9ead4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:51.065326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-e916b016-ec9c-4657-87f4-9c961ee9ead4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:51.065326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:51.065326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:51.065326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:51.065326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:51.065326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:51.065326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:51.065326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:51.065326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:51.065326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:51.065326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:51.065326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:51.065326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:51.065326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:51.065326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:51.065326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:51.066168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:51.066168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:51.066168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:51.066168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:51.066168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:51.066168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:51.066168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:51.066168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:51.066168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:51.066168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:51.066168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:51.066168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:51.066168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:51.066168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:51.066168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:51.066168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:51.066937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:51.066937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:51.066937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:51.066937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:51.066937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:51.066937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:51.066937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:51.066937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:51.066937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:51.066937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:51.066937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:51.066937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:20:51.066937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 84/170] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:51.076152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916b016-ec9c-4657-87f4-9c961ee9ead4 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:51.144712 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:51.216954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 87/171] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 782 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:51.218352 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b7137-6d0e-4f3e-80b0-d2275a2b3ee3 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:51.256637 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916b016-ec9c-4657-87f4-9c961ee9ead4 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:51.294498 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954de5c-5a8a-4fce-b137-8484d7e678ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:51.295633 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954de5c-5a8a-4fce-b137-8484d7e678ab None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.295919 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954de5c-5a8a-4fce-b137-8484d7e678ab None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.296194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954de5c-5a8a-4fce-b137-8484d7e678ab None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.297562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954de5c-5a8a-4fce-b137-8484d7e678ab None admin] RBAC: Authorizing `identity:get_project(project_id=21f896d0c1d8492287fcd5e0801dec94)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:51.299038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954de5c-5a8a-4fce-b137-8484d7e678ab None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:51.300949 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 85/172] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:51 2022] GET /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:51.302544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ce607-bd9f-4ad4-a5ff-81e0deaefb84 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.302833 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ce607-bd9f-4ad4-a5ff-81e0deaefb84 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.303109 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ce607-bd9f-4ad4-a5ff-81e0deaefb84 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.304564 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 86/173] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:51.305447 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ce607-bd9f-4ad4-a5ff-81e0deaefb84 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:51.371881 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:51.424444 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b7137-6d0e-4f3e-80b0-d2275a2b3ee3 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:51.437208 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ce607-bd9f-4ad4-a5ff-81e0deaefb84 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:51.439525 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:51.468178 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0592d-1db6-48c4-88b6-0d0f870911a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:51.469109 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0592d-1db6-48c4-88b6-0d0f870911a5 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.469552 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0592d-1db6-48c4-88b6-0d0f870911a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.469987 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0592d-1db6-48c4-88b6-0d0f870911a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.470898 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0592d-1db6-48c4-88b6-0d0f870911a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:51.471378 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0592d-1db6-48c4-88b6-0d0f870911a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:51.472917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0592d-1db6-48c4-88b6-0d0f870911a5 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:51.473641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfdba9-1529-420e-987d-0cd805a320a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:51.474550 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfdba9-1529-420e-987d-0cd805a320a4 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.474834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfdba9-1529-420e-987d-0cd805a320a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.475405 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfdba9-1529-420e-987d-0cd805a320a4 None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.477691 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfdba9-1529-420e-987d-0cd805a320a4 None admin] RBAC: Authorizing `identity:get_project(project_id=21f896d0c1d8492287fcd5e0801dec94)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:51.479147 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfdba9-1529-420e-987d-0cd805a320a4 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:51.486047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 87/174] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:51 2022] GET /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:51.486047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b931c-bcf6-49b6-a1e4-4db12f4416e8 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.486047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b931c-bcf6-49b6-a1e4-4db12f4416e8 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.486047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b931c-bcf6-49b6-a1e4-4db12f4416e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.488881 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 88/175] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:51.492264 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0592d-1db6-48c4-88b6-0d0f870911a5 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:51.500779 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-831b931c-bcf6-49b6-a1e4-4db12f4416e8 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:51.501994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-831b931c-bcf6-49b6-a1e4-4db12f4416e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:51.574822 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 88/176] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:51.576279 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734020c0-b8ee-46aa-a5f9-4d761884578c None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.576571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734020c0-b8ee-46aa-a5f9-4d761884578c None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.576854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734020c0-b8ee-46aa-a5f9-4d761884578c None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.578150 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 89/177] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:51.579222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17b847-4341-4bb8-a9d6-e5f90654f673 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.579531 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17b847-4341-4bb8-a9d6-e5f90654f673 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.579815 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17b847-4341-4bb8-a9d6-e5f90654f673 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.581189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 90/178] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:51.584112 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17b847-4341-4bb8-a9d6-e5f90654f673 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:51.626384 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0592d-1db6-48c4-88b6-0d0f870911a5 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:51.652685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:51.661229 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e5d5d-dcca-4ad3-9f9b-82840d9264f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:51.661906 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e5d5d-dcca-4ad3-9f9b-82840d9264f1 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.662192 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e5d5d-dcca-4ad3-9f9b-82840d9264f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.662517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e5d5d-dcca-4ad3-9f9b-82840d9264f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.663358 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e5d5d-dcca-4ad3-9f9b-82840d9264f1 None admin] RBAC: Adding query filter params (role.id=ae530119fc5c42358179521ce865b5d7, scope.project.id=21f896d0c1d8492287fcd5e0801dec94, user.id=6f66109ae90a4460b768c8db1b53b02e) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:51.663689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e5d5d-dcca-4ad3-9f9b-82840d9264f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:51.666571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e5d5d-dcca-4ad3-9f9b-82840d9264f1 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:51.672649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 89/179] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:51 2022] GET /identity/v3/role_assignments?user.id=6f66109ae90a4460b768c8db1b53b02e&scope.project.id=21f896d0c1d8492287fcd5e0801dec94&role.id=ae530119fc5c42358179521ce865b5d7 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:51.673625 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e5d5d-dcca-4ad3-9f9b-82840d9264f1 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:51.689234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:51.693516 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17b847-4341-4bb8-a9d6-e5f90654f673 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:51.735399 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7b4b2-d0ae-4ed9-863d-bba42a4899f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:51.735399 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7b4b2-d0ae-4ed9-863d-bba42a4899f7 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.735399 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7b4b2-d0ae-4ed9-863d-bba42a4899f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.735399 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7b4b2-d0ae-4ed9-863d-bba42a4899f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.735839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7b4b2-d0ae-4ed9-863d-bba42a4899f7 None admin] RBAC: Adding query filter params (role.id=6184586642114a188e13c695442669f8, scope.project.id=21f896d0c1d8492287fcd5e0801dec94, user.id=8c1a31a288804174b0c5662f15125f80) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:51.735839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7b4b2-d0ae-4ed9-863d-bba42a4899f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:51.737217 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7b4b2-d0ae-4ed9-863d-bba42a4899f7 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:51.745725 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 91/180] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:51 2022] GET /identity/v3/role_assignments?user.id=8c1a31a288804174b0c5662f15125f80&scope.project.id=21f896d0c1d8492287fcd5e0801dec94&role.id=6184586642114a188e13c695442669f8 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:51.747240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba07c82-38c2-4b4c-b3f5-31eda205f90d None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.747580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba07c82-38c2-4b4c-b3f5-31eda205f90d None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.747862 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba07c82-38c2-4b4c-b3f5-31eda205f90d None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.753909 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 92/181] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:51.753909 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18ae42-2561-4f31-93f9-aaef20628e4b None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.753909 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18ae42-2561-4f31-93f9-aaef20628e4b None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.753909 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18ae42-2561-4f31-93f9-aaef20628e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.776128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-df18ae42-2561-4f31-93f9-aaef20628e4b None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:51.777673 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-df18ae42-2561-4f31-93f9-aaef20628e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:51.831438 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e5d5d-dcca-4ad3-9f9b-82840d9264f1 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:51.881209 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 93/182] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:51.885020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef340513-f3d8-4207-b77c-aac7aa243f9a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.885349 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef340513-f3d8-4207-b77c-aac7aa243f9a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.885597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef340513-f3d8-4207-b77c-aac7aa243f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.887531 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a84dc-c08b-4275-a8ae-742887d6abcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:51.888815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a84dc-c08b-4275-a8ae-742887d6abcc None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:51.889373 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a84dc-c08b-4275-a8ae-742887d6abcc None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:51.889844 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a84dc-c08b-4275-a8ae-742887d6abcc None admin] PATH_INFO: `/v3/users/8c1a31a288804174b0c5662f15125f80` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:51.891545 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a84dc-c08b-4275-a8ae-742887d6abcc None admin] RBAC: Authorizing `identity:get_user(user_id=8c1a31a288804174b0c5662f15125f80)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:51.894944 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a84dc-c08b-4275-a8ae-742887d6abcc None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:51.898722 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 90/183] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:51 2022] GET /identity/v3/users/8c1a31a288804174b0c5662f15125f80 => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:51.900742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a84dc-c08b-4275-a8ae-742887d6abcc None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:51.906894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-ef340513-f3d8-4207-b77c-aac7aa243f9a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:51.908172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ef340513-f3d8-4207-b77c-aac7aa243f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:51.987613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:52.001289 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 94/184] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:52.008251 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034a27a-a24a-41e6-a919-923ce7fce83b None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:52.008251 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034a27a-a24a-41e6-a919-923ce7fce83b None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:52.008251 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034a27a-a24a-41e6-a919-923ce7fce83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:52.020850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-8034a27a-a24a-41e6-a919-923ce7fce83b None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:52.022206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-8034a27a-a24a-41e6-a919-923ce7fce83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:52.043354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:52.043691 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a84dc-c08b-4275-a8ae-742887d6abcc None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:52.080066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df48f2c-2e9c-4591-bcd7-f1d380ac7424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:52.080881 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df48f2c-2e9c-4591-bcd7-f1d380ac7424 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:52.081165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df48f2c-2e9c-4591-bcd7-f1d380ac7424 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:52.081442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df48f2c-2e9c-4591-bcd7-f1d380ac7424 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:52.092129 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df48f2c-2e9c-4591-bcd7-f1d380ac7424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:52.093532 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 95/185] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:52.094277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034a27a-a24a-41e6-a919-923ce7fce83b None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:52.100383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-8df48f2c-2e9c-4591-bcd7-f1d380ac7424 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:52.100383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:52.100383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:52.100383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:52.100383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:52.100383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:52.100383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:52.100383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:52.100383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:52.100383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:52.100383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:52.100383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:52.100383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:52.100383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:52.100383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:52.100383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:52.101263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:52.101263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:52.101263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:52.101263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:52.101263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:52.101263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:52.101263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:52.101263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:52.101263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:52.101263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:52.101263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:52.101263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:52.101263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:52.101263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:52.101263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:52.101263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:52.102078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:52.102078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:52.102078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:52.102078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:52.102078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:52.102078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:52.102078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:52.102078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:52.102078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:52.102078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:52.102078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:52.102078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:20:52.107211 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 91/186] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:20:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:52.108146 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df48f2c-2e9c-4591-bcd7-f1d380ac7424 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:52.196879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034a27a-a24a-41e6-a919-923ce7fce83b None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:52.218045 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df48f2c-2e9c-4591-bcd7-f1d380ac7424 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:52.235444 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee46006-cc13-483d-a234-20e13336acca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:52.236388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee46006-cc13-483d-a234-20e13336acca None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:52.236568 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:52.236665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee46006-cc13-483d-a234-20e13336acca None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:52.236932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee46006-cc13-483d-a234-20e13336acca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:52.256383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467a4c5-52c6-4d72-be4a-291879ba1aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:52.257207 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467a4c5-52c6-4d72-be4a-291879ba1aec None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:52.257493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467a4c5-52c6-4d72-be4a-291879ba1aec None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:52.257785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467a4c5-52c6-4d72-be4a-291879ba1aec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:52.265068 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:52.270744 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467a4c5-52c6-4d72-be4a-291879ba1aec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:52.279241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-c467a4c5-52c6-4d72-be4a-291879ba1aec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:20:52.279241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:52.279241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:52.279241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:52.279241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:52.279241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:52.279241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:52.279241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:52.279241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:52.279241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:52.279241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:52.279241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:52.279241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:52.279241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:52.279241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:52.279241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:52.285688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:52.285688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:52.285688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:52.285688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:52.285688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:52.285688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:52.285688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:52.285688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:52.285688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:52.285688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:52.285688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:52.285688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:52.285688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:52.285688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:52.285688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:52.285688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:52.286548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:52.286548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:52.286548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:52.286548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:52.286548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:52.286548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:52.286548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:52.286548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:52.286548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:52.286548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:52.286548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:20:52.286548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:20:52.286548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 92/187] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:52.286548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467a4c5-52c6-4d72-be4a-291879ba1aec None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:52.325204 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee46006-cc13-483d-a234-20e13336acca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:52.326731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee46006-cc13-483d-a234-20e13336acca None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:52.397632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467a4c5-52c6-4d72-be4a-291879ba1aec None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:52.431892 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 96/188] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:52.432989 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee46006-cc13-483d-a234-20e13336acca None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:52.433139 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66043bb9-9cb1-43b4-a025-fbb5cd2909ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:52.433910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66043bb9-9cb1-43b4-a025-fbb5cd2909ad None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:52.434198 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66043bb9-9cb1-43b4-a025-fbb5cd2909ad None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:52.434473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66043bb9-9cb1-43b4-a025-fbb5cd2909ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:52.435713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66043bb9-9cb1-43b4-a025-fbb5cd2909ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:52.437306 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66043bb9-9cb1-43b4-a025-fbb5cd2909ad None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:52.438931 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 93/189] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:52.439735 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66043bb9-9cb1-43b4-a025-fbb5cd2909ad None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:52.492668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:52.495393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:52.549502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee46006-cc13-483d-a234-20e13336acca None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:52.550106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66043bb9-9cb1-43b4-a025-fbb5cd2909ad None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:52.585923 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bdf27-a404-4643-ad7b-1e5f20ffaf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:52.586271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06225358-5a36-4f35-bac8-5eede2a09ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:52.587533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bdf27-a404-4643-ad7b-1e5f20ffaf65 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:52.587666 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06225358-5a36-4f35-bac8-5eede2a09ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:52.587817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06225358-5a36-4f35-bac8-5eede2a09ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:52.588063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bdf27-a404-4643-ad7b-1e5f20ffaf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:52.588199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06225358-5a36-4f35-bac8-5eede2a09ec2 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:52.588372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bdf27-a404-4643-ad7b-1e5f20ffaf65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:52.588807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06225358-5a36-4f35-bac8-5eede2a09ec2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:52.589111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06225358-5a36-4f35-bac8-5eede2a09ec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:52.590506 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06225358-5a36-4f35-bac8-5eede2a09ec2 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:52.599077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 97/190] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:52.600078 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06225358-5a36-4f35-bac8-5eede2a09ec2 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:52.600203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bdf27-a404-4643-ad7b-1e5f20ffaf65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:52.608269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-2b3bdf27-a404-4643-ad7b-1e5f20ffaf65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:52.608269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:52.608269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:52.608269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:52.608269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:52.608269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:52.608269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:52.608269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:52.608269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:52.608269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:52.608269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:52.608269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:52.608269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:52.608269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:52.608269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:52.608269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:52.609216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:52.609216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:52.609216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:52.609216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:52.609216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:52.609216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:52.609216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:52.609216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:52.609216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:52.609216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:52.609216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:52.609216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:52.609216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:52.609216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:52.609216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:52.609216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:52.609999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:52.609999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:52.609999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:52.609999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:52.609999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:52.609999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:52.609999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:52.609999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:52.609999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:52.609999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:52.609999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:52.609999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:20:52.609999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 94/191] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:20:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:52.610647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bdf27-a404-4643-ad7b-1e5f20ffaf65 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:52.714632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06225358-5a36-4f35-bac8-5eede2a09ec2 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:52.725328 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bdf27-a404-4643-ad7b-1e5f20ffaf65 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:52.732645 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:52.734478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:52.753129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0e34b-655f-46e9-8843-619add439064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:52.753724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0e34b-655f-46e9-8843-619add439064 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:52.754133 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0e34b-655f-46e9-8843-619add439064 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:52.754377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0e34b-655f-46e9-8843-619add439064 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:52.755092 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0e34b-655f-46e9-8843-619add439064 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:52.755434 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0e34b-655f-46e9-8843-619add439064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:52.756806 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0e34b-655f-46e9-8843-619add439064 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:52.762609 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121752b1-f05f-42f9-bade-bb770995536b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:52.763517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121752b1-f05f-42f9-bade-bb770995536b None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:52.763802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121752b1-f05f-42f9-bade-bb770995536b None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:52.764081 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121752b1-f05f-42f9-bade-bb770995536b None admin] PATH_INFO: `/v3/projects/722e495737b64f63a913e644534fa749` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:52.766901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 98/192] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:52.767404 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121752b1-f05f-42f9-bade-bb770995536b None admin] RBAC: Authorizing `identity:get_project(project_id=722e495737b64f63a913e644534fa749)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:52.767755 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0e34b-655f-46e9-8843-619add439064 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:52.770024 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121752b1-f05f-42f9-bade-bb770995536b None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:52.777026 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 95/193] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:52 2022] GET /identity/v3/projects/722e495737b64f63a913e644534fa749 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:52.777026 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121752b1-f05f-42f9-bade-bb770995536b None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:52.883016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0e34b-655f-46e9-8843-619add439064 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:52.883228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121752b1-f05f-42f9-bade-bb770995536b None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:52.918633 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301db33-b914-4835-bd01-92989a184f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:52.919560 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301db33-b914-4835-bd01-92989a184f32 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:52.919837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301db33-b914-4835-bd01-92989a184f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:52.920117 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301db33-b914-4835-bd01-92989a184f32 None admin] PATH_INFO: `/v3/users/8d7dda2c7c6b4834a6cc5487fde8b1d3` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:52.921316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc054f9-cbc2-4c72-91aa-ae55eb004c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:52.922064 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc054f9-cbc2-4c72-91aa-ae55eb004c9d None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:52.922442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc054f9-cbc2-4c72-91aa-ae55eb004c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:52.922845 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc054f9-cbc2-4c72-91aa-ae55eb004c9d None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:52.924111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc054f9-cbc2-4c72-91aa-ae55eb004c9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:52.925681 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc054f9-cbc2-4c72-91aa-ae55eb004c9d None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:52.939075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301db33-b914-4835-bd01-92989a184f32 None admin] RBAC: Authorizing `identity:get_user(user_id=8d7dda2c7c6b4834a6cc5487fde8b1d3)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:52.940594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301db33-b914-4835-bd01-92989a184f32 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:52.942517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 96/194] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:52 2022] GET /identity/v3/users/8d7dda2c7c6b4834a6cc5487fde8b1d3 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:52.944097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301db33-b914-4835-bd01-92989a184f32 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:52.976388 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:53.015375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 99/195] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Jul 12 14:20:52 2022] POST /identity/v3/users => generated 297 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:53.016152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc054f9-cbc2-4c72-91aa-ae55eb004c9d None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:53.065120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301db33-b914-4835-bd01-92989a184f32 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:53.067464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:53.112502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d47c60-e5e0-41d3-81af-3071dc89b475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:53.113195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d47c60-e5e0-41d3-81af-3071dc89b475 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:53.113624 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d47c60-e5e0-41d3-81af-3071dc89b475 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:53.113799 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d47c60-e5e0-41d3-81af-3071dc89b475 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:53.114577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d47c60-e5e0-41d3-81af-3071dc89b475 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:53.114884 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d47c60-e5e0-41d3-81af-3071dc89b475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:53.116464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d47c60-e5e0-41d3-81af-3071dc89b475 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:53.127060 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 97/196] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:53.131920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d47c60-e5e0-41d3-81af-3071dc89b475 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:53.160808 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc054f9-cbc2-4c72-91aa-ae55eb004c9d None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:53.207822 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf99cc-d15b-44ec-93f0-bcc0b16c6006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:53.208891 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf99cc-d15b-44ec-93f0-bcc0b16c6006 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:53.209179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf99cc-d15b-44ec-93f0-bcc0b16c6006 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:53.209987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf99cc-d15b-44ec-93f0-bcc0b16c6006 None admin] PATH_INFO: `/v3/users/1bed0cdc27f24d4c9ad3a8605eb8a1c5` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:53.211300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf99cc-d15b-44ec-93f0-bcc0b16c6006 None admin] RBAC: Authorizing `identity:get_user(user_id=1bed0cdc27f24d4c9ad3a8605eb8a1c5)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:53.213051 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf99cc-d15b-44ec-93f0-bcc0b16c6006 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:53.214757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 100/197] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:53 2022] GET /identity/v3/users/1bed0cdc27f24d4c9ad3a8605eb8a1c5 => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:53.216599 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf99cc-d15b-44ec-93f0-bcc0b16c6006 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:53.244172 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:53.256683 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d47c60-e5e0-41d3-81af-3071dc89b475 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:53.310166 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ec76f-2e63-4fe6-9b69-95bf55d304cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:53.310851 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ec76f-2e63-4fe6-9b69-95bf55d304cb None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:53.311234 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ec76f-2e63-4fe6-9b69-95bf55d304cb None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:53.311545 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ec76f-2e63-4fe6-9b69-95bf55d304cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:53.312523 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ec76f-2e63-4fe6-9b69-95bf55d304cb None admin] RBAC: Adding query filter params (role.id=5444412a1f604ebaa9282a244859c051, scope.project.id=722e495737b64f63a913e644534fa749, user.id=8c1a31a288804174b0c5662f15125f80) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:53.312721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ec76f-2e63-4fe6-9b69-95bf55d304cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:53.314187 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ec76f-2e63-4fe6-9b69-95bf55d304cb None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:53.323036 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 98/198] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:53 2022] GET /identity/v3/role_assignments?user.id=8c1a31a288804174b0c5662f15125f80&scope.project.id=722e495737b64f63a913e644534fa749&role.id=5444412a1f604ebaa9282a244859c051 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:53.324034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ec76f-2e63-4fe6-9b69-95bf55d304cb None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:53.358794 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf99cc-d15b-44ec-93f0-bcc0b16c6006 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:53.359761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:53.408257 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e661d-4b8c-40da-80a6-ab8caa12a714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:53.408941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e661d-4b8c-40da-80a6-ab8caa12a714 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:53.409234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e661d-4b8c-40da-80a6-ab8caa12a714 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:53.409517 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e661d-4b8c-40da-80a6-ab8caa12a714 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:53.479156 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ec76f-2e63-4fe6-9b69-95bf55d304cb None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:53.512587 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e661d-4b8c-40da-80a6-ab8caa12a714 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:53.514115 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e661d-4b8c-40da-80a6-ab8caa12a714 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:53.533114 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b23068-6475-4f52-bd23-884bf59825f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:53.534018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b23068-6475-4f52-bd23-884bf59825f0 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:53.534296 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b23068-6475-4f52-bd23-884bf59825f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:53.534570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b23068-6475-4f52-bd23-884bf59825f0 None admin] PATH_INFO: `/v3/users/8d7dda2c7c6b4834a6cc5487fde8b1d3` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:53.536173 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b23068-6475-4f52-bd23-884bf59825f0 None admin] RBAC: Authorizing `identity:get_user(user_id=8d7dda2c7c6b4834a6cc5487fde8b1d3)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:53.537621 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b23068-6475-4f52-bd23-884bf59825f0 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:53.539483 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 99/199] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:53 2022] GET /identity/v3/users/8d7dda2c7c6b4834a6cc5487fde8b1d3 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:53.545442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b23068-6475-4f52-bd23-884bf59825f0 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:53.586629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:53.664229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 101/200] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:53.665863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e661d-4b8c-40da-80a6-ab8caa12a714 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:53.674167 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:53.689468 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b23068-6475-4f52-bd23-884bf59825f0 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:53.739436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf0628-fe07-4933-8cec-4031903a08af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:53.740474 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf0628-fe07-4933-8cec-4031903a08af None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:53.740967 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf0628-fe07-4933-8cec-4031903a08af None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:53.741450 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf0628-fe07-4933-8cec-4031903a08af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:53.804680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e661d-4b8c-40da-80a6-ab8caa12a714 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:53.833536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf0628-fe07-4933-8cec-4031903a08af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:53.835047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf0628-fe07-4933-8cec-4031903a08af None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:53.852605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4b7d7-4f8e-4ab6-a9c4-1b64864db5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:53.853274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4b7d7-4f8e-4ab6-a9c4-1b64864db5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:53.853562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4b7d7-4f8e-4ab6-a9c4-1b64864db5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:53.853841 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4b7d7-4f8e-4ab6-a9c4-1b64864db5c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:53.896822 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:53.951261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4b7d7-4f8e-4ab6-a9c4-1b64864db5c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:53.953135 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4b7d7-4f8e-4ab6-a9c4-1b64864db5c0 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:53.955902 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:53.973822 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 100/201] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:53.976119 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf0628-fe07-4933-8cec-4031903a08af None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:54.091309 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 102/202] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:54.091309 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4b7d7-4f8e-4ab6-a9c4-1b64864db5c0 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:54.115484 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf0628-fe07-4933-8cec-4031903a08af None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:54.152895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:54.163466 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb2ec8-9ece-461f-af0f-e883c8ef5291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:54.165438 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb2ec8-9ece-461f-af0f-e883c8ef5291 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:54.165928 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb2ec8-9ece-461f-af0f-e883c8ef5291 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:54.166402 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb2ec8-9ece-461f-af0f-e883c8ef5291 None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:54.167993 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb2ec8-9ece-461f-af0f-e883c8ef5291 None admin] RBAC: Authorizing `identity:get_project(project_id=a67548b777b24c2d88cd5789350f5c35)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:54.169677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb2ec8-9ece-461f-af0f-e883c8ef5291 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:54.175613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 101/203] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:53 2022] GET /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:54.176721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb2ec8-9ece-461f-af0f-e883c8ef5291 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:54.221172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4b7d7-4f8e-4ab6-a9c4-1b64864db5c0 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:54.223413 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:54.271152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5d587-7d8e-4b62-be2d-267c09ad5450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:54.272062 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5d587-7d8e-4b62-be2d-267c09ad5450 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:54.272352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5d587-7d8e-4b62-be2d-267c09ad5450 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:54.272636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5d587-7d8e-4b62-be2d-267c09ad5450 None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:54.274167 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5d587-7d8e-4b62-be2d-267c09ad5450 None admin] RBAC: Authorizing `identity:get_project(project_id=21f896d0c1d8492287fcd5e0801dec94)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:54.277027 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5d587-7d8e-4b62-be2d-267c09ad5450 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:54.283366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 103/204] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:54 2022] GET /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:54.284612 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5d587-7d8e-4b62-be2d-267c09ad5450 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:54.325916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb2ec8-9ece-461f-af0f-e883c8ef5291 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:54.373138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43c04a-65f1-4e11-96ed-cca29e3da2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:54.375074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43c04a-65f1-4e11-96ed-cca29e3da2de None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:54.375576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43c04a-65f1-4e11-96ed-cca29e3da2de None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:54.376042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43c04a-65f1-4e11-96ed-cca29e3da2de None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:54.378499 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43c04a-65f1-4e11-96ed-cca29e3da2de None admin] RBAC: Authorizing `identity:get_project(project_id=a67548b777b24c2d88cd5789350f5c35)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:54.380191 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43c04a-65f1-4e11-96ed-cca29e3da2de None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:54.387481 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 102/205] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:54 2022] GET /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:54.388850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43c04a-65f1-4e11-96ed-cca29e3da2de None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:54.443344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5d587-7d8e-4b62-be2d-267c09ad5450 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:54.480845 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:54.495680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e30b75-8f5c-4351-ba2d-4cfc1f4ced2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:54.496593 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e30b75-8f5c-4351-ba2d-4cfc1f4ced2c None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:54.497040 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e30b75-8f5c-4351-ba2d-4cfc1f4ced2c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:54.497500 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e30b75-8f5c-4351-ba2d-4cfc1f4ced2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:54.498368 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e30b75-8f5c-4351-ba2d-4cfc1f4ced2c None admin] RBAC: Adding query filter params (role.id=6184586642114a188e13c695442669f8, scope.project.id=a67548b777b24c2d88cd5789350f5c35, user.id=8d7dda2c7c6b4834a6cc5487fde8b1d3) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:54.498689 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e30b75-8f5c-4351-ba2d-4cfc1f4ced2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:54.500183 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e30b75-8f5c-4351-ba2d-4cfc1f4ced2c None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:54.506534 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 104/206] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:54 2022] GET /identity/v3/role_assignments?user.id=8d7dda2c7c6b4834a6cc5487fde8b1d3&scope.project.id=a67548b777b24c2d88cd5789350f5c35&role.id=6184586642114a188e13c695442669f8 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:54.507194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e30b75-8f5c-4351-ba2d-4cfc1f4ced2c None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:54.530845 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43c04a-65f1-4e11-96ed-cca29e3da2de None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:54.600892 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:54.603256 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062190e-1064-4f41-b66a-2530a0f83da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:54.609550 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062190e-1064-4f41-b66a-2530a0f83da1 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:54.613913 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062190e-1064-4f41-b66a-2530a0f83da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:54.613913 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062190e-1064-4f41-b66a-2530a0f83da1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:54.613913 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062190e-1064-4f41-b66a-2530a0f83da1 None admin] RBAC: Adding query filter params (role.id=91418844a31b44b885804c221d52c38b, scope.project.id=21f896d0c1d8492287fcd5e0801dec94, user.id=1bed0cdc27f24d4c9ad3a8605eb8a1c5) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:54.613913 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062190e-1064-4f41-b66a-2530a0f83da1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:54.614328 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062190e-1064-4f41-b66a-2530a0f83da1 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:54.628009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 103/207] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:54 2022] GET /identity/v3/role_assignments?user.id=1bed0cdc27f24d4c9ad3a8605eb8a1c5&scope.project.id=21f896d0c1d8492287fcd5e0801dec94&role.id=91418844a31b44b885804c221d52c38b => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:54.699684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e30b75-8f5c-4351-ba2d-4cfc1f4ced2c None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:54.772861 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf5ac4-bb86-418a-ace0-1c7e58749ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:54.773544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf5ac4-bb86-418a-ace0-1c7e58749ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:54.773832 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf5ac4-bb86-418a-ace0-1c7e58749ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:54.774512 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf5ac4-bb86-418a-ace0-1c7e58749ae1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:54.775590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf5ac4-bb86-418a-ace0-1c7e58749ae1 None admin] RBAC: Adding query filter params (role.id=ae530119fc5c42358179521ce865b5d7, scope.project.id=a67548b777b24c2d88cd5789350f5c35, user.id=8d7dda2c7c6b4834a6cc5487fde8b1d3) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:54.775910 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf5ac4-bb86-418a-ace0-1c7e58749ae1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:54.777419 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf5ac4-bb86-418a-ace0-1c7e58749ae1 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:54.785546 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 105/208] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:54 2022] GET /identity/v3/role_assignments?user.id=8d7dda2c7c6b4834a6cc5487fde8b1d3&scope.project.id=a67548b777b24c2d88cd5789350f5c35&role.id=ae530119fc5c42358179521ce865b5d7 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:55.479645 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5fea8-e7f8-46fe-a448-f8461f1940e6 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:55.480157 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5fea8-e7f8-46fe-a448-f8461f1940e6 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:55.480229 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5fea8-e7f8-46fe-a448-f8461f1940e6 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:55.481905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 104/209] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:55.487465 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e666d-dc96-4b1b-9d53-fa6d19de1a24 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:55.487908 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e666d-dc96-4b1b-9d53-fa6d19de1a24 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:55.488107 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e666d-dc96-4b1b-9d53-fa6d19de1a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:55.507559 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-0a9e666d-dc96-4b1b-9d53-fa6d19de1a24 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:55.509566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0a9e666d-dc96-4b1b-9d53-fa6d19de1a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:55.561751 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b51ab1-1ebf-4bfa-b12d-ab620c6aa78f None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:55.562048 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b51ab1-1ebf-4bfa-b12d-ab620c6aa78f None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:55.562475 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b51ab1-1ebf-4bfa-b12d-ab620c6aa78f None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:55.564047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 105/210] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:55.578547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ccfac-33b6-4ecb-83b3-214421dd7f12 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:55.579110 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ccfac-33b6-4ecb-83b3-214421dd7f12 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:55.579451 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ccfac-33b6-4ecb-83b3-214421dd7f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:55.598910 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 106/211] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:55.603453 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-b88ccfac-33b6-4ecb-83b3-214421dd7f12 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:55.604692 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b88ccfac-33b6-4ecb-83b3-214421dd7f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:55.624539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e666d-dc96-4b1b-9d53-fa6d19de1a24 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:55.664911 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:55.699821 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 106/212] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:55.726116 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ccfac-33b6-4ecb-83b3-214421dd7f12 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:55.764291 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e666d-dc96-4b1b-9d53-fa6d19de1a24 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:55.815306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50530e33-ffb3-4fd8-9395-f88cdf677cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:55.819297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50530e33-ffb3-4fd8-9395-f88cdf677cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:55.819297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50530e33-ffb3-4fd8-9395-f88cdf677cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:55.819297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50530e33-ffb3-4fd8-9395-f88cdf677cc5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:55.840674 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50530e33-ffb3-4fd8-9395-f88cdf677cc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:55.846297 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:55.849973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-50530e33-ffb3-4fd8-9395-f88cdf677cc5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:55.849973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:55.849973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:55.849973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:55.849973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:55.849973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:55.849973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:55.849973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:55.849973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:55.849973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:55.849973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:55.849973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:55.849973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:55.849973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:55.849973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:55.849973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:55.850838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:55.850838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:55.850838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:55.850838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:55.850838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:55.850838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:55.850838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:55.850838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:55.850838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:55.850838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:55.850838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:55.850838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:55.850838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:55.850838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:55.850838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:55.850838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:55.851624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:55.851624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:55.851624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:55.851624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:55.851624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:55.851624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:55.851624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:55.851624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:55.851624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:55.851624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:55.851624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:20:55.851624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:20:55.851624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 107/213] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:55.862900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50530e33-ffb3-4fd8-9395-f88cdf677cc5 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:55.942203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ccfac-33b6-4ecb-83b3-214421dd7f12 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:55.976421 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:55.999306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50530e33-ffb3-4fd8-9395-f88cdf677cc5 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:56.027392 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03923443-e17a-4861-b5b7-2b98bb2a1f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:56.027392 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03923443-e17a-4861-b5b7-2b98bb2a1f46 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:56.027392 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03923443-e17a-4861-b5b7-2b98bb2a1f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:56.027392 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03923443-e17a-4861-b5b7-2b98bb2a1f46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:56.035301 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03923443-e17a-4861-b5b7-2b98bb2a1f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:56.039308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03923443-e17a-4861-b5b7-2b98bb2a1f46 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:56.047300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e4b82-3d7b-4aee-8700-b1d0d43ec335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:56.047300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e4b82-3d7b-4aee-8700-b1d0d43ec335 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:56.047300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e4b82-3d7b-4aee-8700-b1d0d43ec335 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:56.047300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e4b82-3d7b-4aee-8700-b1d0d43ec335 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:56.047929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e4b82-3d7b-4aee-8700-b1d0d43ec335 None admin] RBAC: Adding query filter params (name=member) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:56.047929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e4b82-3d7b-4aee-8700-b1d0d43ec335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:56.048168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e4b82-3d7b-4aee-8700-b1d0d43ec335 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:56.055780 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 107/214] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:56.055780 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03923443-e17a-4861-b5b7-2b98bb2a1f46 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:56.059297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 108/215] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:56.066149 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e4b82-3d7b-4aee-8700-b1d0d43ec335 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:56.191522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03923443-e17a-4861-b5b7-2b98bb2a1f46 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:56.255343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:56.277762 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e4b82-3d7b-4aee-8700-b1d0d43ec335 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:56.289707 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ac90a-ba3d-4af0-b847-dd1dc47c4ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:56.290409 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ac90a-ba3d-4af0-b847-dd1dc47c4ce5 None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:56.290695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ac90a-ba3d-4af0-b847-dd1dc47c4ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:56.290977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ac90a-ba3d-4af0-b847-dd1dc47c4ce5 None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:56.297043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ac90a-ba3d-4af0-b847-dd1dc47c4ce5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:56.301210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ac90a-ba3d-4af0-b847-dd1dc47c4ce5 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:56.321279 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ff870-e9bb-4d52-80ab-60a0ba0437f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:56.322905 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ff870-e9bb-4d52-80ab-60a0ba0437f2 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:56.323958 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ff870-e9bb-4d52-80ab-60a0ba0437f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:56.324463 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ff870-e9bb-4d52-80ab-60a0ba0437f2 None admin] PATH_INFO: `/v3/users/17f9e149bf3047e8a39808a8d689ac0a` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:56.344140 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ff870-e9bb-4d52-80ab-60a0ba0437f2 None admin] RBAC: Authorizing `identity:get_user(user_id=17f9e149bf3047e8a39808a8d689ac0a)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:56.346297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ff870-e9bb-4d52-80ab-60a0ba0437f2 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:56.348904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 109/216] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:56 2022] GET /identity/v3/users/17f9e149bf3047e8a39808a8d689ac0a => generated 297 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:56.357694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ff870-e9bb-4d52-80ab-60a0ba0437f2 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:56.370594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:56.411309 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 108/217] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Jul 12 14:20:56 2022] POST /identity/v3/users => generated 297 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:56.541518 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ff870-e9bb-4d52-80ab-60a0ba0437f2 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:56.581988 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de524444-dedb-4b3a-ba44-78c04d05d0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:56.582907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de524444-dedb-4b3a-ba44-78c04d05d0cc None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:56.583450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de524444-dedb-4b3a-ba44-78c04d05d0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:56.583978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de524444-dedb-4b3a-ba44-78c04d05d0cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:56.662059 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de524444-dedb-4b3a-ba44-78c04d05d0cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:56.663824 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de524444-dedb-4b3a-ba44-78c04d05d0cc None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:56.693864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:56.803246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 110/218] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:20:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:20:56.811693 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ac90a-ba3d-4af0-b847-dd1dc47c4ce5 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:56.854824 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40701eb-37c4-4f62-a92f-905f882e4694 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:56.855479 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40701eb-37c4-4f62-a92f-905f882e4694 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:56.855955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40701eb-37c4-4f62-a92f-905f882e4694 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:56.858700 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 111/219] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:20:56.864775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cb7ec-5d46-41df-b7ff-31c9b2de5055 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:56.865359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cb7ec-5d46-41df-b7ff-31c9b2de5055 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:56.865840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cb7ec-5d46-41df-b7ff-31c9b2de5055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:56.890943 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-de7cb7ec-5d46-41df-b7ff-31c9b2de5055 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:56.892560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-de7cb7ec-5d46-41df-b7ff-31c9b2de5055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:56.938581 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ac90a-ba3d-4af0-b847-dd1dc47c4ce5 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:56.976483 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642da0a1-fde0-442c-9883-40e7b6608413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:56.978967 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642da0a1-fde0-442c-9883-40e7b6608413 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:56.980326 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642da0a1-fde0-442c-9883-40e7b6608413 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:56.980763 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642da0a1-fde0-442c-9883-40e7b6608413 None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:56.982234 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642da0a1-fde0-442c-9883-40e7b6608413 None admin] RBAC: Authorizing `identity:get_project(project_id=a67548b777b24c2d88cd5789350f5c35)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:56.984151 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642da0a1-fde0-442c-9883-40e7b6608413 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:56.984581 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 112/220] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:56.986530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 109/221] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:56 2022] GET /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:56.995302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cb7ec-5d46-41df-b7ff-31c9b2de5055 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:57.013372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642da0a1-fde0-442c-9883-40e7b6608413 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:57.040891 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:57.087388 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:57.127986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cb7ec-5d46-41df-b7ff-31c9b2de5055 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:57.152975 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642da0a1-fde0-442c-9883-40e7b6608413 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:57.178680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2dc18-40f2-4200-b93c-fc5684e1c187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:57.179655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2dc18-40f2-4200-b93c-fc5684e1c187 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:57.179946 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2dc18-40f2-4200-b93c-fc5684e1c187 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:57.180912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2dc18-40f2-4200-b93c-fc5684e1c187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:57.182481 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2dc18-40f2-4200-b93c-fc5684e1c187 None admin] RBAC: Adding query filter params (role.id=5444412a1f604ebaa9282a244859c051, scope.project.id=a67548b777b24c2d88cd5789350f5c35, user.id=17f9e149bf3047e8a39808a8d689ac0a) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:57.182955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2dc18-40f2-4200-b93c-fc5684e1c187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:57.184915 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2dc18-40f2-4200-b93c-fc5684e1c187 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:57.192837 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 113/222] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:20:56 2022] GET /identity/v3/role_assignments?user.id=17f9e149bf3047e8a39808a8d689ac0a&scope.project.id=a67548b777b24c2d88cd5789350f5c35&role.id=5444412a1f604ebaa9282a244859c051 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:57.194450 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54dd631-41c2-46ab-aefa-3dc3d4f3ea40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:57.195622 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54dd631-41c2-46ab-aefa-3dc3d4f3ea40 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:57.196663 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54dd631-41c2-46ab-aefa-3dc3d4f3ea40 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:57.197186 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54dd631-41c2-46ab-aefa-3dc3d4f3ea40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:57.201769 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a12327-5cee-4152-8972-349b15dda90a None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:57.202056 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a12327-5cee-4152-8972-349b15dda90a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:57.202505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a12327-5cee-4152-8972-349b15dda90a None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:57.204799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 114/223] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:57 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:57.213676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d06c1-f902-41e2-be86-098a034382b5 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:57.214259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d06c1-f902-41e2-be86-098a034382b5 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:57.214713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d06c1-f902-41e2-be86-098a034382b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:57.219318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54dd631-41c2-46ab-aefa-3dc3d4f3ea40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:57.226494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-a54dd631-41c2-46ab-aefa-3dc3d4f3ea40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:57.226494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:57.226494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:57.226494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:57.226494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:57.226494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:57.226494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:57.226494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:57.226494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:57.226494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:57.226494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:57.226494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:57.226494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:57.226494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:57.226494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:57.226494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:57.228104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:57.228104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:57.228104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:57.228104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:57.228104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:57.228104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:57.228104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:57.228104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:57.228104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:57.228104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:57.228104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:57.228104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:57.228104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:57.228104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:57.228104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:57.228104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:57.228864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:57.228864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:57.228864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:57.228864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:57.228864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:57.228864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:57.228864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:57.228864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:57.228864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:57.228864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:57.228864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:20:57.228864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:20:57.229873 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 110/224] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:20:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:57.236037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54dd631-41c2-46ab-aefa-3dc3d4f3ea40 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:57.248428 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-144d06c1-f902-41e2-be86-098a034382b5 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:57.250057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-144d06c1-f902-41e2-be86-098a034382b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:57.338680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 115/225] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:57.373144 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d06c1-f902-41e2-be86-098a034382b5 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:57.407632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:57.466049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54dd631-41c2-46ab-aefa-3dc3d4f3ea40 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:57.478491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:57.509119 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bf7d8-d101-4e77-94b8-ec1a809d24d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:57.509972 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d06c1-f902-41e2-be86-098a034382b5 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:57.510080 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bf7d8-d101-4e77-94b8-ec1a809d24d1 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:57.510556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bf7d8-d101-4e77-94b8-ec1a809d24d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:57.510849 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bf7d8-d101-4e77-94b8-ec1a809d24d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:57.511659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bf7d8-d101-4e77-94b8-ec1a809d24d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:57.511972 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bf7d8-d101-4e77-94b8-ec1a809d24d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:57.516029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bf7d8-d101-4e77-94b8-ec1a809d24d1 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:57.524101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 111/226] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:20:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:57.537181 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bf7d8-d101-4e77-94b8-ec1a809d24d1 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:57.562341 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e615e0-8325-416a-a2f5-bf2069d58c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:57.563155 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e615e0-8325-416a-a2f5-bf2069d58c6a None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:57.563466 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e615e0-8325-416a-a2f5-bf2069d58c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:57.563738 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e615e0-8325-416a-a2f5-bf2069d58c6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:57.584863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e615e0-8325-416a-a2f5-bf2069d58c6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:57.593340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-f7e615e0-8325-416a-a2f5-bf2069d58c6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:57.593340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:57.593340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:57.593340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:57.593340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:57.593340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:57.593340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:57.593340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:57.593340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:57.593340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:57.593340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:57.593340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:57.593340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:57.593340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:57.593340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:57.593340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:57.594219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:57.594219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:57.594219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:57.594219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:57.594219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:57.594219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:57.594219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:57.594219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:57.594219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:57.594219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:57.594219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:57.594219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:57.594219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:57.594219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:57.594219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:57.594219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:57.595032 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:57.595032 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:57.595032 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:57.595032 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:57.595032 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:57.595032 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:57.595032 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:57.595032 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:57.595032 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:57.595032 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:57.595032 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:20:57.595032 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:20:57.597180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 116/227] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:20:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:20:57.605663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e615e0-8325-416a-a2f5-bf2069d58c6a None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:57.740754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bf7d8-d101-4e77-94b8-ec1a809d24d1 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:57.784726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:57.800677 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e615e0-8325-416a-a2f5-bf2069d58c6a None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:57.813986 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03775af-799e-4b08-b610-7b80a04d793e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:57.815598 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03775af-799e-4b08-b610-7b80a04d793e None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:57.816078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03775af-799e-4b08-b610-7b80a04d793e None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:57.816565 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03775af-799e-4b08-b610-7b80a04d793e None admin] PATH_INFO: `/v3/users/8d7dda2c7c6b4834a6cc5487fde8b1d3` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:57.819692 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03775af-799e-4b08-b610-7b80a04d793e None admin] RBAC: Authorizing `identity:get_user(user_id=8d7dda2c7c6b4834a6cc5487fde8b1d3)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:57.821909 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03775af-799e-4b08-b610-7b80a04d793e None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:57.824750 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 112/228] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:57 2022] GET /identity/v3/users/8d7dda2c7c6b4834a6cc5487fde8b1d3 => generated 283 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:57.831424 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03775af-799e-4b08-b610-7b80a04d793e None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:57.863123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541dc92-4d28-4a97-8c4d-ac276c579f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:57.863879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541dc92-4d28-4a97-8c4d-ac276c579f3c None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:57.864168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541dc92-4d28-4a97-8c4d-ac276c579f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:57.864445 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541dc92-4d28-4a97-8c4d-ac276c579f3c None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:57.865214 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541dc92-4d28-4a97-8c4d-ac276c579f3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:57.865530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541dc92-4d28-4a97-8c4d-ac276c579f3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:57.867037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541dc92-4d28-4a97-8c4d-ac276c579f3c None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:57.884185 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:57.888650 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 117/229] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:57.895156 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541dc92-4d28-4a97-8c4d-ac276c579f3c None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:57.970732 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03775af-799e-4b08-b610-7b80a04d793e None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:58.012509 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13456ec-ef7d-41cb-bd6e-9602629f43e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:58.014181 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13456ec-ef7d-41cb-bd6e-9602629f43e0 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:58.014720 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13456ec-ef7d-41cb-bd6e-9602629f43e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:58.015190 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13456ec-ef7d-41cb-bd6e-9602629f43e0 None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:58.016988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13456ec-ef7d-41cb-bd6e-9602629f43e0 None admin] RBAC: Authorizing `identity:get_project(project_id=a67548b777b24c2d88cd5789350f5c35)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:58.018684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13456ec-ef7d-41cb-bd6e-9602629f43e0 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:58.021265 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 113/230] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:57 2022] GET /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:58.027314 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13456ec-ef7d-41cb-bd6e-9602629f43e0 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:58.149556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13456ec-ef7d-41cb-bd6e-9602629f43e0 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:58.167682 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:58.191912 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dbbf2-b351-4744-a220-7c7c44dc04c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:58.193287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dbbf2-b351-4744-a220-7c7c44dc04c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:58.193763 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dbbf2-b351-4744-a220-7c7c44dc04c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:58.194228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dbbf2-b351-4744-a220-7c7c44dc04c3 None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35/users/8d7dda2c7c6b4834a6cc5487fde8b1d3/roles/6184586642114a188e13c695442669f8` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:58.197516 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dbbf2-b351-4744-a220-7c7c44dc04c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a67548b777b24c2d88cd5789350f5c35, user_id=8d7dda2c7c6b4834a6cc5487fde8b1d3, role_id=6184586642114a188e13c695442669f8)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:58.199208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dbbf2-b351-4744-a220-7c7c44dc04c3 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:58.217183 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541dc92-4d28-4a97-8c4d-ac276c579f3c None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:58.253507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ec4af-3335-4bf0-9dae-552aaeb78a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:58.254646 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ec4af-3335-4bf0-9dae-552aaeb78a0f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:58.255224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ec4af-3335-4bf0-9dae-552aaeb78a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:58.255777 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ec4af-3335-4bf0-9dae-552aaeb78a0f None admin] PATH_INFO: `/v3/users/8d7dda2c7c6b4834a6cc5487fde8b1d3` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:58.257398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ec4af-3335-4bf0-9dae-552aaeb78a0f None admin] RBAC: Authorizing `identity:get_user(user_id=8d7dda2c7c6b4834a6cc5487fde8b1d3)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:58.259840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ec4af-3335-4bf0-9dae-552aaeb78a0f None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:58.261746 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 118/231] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:57 2022] GET /identity/v3/users/8d7dda2c7c6b4834a6cc5487fde8b1d3 => generated 283 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:58.267166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ec4af-3335-4bf0-9dae-552aaeb78a0f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:58.293426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 114/232] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:20:58 2022] PUT /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35/users/8d7dda2c7c6b4834a6cc5487fde8b1d3/roles/6184586642114a188e13c695442669f8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:20:58.303242 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:58.394344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ec4af-3335-4bf0-9dae-552aaeb78a0f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:58.434500 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45141b7-bdf3-4e2a-8bf3-c23cb4c6f4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:58.435871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45141b7-bdf3-4e2a-8bf3-c23cb4c6f4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:58.436373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45141b7-bdf3-4e2a-8bf3-c23cb4c6f4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:58.436857 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45141b7-bdf3-4e2a-8bf3-c23cb4c6f4a8 None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:58.438254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45141b7-bdf3-4e2a-8bf3-c23cb4c6f4a8 None admin] RBAC: Authorizing `identity:get_project(project_id=a67548b777b24c2d88cd5789350f5c35)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:58.439937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45141b7-bdf3-4e2a-8bf3-c23cb4c6f4a8 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:58.441958 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 119/233] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:20:58 2022] GET /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:20:58.459292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dbbf2-b351-4744-a220-7c7c44dc04c3 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:58.576896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dbbf2-b351-4744-a220-7c7c44dc04c3 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:58.613423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1acb6-2634-4c79-83b5-9a7b761c14d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:58.614333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1acb6-2634-4c79-83b5-9a7b761c14d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:58.614619 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1acb6-2634-4c79-83b5-9a7b761c14d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:58.615039 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1acb6-2634-4c79-83b5-9a7b761c14d0 None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35/users/8d7dda2c7c6b4834a6cc5487fde8b1d3/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:58.617062 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1acb6-2634-4c79-83b5-9a7b761c14d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a67548b777b24c2d88cd5789350f5c35, user_id=8d7dda2c7c6b4834a6cc5487fde8b1d3, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:58.619068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1acb6-2634-4c79-83b5-9a7b761c14d0 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:58.716618 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 115/234] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:20:58 2022] PUT /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35/users/8d7dda2c7c6b4834a6cc5487fde8b1d3/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:20:59.096186 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00fc8f-9a2e-40e8-aace-ee98c7087e72 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:59.097187 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00fc8f-9a2e-40e8-aace-ee98c7087e72 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:59.097777 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00fc8f-9a2e-40e8-aace-ee98c7087e72 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:59.099650 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 120/235] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:59.105728 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45d6ba-94d8-4cb4-ac35-421d79dc42d1 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:59.106195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45d6ba-94d8-4cb4-ac35-421d79dc42d1 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:59.106294 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45d6ba-94d8-4cb4-ac35-421d79dc42d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:59.114158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c1cff-565f-494d-9de8-ea0eb487763b None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:59.114444 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c1cff-565f-494d-9de8-ea0eb487763b None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:59.114728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c1cff-565f-494d-9de8-ea0eb487763b None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:59.116434 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 121/236] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:20:59.122712 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94502e2-9a99-445a-ab71-d6c656607cc6 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:59.123002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94502e2-9a99-445a-ab71-d6c656607cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:59.123311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94502e2-9a99-445a-ab71-d6c656607cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:59.134479 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-2e45d6ba-94d8-4cb4-ac35-421d79dc42d1 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:59.136890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2e45d6ba-94d8-4cb4-ac35-421d79dc42d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:59.142171 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-b94502e2-9a99-445a-ab71-d6c656607cc6 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:59.142171 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b94502e2-9a99-445a-ab71-d6c656607cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:59.175670 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:59.253737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 116/237] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:20:59.267387 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 122/238] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:20:59.287671 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45d6ba-94d8-4cb4-ac35-421d79dc42d1 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:59.297192 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94502e2-9a99-445a-ab71-d6c656607cc6 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:59.329019 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:59.419575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94502e2-9a99-445a-ab71-d6c656607cc6 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:59.420672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45d6ba-94d8-4cb4-ac35-421d79dc42d1 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:59.458468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c2856-8a8f-45ba-8a30-54a396fdb0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:59.459719 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c2856-8a8f-45ba-8a30-54a396fdb0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:59.460204 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c2856-8a8f-45ba-8a30-54a396fdb0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:59.460677 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c2856-8a8f-45ba-8a30-54a396fdb0a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:59.462131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c2856-8a8f-45ba-8a30-54a396fdb0a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:59.463937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c2856-8a8f-45ba-8a30-54a396fdb0a3 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:59.466154 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 123/239] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:20:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:59.470732 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dc63f-88e2-4232-b622-6f55e6aa622f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:59.471837 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c2856-8a8f-45ba-8a30-54a396fdb0a3 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:59.473195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dc63f-88e2-4232-b622-6f55e6aa622f None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:59.476803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dc63f-88e2-4232-b622-6f55e6aa622f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:59.479639 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dc63f-88e2-4232-b622-6f55e6aa622f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:59.502360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153dc63f-88e2-4232-b622-6f55e6aa622f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:20:59.520974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-153dc63f-88e2-4232-b622-6f55e6aa622f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:20:59.520974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:20:59.520974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:20:59.520974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:20:59.520974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:20:59.520974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:20:59.520974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:20:59.520974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:20:59.520974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:20:59.520974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:20:59.520974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:20:59.520974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:20:59.520974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:20:59.520974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:20:59.520974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:20:59.520974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:20:59.521910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:20:59.521910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:20:59.521910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:20:59.521910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:20:59.521910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:20:59.521910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:20:59.521910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:20:59.521910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:20:59.521910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:20:59.521910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:20:59.521910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:20:59.521910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:20:59.521910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:20:59.521910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:20:59.521910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:20:59.521910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:20:59.528014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:20:59.528014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:20:59.528014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:20:59.528014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:20:59.528014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:20:59.528014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:20:59.528014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:20:59.528014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:20:59.528014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:20:59.528014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:20:59.528014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:20:59.528014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:20:59.528014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 117/240] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:20:59.545512 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dc63f-88e2-4232-b622-6f55e6aa622f None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:59.583188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:59.597087 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c2856-8a8f-45ba-8a30-54a396fdb0a3 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:59.600908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:59.637023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699009a-41a9-4f6a-8987-996939614437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:59.638050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699009a-41a9-4f6a-8987-996939614437 None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:59.638513 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699009a-41a9-4f6a-8987-996939614437 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:59.639304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699009a-41a9-4f6a-8987-996939614437 None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:59.640315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699009a-41a9-4f6a-8987-996939614437 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:59.645589 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699009a-41a9-4f6a-8987-996939614437 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:59.727456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 124/241] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Jul 12 14:20:59 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:20:59.738087 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dc63f-88e2-4232-b622-6f55e6aa622f None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:59.780000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a37ab-30fe-44b9-93e2-03e8c6da336d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:20:59.781052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a37ab-30fe-44b9-93e2-03e8c6da336d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:59.781607 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a37ab-30fe-44b9-93e2-03e8c6da336d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:59.782073 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a37ab-30fe-44b9-93e2-03e8c6da336d None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:59.783246 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a37ab-30fe-44b9-93e2-03e8c6da336d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:20:59.783827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a37ab-30fe-44b9-93e2-03e8c6da336d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:20:59.785559 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a37ab-30fe-44b9-93e2-03e8c6da336d None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:20:59.797146 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 118/242] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:20:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:20:59.803865 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd5af5-3cec-4c3a-90c3-6915e4ddffa8 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:59.804445 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd5af5-3cec-4c3a-90c3-6915e4ddffa8 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:59.804931 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd5af5-3cec-4c3a-90c3-6915e4ddffa8 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:59.808387 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 125/243] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:20:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:20:59.809353 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a37ab-30fe-44b9-93e2-03e8c6da336d None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:20:59.818409 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05b2d6-3766-41fb-bcb9-534e6cf1ed78 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:20:59.819021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05b2d6-3766-41fb-bcb9-534e6cf1ed78 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:20:59.819564 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05b2d6-3766-41fb-bcb9-534e6cf1ed78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:20:59.855376 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-5f05b2d6-3766-41fb-bcb9-534e6cf1ed78 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:20:59.856981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-5f05b2d6-3766-41fb-bcb9-534e6cf1ed78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:20:59.967647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:20:59.976636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 126/244] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:20:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:20:59.991954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a37ab-30fe-44b9-93e2-03e8c6da336d None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:20:59.999105 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05b2d6-3766-41fb-bcb9-534e6cf1ed78 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:00.032969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a4efc-33eb-42a2-b77f-3fa300c18d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:00.034185 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a4efc-33eb-42a2-b77f-3fa300c18d20 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:00.034681 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a4efc-33eb-42a2-b77f-3fa300c18d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:00.035243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a4efc-33eb-42a2-b77f-3fa300c18d20 None admin] PATH_INFO: `/v3/users/b1e77579c0b64edcadea6c90fcc5b24c` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:00.051851 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a4efc-33eb-42a2-b77f-3fa300c18d20 None admin] RBAC: Authorizing `identity:get_user(user_id=b1e77579c0b64edcadea6c90fcc5b24c)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:00.053885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a4efc-33eb-42a2-b77f-3fa300c18d20 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:00.060983 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 119/245] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:20:59 2022] GET /identity/v3/users/b1e77579c0b64edcadea6c90fcc5b24c => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:00.062702 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a4efc-33eb-42a2-b77f-3fa300c18d20 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:00.080576 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:00.108951 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05b2d6-3766-41fb-bcb9-534e6cf1ed78 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:00.151479 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35e015-eefb-473c-812b-1f1477257248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:00.152293 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35e015-eefb-473c-812b-1f1477257248 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:00.152575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35e015-eefb-473c-812b-1f1477257248 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:00.152850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35e015-eefb-473c-812b-1f1477257248 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:00.166249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35e015-eefb-473c-812b-1f1477257248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:00.176883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-8e35e015-eefb-473c-812b-1f1477257248 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:00.176883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:00.176883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:00.176883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:00.176883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:00.176883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:00.176883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:00.176883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:00.176883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:00.176883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:00.176883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:00.176883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:00.176883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:00.176883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:00.176883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:00.176883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:00.177999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:00.177999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:00.177999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:00.177999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:00.177999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:00.177999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:00.177999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:00.177999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:00.177999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:00.177999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:00.177999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:00.177999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:00.177999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:00.177999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:00.177999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:00.177999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:00.178801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:00.178801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:00.178801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:00.178801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:00.178801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:00.178801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:00.178801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:00.178801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:00.178801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:00.178801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:00.178801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:00.178801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:00.184264 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 127/246] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:20:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:00.186432 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35e015-eefb-473c-812b-1f1477257248 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:00.191467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a4efc-33eb-42a2-b77f-3fa300c18d20 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:00.241405 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cb7fe-d119-4fab-bc61-413028d662b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:00.242480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cb7fe-d119-4fab-bc61-413028d662b2 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:00.242964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cb7fe-d119-4fab-bc61-413028d662b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:00.243477 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cb7fe-d119-4fab-bc61-413028d662b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:00.261553 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:00.335475 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35e015-eefb-473c-812b-1f1477257248 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:00.345847 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11cb7fe-d119-4fab-bc61-413028d662b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:00.348977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11cb7fe-d119-4fab-bc61-413028d662b2 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:00.386867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e1273-5537-46ef-9e2b-b23ddb713dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:00.387603 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e1273-5537-46ef-9e2b-b23ddb713dfe None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:00.387885 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e1273-5537-46ef-9e2b-b23ddb713dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:00.388162 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e1273-5537-46ef-9e2b-b23ddb713dfe None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:00.388934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e1273-5537-46ef-9e2b-b23ddb713dfe None admin] RBAC: Adding query filter params (name=member) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:00.389380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e1273-5537-46ef-9e2b-b23ddb713dfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:00.390963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e1273-5537-46ef-9e2b-b23ddb713dfe None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:00.392782 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:00.403052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 128/247] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:21:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:00.408548 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e1273-5537-46ef-9e2b-b23ddb713dfe None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:00.493778 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 120/248] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 14:21:00.501582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cb7fe-d119-4fab-bc61-413028d662b2 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:00.540396 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e1273-5537-46ef-9e2b-b23ddb713dfe None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:00.547967 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:00.581812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511363f-aebc-4966-91a6-14c0c3c4800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:00.583075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511363f-aebc-4966-91a6-14c0c3c4800a None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:00.583598 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511363f-aebc-4966-91a6-14c0c3c4800a None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:00.584076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511363f-aebc-4966-91a6-14c0c3c4800a None admin] PATH_INFO: `/v3/users/17f9e149bf3047e8a39808a8d689ac0a` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:00.585566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511363f-aebc-4966-91a6-14c0c3c4800a None admin] RBAC: Authorizing `identity:get_user(user_id=17f9e149bf3047e8a39808a8d689ac0a)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:00.588008 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511363f-aebc-4966-91a6-14c0c3c4800a None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:00.591025 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 129/249] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:00 2022] GET /identity/v3/users/17f9e149bf3047e8a39808a8d689ac0a => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:00.597861 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511363f-aebc-4966-91a6-14c0c3c4800a None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:00.634960 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cb7fe-d119-4fab-bc61-413028d662b2 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:00.668129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:00.674568 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ded62-46db-46ff-be4d-5e4b14855066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:00.675987 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ded62-46db-46ff-be4d-5e4b14855066 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:00.676539 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ded62-46db-46ff-be4d-5e4b14855066 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:00.677013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ded62-46db-46ff-be4d-5e4b14855066 None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:00.678710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ded62-46db-46ff-be4d-5e4b14855066 None admin] RBAC: Authorizing `identity:get_project(project_id=a67548b777b24c2d88cd5789350f5c35)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:00.681133 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ded62-46db-46ff-be4d-5e4b14855066 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:00.683097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 121/250] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:00 2022] GET /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:00.689149 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ded62-46db-46ff-be4d-5e4b14855066 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:00.711002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511363f-aebc-4966-91a6-14c0c3c4800a None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:00.753982 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4584ea3-d209-4dd7-be2d-32b7e90631de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:00.754811 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4584ea3-d209-4dd7-be2d-32b7e90631de None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:00.755148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4584ea3-d209-4dd7-be2d-32b7e90631de None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:00.755468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4584ea3-d209-4dd7-be2d-32b7e90631de None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:00.756748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4584ea3-d209-4dd7-be2d-32b7e90631de None admin] RBAC: Authorizing `identity:get_project(project_id=a67548b777b24c2d88cd5789350f5c35)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:00.758250 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4584ea3-d209-4dd7-be2d-32b7e90631de None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:00.760467 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 130/251] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:00 2022] GET /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:00.766058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4584ea3-d209-4dd7-be2d-32b7e90631de None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:00.811933 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ded62-46db-46ff-be4d-5e4b14855066 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:00.814947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:00.853041 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d3f13-70af-42a8-9c2b-1af73b5e8768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:00.854188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d3f13-70af-42a8-9c2b-1af73b5e8768 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:00.854671 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d3f13-70af-42a8-9c2b-1af73b5e8768 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:00.855148 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d3f13-70af-42a8-9c2b-1af73b5e8768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:00.856233 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d3f13-70af-42a8-9c2b-1af73b5e8768 None admin] RBAC: Adding query filter params (role.id=91418844a31b44b885804c221d52c38b, scope.project.id=a67548b777b24c2d88cd5789350f5c35, user.id=b1e77579c0b64edcadea6c90fcc5b24c) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:00.856798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d3f13-70af-42a8-9c2b-1af73b5e8768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:00.859415 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d3f13-70af-42a8-9c2b-1af73b5e8768 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:00.866239 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 122/252] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:00 2022] GET /identity/v3/role_assignments?user.id=b1e77579c0b64edcadea6c90fcc5b24c&scope.project.id=a67548b777b24c2d88cd5789350f5c35&role.id=91418844a31b44b885804c221d52c38b => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:00.873364 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4584ea3-d209-4dd7-be2d-32b7e90631de None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:00.909787 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:00.915486 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6eff0-3476-46d7-ad57-11a926b90fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:00.916495 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6eff0-3476-46d7-ad57-11a926b90fb8 None admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:00.916777 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6eff0-3476-46d7-ad57-11a926b90fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:00.917114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6eff0-3476-46d7-ad57-11a926b90fb8 None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35/users/17f9e149bf3047e8a39808a8d689ac0a/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:00.919270 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6eff0-3476-46d7-ad57-11a926b90fb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a67548b777b24c2d88cd5789350f5c35, user_id=17f9e149bf3047e8a39808a8d689ac0a, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:00.920908 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6eff0-3476-46d7-ad57-11a926b90fb8 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:01.002181 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 131/253] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:21:00 2022] PUT /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35/users/17f9e149bf3047e8a39808a8d689ac0a/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:21:01.115604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c868f-ffe8-4f6d-a7d9-c9e56e157281 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:01.115946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c868f-ffe8-4f6d-a7d9-c9e56e157281 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:01.116176 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c868f-ffe8-4f6d-a7d9-c9e56e157281 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:01.117975 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 123/254] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:01.127960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986642a-0d5f-48d0-a77c-26b476a038b0 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:01.128478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986642a-0d5f-48d0-a77c-26b476a038b0 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:01.128550 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986642a-0d5f-48d0-a77c-26b476a038b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:01.146273 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-6986642a-0d5f-48d0-a77c-26b476a038b0 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:01.147528 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-6986642a-0d5f-48d0-a77c-26b476a038b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:01.227377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 132/255] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:21:01.262508 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c868f-ffe8-4f6d-a7d9-c9e56e157281 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:01.440333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c868f-ffe8-4f6d-a7d9-c9e56e157281 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:01.503165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1770e1e-e4e2-4dca-99ae-a4533e3092ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:01.504065 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1770e1e-e4e2-4dca-99ae-a4533e3092ba None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:01.504354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1770e1e-e4e2-4dca-99ae-a4533e3092ba None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:01.504630 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1770e1e-e4e2-4dca-99ae-a4533e3092ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:01.523527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1770e1e-e4e2-4dca-99ae-a4533e3092ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:01.532386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-b1770e1e-e4e2-4dca-99ae-a4533e3092ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:21:01.532386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:01.532386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:01.532386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:01.532386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:01.532386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:01.532386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:01.532386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:01.532386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:01.532386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:01.532386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:01.532386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:01.532386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:01.532386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:01.532386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:01.532386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:01.533290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:01.533290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:01.533290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:01.533290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:01.533290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:01.533290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:01.533290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:01.533290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:01.533290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:01.533290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:01.533290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:01.533290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:01.533290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:01.533290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:01.533290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:01.533290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:01.534501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:01.534501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:01.534501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:01.534501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:01.534501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:01.534501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:01.534501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:01.534501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:01.534501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:01.534501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:01.534501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:21:01.534501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:01.534501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 124/256] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:21:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:01.541185 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986642a-0d5f-48d0-a77c-26b476a038b0 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:01.718052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986642a-0d5f-48d0-a77c-26b476a038b0 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:01.743851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:01.757288 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0b327-bc62-4efc-abfe-15f52306a121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:01.760294 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0b327-bc62-4efc-abfe-15f52306a121 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:01.760294 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0b327-bc62-4efc-abfe-15f52306a121 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:01.760294 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0b327-bc62-4efc-abfe-15f52306a121 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:01.760510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0b327-bc62-4efc-abfe-15f52306a121 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:01.760928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0b327-bc62-4efc-abfe-15f52306a121 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:01.763406 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0b327-bc62-4efc-abfe-15f52306a121 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:01.779513 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 133/257] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:01.787221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1770e1e-e4e2-4dca-99ae-a4533e3092ba None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:01.819871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:01.886801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70c61f-77be-4a72-b3dc-1623c7790818 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:01.887269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70c61f-77be-4a72-b3dc-1623c7790818 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:01.887732 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70c61f-77be-4a72-b3dc-1623c7790818 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:01.890222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 134/258] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:21:01.896112 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d57313-2694-4df9-b913-3f85a70c1ca6 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:01.896400 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d57313-2694-4df9-b913-3f85a70c1ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:01.896675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d57313-2694-4df9-b913-3f85a70c1ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:01.914331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-82d57313-2694-4df9-b913-3f85a70c1ca6 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:01.916288 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-82d57313-2694-4df9-b913-3f85a70c1ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:01.931106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1770e1e-e4e2-4dca-99ae-a4533e3092ba None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:02.016842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 135/259] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:21:02.020025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a8014-8e98-4c57-87eb-851f7733fe7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:02.020939 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a8014-8e98-4c57-87eb-851f7733fe7f None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.021222 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a8014-8e98-4c57-87eb-851f7733fe7f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.021498 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a8014-8e98-4c57-87eb-851f7733fe7f None admin] PATH_INFO: `/v3/users/8d7dda2c7c6b4834a6cc5487fde8b1d3` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.022815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a8014-8e98-4c57-87eb-851f7733fe7f None admin] RBAC: Authorizing `identity:get_user(user_id=8d7dda2c7c6b4834a6cc5487fde8b1d3)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:02.024910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a8014-8e98-4c57-87eb-851f7733fe7f None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:02.026828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 125/260] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:01 2022] GET /identity/v3/users/8d7dda2c7c6b4834a6cc5487fde8b1d3 => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:02.032359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d57313-2694-4df9-b913-3f85a70c1ca6 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:02.071146 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a8014-8e98-4c57-87eb-851f7733fe7f None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:02.183031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d57313-2694-4df9-b913-3f85a70c1ca6 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:02.198160 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:02.218747 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ac3e4-6a4e-4151-bc92-b3e1931a2270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:02.219522 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ac3e4-6a4e-4151-bc92-b3e1931a2270 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.219881 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ac3e4-6a4e-4151-bc92-b3e1931a2270 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.220325 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ac3e4-6a4e-4151-bc92-b3e1931a2270 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.302536 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ac3e4-6a4e-4151-bc92-b3e1931a2270 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:02.304317 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ac3e4-6a4e-4151-bc92-b3e1931a2270 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:02.344616 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:02.358510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a8014-8e98-4c57-87eb-851f7733fe7f None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:02.428120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69feee16-ac79-4148-b230-11f2ac3a5124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:02.429293 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feee16-ac79-4148-b230-11f2ac3a5124 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.432051 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feee16-ac79-4148-b230-11f2ac3a5124 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.432051 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feee16-ac79-4148-b230-11f2ac3a5124 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.450524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69feee16-ac79-4148-b230-11f2ac3a5124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:02.458840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-69feee16-ac79-4148-b230-11f2ac3a5124 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:02.458840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:02.458840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:02.458840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:02.458840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:02.458840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:02.458840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:02.458840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:02.458840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:02.458840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:02.458840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:02.458840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:02.458840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:02.458840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:02.458840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:02.458840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:02.459896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:02.459896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:02.459896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:02.459896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:02.459896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:02.459896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:02.459896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:02.459896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:02.459896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:02.459896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:02.459896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:02.459896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:02.459896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:02.459896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:02.459896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:02.459896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:02.460667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:02.460667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:02.460667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:02.460667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:02.460667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:02.460667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:02.460667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:02.460667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:02.460667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:02.460667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:02.460667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:02.460667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:02.463342 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 136/261] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:02.468898 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 126/262] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:21:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:02.473171 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ac3e4-6a4e-4151-bc92-b3e1931a2270 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:02.476481 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69feee16-ac79-4148-b230-11f2ac3a5124 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:02.495778 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:02.580420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ac3e4-6a4e-4151-bc92-b3e1931a2270 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:02.615639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a91c8-3c7c-4b39-9bff-8a0754e74366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:02.616842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a91c8-3c7c-4b39-9bff-8a0754e74366 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.617364 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a91c8-3c7c-4b39-9bff-8a0754e74366 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.618365 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a91c8-3c7c-4b39-9bff-8a0754e74366 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.619554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a91c8-3c7c-4b39-9bff-8a0754e74366 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:02.620062 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a91c8-3c7c-4b39-9bff-8a0754e74366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:02.621876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a91c8-3c7c-4b39-9bff-8a0754e74366 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:02.631350 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 137/263] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:02.639728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a91c8-3c7c-4b39-9bff-8a0754e74366 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:02.683195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69feee16-ac79-4148-b230-11f2ac3a5124 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:02.732449 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:02.755695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af4387-9f2a-449e-83ca-d564c5cbd37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:02.756830 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af4387-9f2a-449e-83ca-d564c5cbd37b None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.757257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af4387-9f2a-449e-83ca-d564c5cbd37b None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.757701 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af4387-9f2a-449e-83ca-d564c5cbd37b None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.758713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a91c8-3c7c-4b39-9bff-8a0754e74366 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:02.764064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af4387-9f2a-449e-83ca-d564c5cbd37b None admin] RBAC: Authorizing `identity:get_project(project_id=a67548b777b24c2d88cd5789350f5c35)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:02.765757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af4387-9f2a-449e-83ca-d564c5cbd37b None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:02.768982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 127/264] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:02 2022] GET /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:02.775188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af4387-9f2a-449e-83ca-d564c5cbd37b None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:02.802786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d04d8-c17c-44ce-af25-1914367b8aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:02.803709 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d04d8-c17c-44ce-af25-1914367b8aca None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.804005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d04d8-c17c-44ce-af25-1914367b8aca None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.804295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d04d8-c17c-44ce-af25-1914367b8aca None admin] PATH_INFO: `/v3/users/8d7dda2c7c6b4834a6cc5487fde8b1d3` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.806718 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d04d8-c17c-44ce-af25-1914367b8aca None admin] RBAC: Authorizing `identity:get_user(user_id=8d7dda2c7c6b4834a6cc5487fde8b1d3)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:02.808394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d04d8-c17c-44ce-af25-1914367b8aca None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:02.810495 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 138/265] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:02 2022] GET /identity/v3/users/8d7dda2c7c6b4834a6cc5487fde8b1d3 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:02.815927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:02.817074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d04d8-c17c-44ce-af25-1914367b8aca None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:02.943500 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af4387-9f2a-449e-83ca-d564c5cbd37b None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:02.978329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d2618-0983-485c-90ea-1ca6fa6e3d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:02.978993 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d2618-0983-485c-90ea-1ca6fa6e3d8c None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:02.979305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d2618-0983-485c-90ea-1ca6fa6e3d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:02.979575 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d2618-0983-485c-90ea-1ca6fa6e3d8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:02.980420 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d2618-0983-485c-90ea-1ca6fa6e3d8c None admin] RBAC: Adding query filter params (role.id=6184586642114a188e13c695442669f8, scope.project.id=a67548b777b24c2d88cd5789350f5c35, user.id=8d7dda2c7c6b4834a6cc5487fde8b1d3) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:02.980732 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d2618-0983-485c-90ea-1ca6fa6e3d8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:02.982187 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d2618-0983-485c-90ea-1ca6fa6e3d8c None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:02.988725 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 128/266] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:02 2022] GET /identity/v3/role_assignments?user.id=8d7dda2c7c6b4834a6cc5487fde8b1d3&scope.project.id=a67548b777b24c2d88cd5789350f5c35&role.id=6184586642114a188e13c695442669f8 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:03.010906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d04d8-c17c-44ce-af25-1914367b8aca None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:03.061121 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec4287-f4f4-4281-a4e7-76dd854fd02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:03.061859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec4287-f4f4-4281-a4e7-76dd854fd02a None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:03.062151 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec4287-f4f4-4281-a4e7-76dd854fd02a None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:03.062432 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec4287-f4f4-4281-a4e7-76dd854fd02a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:03.090887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:03.161190 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec4287-f4f4-4281-a4e7-76dd854fd02a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:03.162801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec4287-f4f4-4281-a4e7-76dd854fd02a None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:03.284422 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 139/267] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:03.290666 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d2618-0983-485c-90ea-1ca6fa6e3d8c None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:03.323925 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f2342-b50b-4678-b65b-889d7ad68702 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:03.324223 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f2342-b50b-4678-b65b-889d7ad68702 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:03.324670 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f2342-b50b-4678-b65b-889d7ad68702 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:03.326655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 140/268] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:03.337550 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cbe3c-4f2a-4ac0-af6d-33d599c2c504 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:03.338091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cbe3c-4f2a-4ac0-af6d-33d599c2c504 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:03.338544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cbe3c-4f2a-4ac0-af6d-33d599c2c504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:03.365117 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-5b9cbe3c-4f2a-4ac0-af6d-33d599c2c504 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:03.366668 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-5b9cbe3c-4f2a-4ac0-af6d-33d599c2c504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:03.397142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:03.410514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d2618-0983-485c-90ea-1ca6fa6e3d8c None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:03.426901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:03.451053 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c205cd-de69-4b8f-8627-205c797cd393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:03.452218 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c205cd-de69-4b8f-8627-205c797cd393 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:03.452681 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c205cd-de69-4b8f-8627-205c797cd393 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:03.453098 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c205cd-de69-4b8f-8627-205c797cd393 None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:03.454455 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c205cd-de69-4b8f-8627-205c797cd393 None admin] RBAC: Authorizing `identity:get_project(project_id=a67548b777b24c2d88cd5789350f5c35)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:03.458855 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c205cd-de69-4b8f-8627-205c797cd393 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:03.458855 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 129/269] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:03 2022] GET /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:03.460293 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 141/270] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:03.467117 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c205cd-de69-4b8f-8627-205c797cd393 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:03.500134 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cbe3c-4f2a-4ac0-af6d-33d599c2c504 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:03.583601 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c205cd-de69-4b8f-8627-205c797cd393 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:03.611617 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cbe3c-4f2a-4ac0-af6d-33d599c2c504 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:03.623761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a34878-8d17-4d74-872e-13591cf0723d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:03.624895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a34878-8d17-4d74-872e-13591cf0723d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:03.625381 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a34878-8d17-4d74-872e-13591cf0723d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:03.625952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a34878-8d17-4d74-872e-13591cf0723d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:03.627084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a34878-8d17-4d74-872e-13591cf0723d None admin] RBAC: Adding query filter params (role.id=ae530119fc5c42358179521ce865b5d7, scope.project.id=a67548b777b24c2d88cd5789350f5c35, user.id=8d7dda2c7c6b4834a6cc5487fde8b1d3) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:03.627648 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a34878-8d17-4d74-872e-13591cf0723d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:03.629395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a34878-8d17-4d74-872e-13591cf0723d None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:03.643519 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 130/271] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:03 2022] GET /identity/v3/role_assignments?user.id=8d7dda2c7c6b4834a6cc5487fde8b1d3&scope.project.id=a67548b777b24c2d88cd5789350f5c35&role.id=ae530119fc5c42358179521ce865b5d7 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:03.650419 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3770e-357e-4159-af74-6ab0423ab147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:03.651267 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3770e-357e-4159-af74-6ab0423ab147 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:03.651607 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3770e-357e-4159-af74-6ab0423ab147 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:03.651894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3770e-357e-4159-af74-6ab0423ab147 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:03.666050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3770e-357e-4159-af74-6ab0423ab147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:03.674575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-eea3770e-357e-4159-af74-6ab0423ab147 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:03.674575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:03.674575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:03.674575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:03.674575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:03.674575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:03.674575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:03.674575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:03.674575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:03.674575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:03.674575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:03.674575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:03.674575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:03.674575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:03.674575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:03.674575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:03.675562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:03.675562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:03.675562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:03.675562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:03.675562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:03.675562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:03.675562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:03.675562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:03.675562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:03.675562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:03.675562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:03.675562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:03.675562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:03.675562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:03.675562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:03.675562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:03.676398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:03.676398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:03.676398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:03.676398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:03.676398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:03.676398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:03.676398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:03.676398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:03.676398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:03.676398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:03.676398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:03.676398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:03.676398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 142/272] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:03.684426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a34878-8d17-4d74-872e-13591cf0723d None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:03.725484 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:03.835874 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a34878-8d17-4d74-872e-13591cf0723d None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:03.844850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae69d17-d848-4f2b-a5fe-b49bdce101cc None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:03.845141 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae69d17-d848-4f2b-a5fe-b49bdce101cc None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:03.845410 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae69d17-d848-4f2b-a5fe-b49bdce101cc None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:03.846819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 143/273] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:03.852397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02fe5a-f584-4385-b9c2-aa2ce71954cb None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:03.852690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02fe5a-f584-4385-b9c2-aa2ce71954cb None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:03.853342 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02fe5a-f584-4385-b9c2-aa2ce71954cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:03.873956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-cf02fe5a-f584-4385-b9c2-aa2ce71954cb None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:03.876438 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-cf02fe5a-f584-4385-b9c2-aa2ce71954cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:03.877238 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435543e-166a-4a28-9e30-96718480e627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:03.877923 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435543e-166a-4a28-9e30-96718480e627 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:03.878203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435543e-166a-4a28-9e30-96718480e627 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:03.878476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435543e-166a-4a28-9e30-96718480e627 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:03.879232 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435543e-166a-4a28-9e30-96718480e627 None admin] RBAC: Adding query filter params (name=member) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:03.881635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435543e-166a-4a28-9e30-96718480e627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:03.883017 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435543e-166a-4a28-9e30-96718480e627 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:03.897172 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 131/274] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:21:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:03.903198 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435543e-166a-4a28-9e30-96718480e627 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:03.925812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:03.987322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 144/275] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:21:04.013691 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02fe5a-f584-4385-b9c2-aa2ce71954cb None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:04.025473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:04.048416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435543e-166a-4a28-9e30-96718480e627 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:04.092581 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6aff5-1a87-4837-9ec3-07ed55474cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:04.093745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6aff5-1a87-4837-9ec3-07ed55474cdf None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.094218 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6aff5-1a87-4837-9ec3-07ed55474cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.094664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6aff5-1a87-4837-9ec3-07ed55474cdf None admin] PATH_INFO: `/v3/users/0ed7246ac8d54c7eb5473f1929379454` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.113879 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6aff5-1a87-4837-9ec3-07ed55474cdf None admin] RBAC: Authorizing `identity:get_user(user_id=0ed7246ac8d54c7eb5473f1929379454)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:04.115678 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6aff5-1a87-4837-9ec3-07ed55474cdf None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:04.117625 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 132/276] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:03 2022] GET /identity/v3/users/0ed7246ac8d54c7eb5473f1929379454 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:04.123948 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6aff5-1a87-4837-9ec3-07ed55474cdf None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:04.140571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02fe5a-f584-4385-b9c2-aa2ce71954cb None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:04.181403 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a22db4-0962-4fc1-87f2-45b496612860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:04.182200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a22db4-0962-4fc1-87f2-45b496612860 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.182480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a22db4-0962-4fc1-87f2-45b496612860 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.182747 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a22db4-0962-4fc1-87f2-45b496612860 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.184222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a22db4-0962-4fc1-87f2-45b496612860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:04.185667 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a22db4-0962-4fc1-87f2-45b496612860 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:04.191432 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 145/277] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:04.191432 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd347f5-9f5c-4f98-9a4a-91cf315f4a3e None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.191432 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd347f5-9f5c-4f98-9a4a-91cf315f4a3e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.191432 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd347f5-9f5c-4f98-9a4a-91cf315f4a3e None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.191432 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 146/278] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:04.194975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd347f5-9f5c-4f98-9a4a-91cf315f4a3e None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:04.228794 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:04.245570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6aff5-1a87-4837-9ec3-07ed55474cdf None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:04.284769 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1661a3-f807-4db1-b896-d8aec6418fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:04.285436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1661a3-f807-4db1-b896-d8aec6418fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.285729 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1661a3-f807-4db1-b896-d8aec6418fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.286009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1661a3-f807-4db1-b896-d8aec6418fb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.286850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1661a3-f807-4db1-b896-d8aec6418fb1 None admin] RBAC: Adding query filter params (role.id=5444412a1f604ebaa9282a244859c051, user.id=0ed7246ac8d54c7eb5473f1929379454, scope.system=all) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:04.287171 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1661a3-f807-4db1-b896-d8aec6418fb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:04.288733 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1661a3-f807-4db1-b896-d8aec6418fb1 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:04.294701 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 133/279] 10.222.0.40 () {56 vars in 1308 bytes} [Tue Jul 12 14:21:04 2022] GET /identity/v3/role_assignments?user.id=0ed7246ac8d54c7eb5473f1929379454&scope.system=all&role.id=5444412a1f604ebaa9282a244859c051 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:04.295957 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c7f96-ae27-438b-a3cd-e2f2bf94d3bf None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.296247 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c7f96-ae27-438b-a3cd-e2f2bf94d3bf None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.296529 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c7f96-ae27-438b-a3cd-e2f2bf94d3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.308084 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd347f5-9f5c-4f98-9a4a-91cf315f4a3e None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:04.313477 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:04.327966 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-a96c7f96-ae27-438b-a3cd-e2f2bf94d3bf None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:04.329194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-a96c7f96-ae27-438b-a3cd-e2f2bf94d3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:04.350653 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53bdf3-fb0a-422f-bfa3-56298dc24f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:04.351610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53bdf3-fb0a-422f-bfa3-56298dc24f5a None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.352247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53bdf3-fb0a-422f-bfa3-56298dc24f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.352706 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53bdf3-fb0a-422f-bfa3-56298dc24f5a None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.353604 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53bdf3-fb0a-422f-bfa3-56298dc24f5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:04.355363 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53bdf3-fb0a-422f-bfa3-56298dc24f5a None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:04.406299 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 134/280] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:04.415951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee63a03-e526-447f-9600-712019de724c None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.415951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee63a03-e526-447f-9600-712019de724c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.415951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee63a03-e526-447f-9600-712019de724c None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.415951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 135/281] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:04.415951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d7b7f-85aa-411a-86d8-ac16635978ff None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.415951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d7b7f-85aa-411a-86d8-ac16635978ff None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.416406 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d7b7f-85aa-411a-86d8-ac16635978ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.434389 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-304d7b7f-85aa-411a-86d8-ac16635978ff None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:04.435668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-304d7b7f-85aa-411a-86d8-ac16635978ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:04.470017 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 147/282] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Jul 12 14:21:04 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:21:04.480376 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53bdf3-fb0a-422f-bfa3-56298dc24f5a None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:04.513345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 136/283] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:04.535710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d7b7f-85aa-411a-86d8-ac16635978ff None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:04.629595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:04.648063 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:04.662075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53bdf3-fb0a-422f-bfa3-56298dc24f5a None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:04.682983 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d7b7f-85aa-411a-86d8-ac16635978ff None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:04.706312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e23824-9ecd-478f-a268-c72cf297809f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:04.707231 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e23824-9ecd-478f-a268-c72cf297809f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.707544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e23824-9ecd-478f-a268-c72cf297809f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.707820 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e23824-9ecd-478f-a268-c72cf297809f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.720666 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e23824-9ecd-478f-a268-c72cf297809f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:04.727877 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc789f9f-6de4-401f-9bc2-901b2e51ad1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:04.729664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc789f9f-6de4-401f-9bc2-901b2e51ad1e None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.729775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-e1e23824-9ecd-478f-a268-c72cf297809f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:04.729775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:04.729775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:04.729775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:04.729775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:04.729775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:04.729775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:04.729775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:04.729775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:04.729775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:04.729775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:04.729775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:04.729775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:04.729775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:04.729775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:04.729775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:04.730588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:04.730588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:04.730588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:04.730588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:04.730588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:04.730588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:04.730588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:04.730588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:04.730588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:04.730588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:04.730588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:04.730588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:04.730588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:04.730588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:04.730588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:04.730588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:04.731397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:04.731397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:04.731397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:04.731397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:04.731397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:04.731397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:04.731397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:04.731397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:04.731397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:04.731397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:04.731397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:04.731397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:04.731397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 148/284] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:04.732030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc789f9f-6de4-401f-9bc2-901b2e51ad1e None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.732030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc789f9f-6de4-401f-9bc2-901b2e51ad1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.739164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e23824-9ecd-478f-a268-c72cf297809f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:04.752804 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc789f9f-6de4-401f-9bc2-901b2e51ad1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:04.762576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-bc789f9f-6de4-401f-9bc2-901b2e51ad1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:21:04.762576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:04.762576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:04.762576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:04.762576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:04.762576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:04.762576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:04.762576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:04.762576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:04.762576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:04.762576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:04.762576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:04.762576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:04.762576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:04.762576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:04.762576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:04.763576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:04.763576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:04.763576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:04.763576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:04.763576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:04.763576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:04.763576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:04.763576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:04.763576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:04.763576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:04.763576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:04.763576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:04.763576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:04.763576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:04.763576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:04.763576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:04.764345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:04.764345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:04.764345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:04.764345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:04.764345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:04.764345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:04.764345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:04.764345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:04.764345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:04.764345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:04.764345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:21:04.764345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:04.764345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 137/285] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:04.771476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc789f9f-6de4-401f-9bc2-901b2e51ad1e None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:04.886771 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e23824-9ecd-478f-a268-c72cf297809f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:04.907790 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc789f9f-6de4-401f-9bc2-901b2e51ad1e None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:04.932763 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d346ba-ba2d-444a-a2c1-437e27d80803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:04.933448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d346ba-ba2d-444a-a2c1-437e27d80803 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.933734 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d346ba-ba2d-444a-a2c1-437e27d80803 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.934016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d346ba-ba2d-444a-a2c1-437e27d80803 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.935085 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d346ba-ba2d-444a-a2c1-437e27d80803 None admin] RBAC: Adding query filter params (name=member) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:04.935085 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d346ba-ba2d-444a-a2c1-437e27d80803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:04.937191 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d346ba-ba2d-444a-a2c1-437e27d80803 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:04.941032 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:04.950474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 149/286] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:21:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:04.955717 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d346ba-ba2d-444a-a2c1-437e27d80803 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:04.961613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a088129-c916-419f-aeda-0c0dca81cbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:04.962646 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a088129-c916-419f-aeda-0c0dca81cbae None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:04.963133 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a088129-c916-419f-aeda-0c0dca81cbae None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:04.963633 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a088129-c916-419f-aeda-0c0dca81cbae None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:04.964606 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a088129-c916-419f-aeda-0c0dca81cbae None admin] RBAC: Adding query filter params (name=reader) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:04.965134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a088129-c916-419f-aeda-0c0dca81cbae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:04.971987 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a088129-c916-419f-aeda-0c0dca81cbae None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:04.981628 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:04.985182 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 138/287] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:21:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:04.991237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a088129-c916-419f-aeda-0c0dca81cbae None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:05.128874 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a088129-c916-419f-aeda-0c0dca81cbae None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:05.169127 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6c13a-a090-447e-b177-263e6c93b5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:05.170572 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6c13a-a090-447e-b177-263e6c93b5ee None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:05.171036 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6c13a-a090-447e-b177-263e6c93b5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:05.171530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6c13a-a090-447e-b177-263e6c93b5ee None admin] PATH_INFO: `/v3/users/b1e77579c0b64edcadea6c90fcc5b24c` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:05.172929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6c13a-a090-447e-b177-263e6c93b5ee None admin] RBAC: Authorizing `identity:get_user(user_id=b1e77579c0b64edcadea6c90fcc5b24c)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:05.174586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6c13a-a090-447e-b177-263e6c93b5ee None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:05.177345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 139/288] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:04 2022] GET /identity/v3/users/b1e77579c0b64edcadea6c90fcc5b24c => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:05.183985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6c13a-a090-447e-b177-263e6c93b5ee None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:05.195016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d346ba-ba2d-444a-a2c1-437e27d80803 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:05.274053 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af31df9-2e15-411e-af2c-e85d224dac04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:05.274944 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af31df9-2e15-411e-af2c-e85d224dac04 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:05.275229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af31df9-2e15-411e-af2c-e85d224dac04 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:05.275535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af31df9-2e15-411e-af2c-e85d224dac04 None admin] PATH_INFO: `/v3/users/17f9e149bf3047e8a39808a8d689ac0a` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:05.276774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af31df9-2e15-411e-af2c-e85d224dac04 None admin] RBAC: Authorizing `identity:get_user(user_id=17f9e149bf3047e8a39808a8d689ac0a)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:05.278262 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af31df9-2e15-411e-af2c-e85d224dac04 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:05.280197 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 150/289] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:04 2022] GET /identity/v3/users/17f9e149bf3047e8a39808a8d689ac0a => generated 297 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:05.280489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:05.288525 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af31df9-2e15-411e-af2c-e85d224dac04 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:05.333288 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6c13a-a090-447e-b177-263e6c93b5ee None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:05.373492 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c358c-faa0-41d7-9840-24123180ebd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:05.374371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c358c-faa0-41d7-9840-24123180ebd5 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:05.374658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c358c-faa0-41d7-9840-24123180ebd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:05.374938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c358c-faa0-41d7-9840-24123180ebd5 None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:05.376193 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c358c-faa0-41d7-9840-24123180ebd5 None admin] RBAC: Authorizing `identity:get_project(project_id=a67548b777b24c2d88cd5789350f5c35)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:05.377640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c358c-faa0-41d7-9840-24123180ebd5 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:05.379776 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 140/290] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:05 2022] GET /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:05.388382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c358c-faa0-41d7-9840-24123180ebd5 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:05.459722 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:05.466842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af31df9-2e15-411e-af2c-e85d224dac04 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:05.502643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285f63c-588a-49fa-8783-3c425acdb9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:05.503328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285f63c-588a-49fa-8783-3c425acdb9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:05.503627 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285f63c-588a-49fa-8783-3c425acdb9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:05.503913 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285f63c-588a-49fa-8783-3c425acdb9e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:05.581992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285f63c-588a-49fa-8783-3c425acdb9e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:05.583523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285f63c-588a-49fa-8783-3c425acdb9e7 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:05.667749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:05.696323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 151/291] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:05.698103 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285f63c-588a-49fa-8783-3c425acdb9e7 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:05.749283 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c358c-faa0-41d7-9840-24123180ebd5 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:05.804243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285f63c-588a-49fa-8783-3c425acdb9e7 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:05.828712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:05.841781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134aeaab-78c3-4834-9ba5-1f0fa096b2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:05.842651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134aeaab-78c3-4834-9ba5-1f0fa096b2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:05.842933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134aeaab-78c3-4834-9ba5-1f0fa096b2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:05.843212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134aeaab-78c3-4834-9ba5-1f0fa096b2c8 None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:05.844580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134aeaab-78c3-4834-9ba5-1f0fa096b2c8 None admin] RBAC: Authorizing `identity:get_project(project_id=a67548b777b24c2d88cd5789350f5c35)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:05.848297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134aeaab-78c3-4834-9ba5-1f0fa096b2c8 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:05.848493 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 152/292] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:05 2022] GET /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:05.854642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134aeaab-78c3-4834-9ba5-1f0fa096b2c8 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:05.904322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:05.907980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a737a-daac-4da3-b5bc-d95393310362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:05.908900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a737a-daac-4da3-b5bc-d95393310362 None admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:05.909183 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a737a-daac-4da3-b5bc-d95393310362 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:05.909456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a737a-daac-4da3-b5bc-d95393310362 None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35/users/b1e77579c0b64edcadea6c90fcc5b24c/roles/91418844a31b44b885804c221d52c38b` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:05.912619 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a737a-daac-4da3-b5bc-d95393310362 None admin] RBAC: Authorizing `identity:create_grant(project_id=a67548b777b24c2d88cd5789350f5c35, user_id=b1e77579c0b64edcadea6c90fcc5b24c, role_id=91418844a31b44b885804c221d52c38b)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:05.914075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a737a-daac-4da3-b5bc-d95393310362 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:05.959108 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134aeaab-78c3-4834-9ba5-1f0fa096b2c8 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:05.995831 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d45e5-5e00-4006-9942-0de7c5132dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:05.996497 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d45e5-5e00-4006-9942-0de7c5132dfe None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:05.996782 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d45e5-5e00-4006-9942-0de7c5132dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:05.997058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d45e5-5e00-4006-9942-0de7c5132dfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:05.998000 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d45e5-5e00-4006-9942-0de7c5132dfe None admin] RBAC: Adding query filter params (role.id=5444412a1f604ebaa9282a244859c051, scope.project.id=a67548b777b24c2d88cd5789350f5c35, user.id=17f9e149bf3047e8a39808a8d689ac0a) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:05.998321 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d45e5-5e00-4006-9942-0de7c5132dfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:05.999856 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d45e5-5e00-4006-9942-0de7c5132dfe None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:06.006689 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 153/293] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:05 2022] GET /identity/v3/role_assignments?user.id=17f9e149bf3047e8a39808a8d689ac0a&scope.project.id=a67548b777b24c2d88cd5789350f5c35&role.id=5444412a1f604ebaa9282a244859c051 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:06.027091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 141/294] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:21:05 2022] PUT /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35/users/b1e77579c0b64edcadea6c90fcc5b24c/roles/91418844a31b44b885804c221d52c38b => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:21:06.532510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19d117-5068-499c-b22a-83e1a244453e None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:06.533248 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19d117-5068-499c-b22a-83e1a244453e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:06.533248 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19d117-5068-499c-b22a-83e1a244453e None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:06.534563 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 154/295] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:06.540809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994035cf-af5a-462a-b9b2-c759af120c18 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:06.541368 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994035cf-af5a-462a-b9b2-c759af120c18 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:06.541858 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994035cf-af5a-462a-b9b2-c759af120c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:06.560287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-994035cf-af5a-462a-b9b2-c759af120c18 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:06.561833 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-994035cf-af5a-462a-b9b2-c759af120c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:06.635183 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 142/296] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:06.658438 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19d117-5068-499c-b22a-83e1a244453e None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:06.765431 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19d117-5068-499c-b22a-83e1a244453e None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:06.777364 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:06.801588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048b02f-1ce9-45d4-ad77-58e40b67d070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:06.802312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048b02f-1ce9-45d4-ad77-58e40b67d070 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:06.802598 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048b02f-1ce9-45d4-ad77-58e40b67d070 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:06.802878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048b02f-1ce9-45d4-ad77-58e40b67d070 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:06.814239 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048b02f-1ce9-45d4-ad77-58e40b67d070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:06.823461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-2048b02f-1ce9-45d4-ad77-58e40b67d070 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:06.823461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:06.823461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:06.823461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:06.823461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:06.823461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:06.823461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:06.823461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:06.823461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:06.823461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:06.823461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:06.823461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:06.823461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:06.823461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:06.823461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:06.823461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:06.824347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:06.824347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:06.824347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:06.824347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:06.824347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:06.824347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:06.824347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:06.824347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:06.824347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:06.824347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:06.824347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:06.824347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:06.824347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:06.824347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:06.824347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:06.824347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:06.825127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:06.825127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:06.825127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:06.825127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:06.825127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:06.825127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:06.825127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:06.825127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:06.825127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:06.825127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:06.825127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:06.825127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:06.825127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 155/297] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:06.830649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994035cf-af5a-462a-b9b2-c759af120c18 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:06.938080 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994035cf-af5a-462a-b9b2-c759af120c18 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:06.952882 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:06.975512 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa2173-67d8-4787-a3d0-36cae6e49ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:06.976198 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa2173-67d8-4787-a3d0-36cae6e49ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:06.976486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa2173-67d8-4787-a3d0-36cae6e49ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:06.976866 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa2173-67d8-4787-a3d0-36cae6e49ef8 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:06.978209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa2173-67d8-4787-a3d0-36cae6e49ef8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:06.978519 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa2173-67d8-4787-a3d0-36cae6e49ef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:06.979935 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa2173-67d8-4787-a3d0-36cae6e49ef8 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:06.992958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 143/298] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:21:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:06.995499 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048b02f-1ce9-45d4-ad77-58e40b67d070 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:07.056246 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189b37f-54df-49f3-a620-4a06e64d14b0 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:07.056864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189b37f-54df-49f3-a620-4a06e64d14b0 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:07.057364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189b37f-54df-49f3-a620-4a06e64d14b0 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:07.058980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 144/299] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:07.067701 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a2b51-e8ba-4111-bc8b-31d4c3f41148 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:07.068234 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a2b51-e8ba-4111-bc8b-31d4c3f41148 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:07.068712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a2b51-e8ba-4111-bc8b-31d4c3f41148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:07.091809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-347a2b51-e8ba-4111-bc8b-31d4c3f41148 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:07.093413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-347a2b51-e8ba-4111-bc8b-31d4c3f41148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:07.107723 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048b02f-1ce9-45d4-ad77-58e40b67d070 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:07.145061 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce359bc8-696f-485a-ab8a-b9a1bc6f50cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:07.145942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce359bc8-696f-485a-ab8a-b9a1bc6f50cc None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:07.146231 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce359bc8-696f-485a-ab8a-b9a1bc6f50cc None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:07.146510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce359bc8-696f-485a-ab8a-b9a1bc6f50cc None admin] PATH_INFO: `/v3/users/0ed7246ac8d54c7eb5473f1929379454` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:07.147944 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce359bc8-696f-485a-ab8a-b9a1bc6f50cc None admin] RBAC: Authorizing `identity:get_user(user_id=0ed7246ac8d54c7eb5473f1929379454)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:07.149839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce359bc8-696f-485a-ab8a-b9a1bc6f50cc None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:07.151697 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 156/300] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:06 2022] GET /identity/v3/users/0ed7246ac8d54c7eb5473f1929379454 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:07.157288 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc8b44-41f6-4287-9eac-ba846021a2eb None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:07.157609 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc8b44-41f6-4287-9eac-ba846021a2eb None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:07.157861 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc8b44-41f6-4287-9eac-ba846021a2eb None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:07.159297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 157/301] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:07.159863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc8b44-41f6-4287-9eac-ba846021a2eb None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:07.174427 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 145/302] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:07.176122 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb186b-2c53-4c6a-80ec-1f5591fb389a None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:07.176607 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb186b-2c53-4c6a-80ec-1f5591fb389a None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:07.177075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb186b-2c53-4c6a-80ec-1f5591fb389a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:07.203937 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-5beb186b-2c53-4c6a-80ec-1f5591fb389a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:07.204541 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:07.205535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5beb186b-2c53-4c6a-80ec-1f5591fb389a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:07.276273 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc8b44-41f6-4287-9eac-ba846021a2eb None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:07.277622 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 146/303] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:07.278685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb186b-2c53-4c6a-80ec-1f5591fb389a None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:07.322048 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:07.322538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2ac76-fc2c-4e5e-9c96-0c02034b9704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:07.323443 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2ac76-fc2c-4e5e-9c96-0c02034b9704 None admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:07.323726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2ac76-fc2c-4e5e-9c96-0c02034b9704 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:07.323996 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2ac76-fc2c-4e5e-9c96-0c02034b9704 None admin] PATH_INFO: `/v3/system/users/0ed7246ac8d54c7eb5473f1929379454/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:07.325817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2ac76-fc2c-4e5e-9c96-0c02034b9704 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0ed7246ac8d54c7eb5473f1929379454, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:07.327434 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2ac76-fc2c-4e5e-9c96-0c02034b9704 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:07.390727 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb186b-2c53-4c6a-80ec-1f5591fb389a None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:07.424477 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d27a7-f444-4a1b-907d-9ca36b4dee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:07.425263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d27a7-f444-4a1b-907d-9ca36b4dee26 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:07.425541 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d27a7-f444-4a1b-907d-9ca36b4dee26 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:07.425810 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d27a7-f444-4a1b-907d-9ca36b4dee26 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:07.437279 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d27a7-f444-4a1b-907d-9ca36b4dee26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:07.439594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 158/304] 10.222.0.40 () {58 vars in 1334 bytes} [Tue Jul 12 14:21:07 2022] PUT /identity/v3/system/users/0ed7246ac8d54c7eb5473f1929379454/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:21:07.440621 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2ac76-fc2c-4e5e-9c96-0c02034b9704 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:07.445284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-5c0d27a7-f444-4a1b-907d-9ca36b4dee26 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:21:07.445284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:07.445284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:07.445284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:07.445284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:07.445284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:07.445284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:07.445284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:07.445284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:07.445284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:07.445284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:07.445284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:07.445284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:07.445284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:07.445284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:07.445284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:07.446890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:07.446890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:07.446890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:07.446890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:07.446890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:07.446890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:07.446890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:07.446890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:07.446890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:07.446890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:07.446890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:07.446890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:07.446890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:07.446890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:07.446890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:07.446890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:07.447698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:07.447698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:07.447698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:07.447698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:07.447698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:07.447698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:07.447698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:07.447698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:07.447698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:07.447698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:07.447698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:21:07.447698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:07.447698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 147/305] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:07.454999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d27a7-f444-4a1b-907d-9ca36b4dee26 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:07.583841 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2ac76-fc2c-4e5e-9c96-0c02034b9704 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:07.585616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:07.598062 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:07.606706 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d27a7-f444-4a1b-907d-9ca36b4dee26 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:07.637708 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d052b-555e-4843-b5c4-9a11060ee062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:07.638509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d052b-555e-4843-b5c4-9a11060ee062 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:07.638793 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d052b-555e-4843-b5c4-9a11060ee062 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:07.639068 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d052b-555e-4843-b5c4-9a11060ee062 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:07.640446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d052b-555e-4843-b5c4-9a11060ee062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:07.641884 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d052b-555e-4843-b5c4-9a11060ee062 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:07.643558 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 159/306] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:07.649861 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d052b-555e-4843-b5c4-9a11060ee062 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:07.652105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d2112-1295-415b-a2bb-00c503958ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:07.652793 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d2112-1295-415b-a2bb-00c503958ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:07.653272 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d2112-1295-415b-a2bb-00c503958ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:07.653556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d2112-1295-415b-a2bb-00c503958ec0 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:07.655218 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d2112-1295-415b-a2bb-00c503958ec0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:07.655570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d2112-1295-415b-a2bb-00c503958ec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:07.656964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d2112-1295-415b-a2bb-00c503958ec0 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:07.669601 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 148/307] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:21:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:07.675495 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d2112-1295-415b-a2bb-00c503958ec0 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:07.785548 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d052b-555e-4843-b5c4-9a11060ee062 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:07.794467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d2112-1295-415b-a2bb-00c503958ec0 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:07.833639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755d581-7dd7-4805-a676-6294300f181d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:07.834368 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755d581-7dd7-4805-a676-6294300f181d None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:07.834599 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755d581-7dd7-4805-a676-6294300f181d None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:07.834881 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755d581-7dd7-4805-a676-6294300f181d None admin] PATH_INFO: `/v3/groups` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:07.835689 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755d581-7dd7-4805-a676-6294300f181d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:07.836081 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fc44f-220e-45c4-be09-7e04f097c845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:07.837088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fc44f-220e-45c4-be09-7e04f097c845 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:07.837185 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755d581-7dd7-4805-a676-6294300f181d None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:07.837371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fc44f-220e-45c4-be09-7e04f097c845 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:07.837648 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fc44f-220e-45c4-be09-7e04f097c845 None admin] PATH_INFO: `/v3/users/7b44626818d14b1da90b2504e357592d` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:07.853028 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fc44f-220e-45c4-be09-7e04f097c845 None admin] RBAC: Authorizing `identity:get_user(user_id=7b44626818d14b1da90b2504e357592d)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:07.854551 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fc44f-220e-45c4-be09-7e04f097c845 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:07.859321 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 149/308] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:07 2022] GET /identity/v3/users/7b44626818d14b1da90b2504e357592d => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:07.862079 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fc44f-220e-45c4-be09-7e04f097c845 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:07.880349 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:07.909856 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 160/309] 10.222.0.40 () {60 vars in 1134 bytes} [Tue Jul 12 14:21:07 2022] POST /identity/v3/groups => generated 229 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:21:07.990270 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fc44f-220e-45c4-be09-7e04f097c845 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:08.037539 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc72e24-6b44-404e-89b8-dfc330453428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:08.038226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc72e24-6b44-404e-89b8-dfc330453428 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:08.038515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc72e24-6b44-404e-89b8-dfc330453428 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:08.038797 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc72e24-6b44-404e-89b8-dfc330453428 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:08.040234 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc72e24-6b44-404e-89b8-dfc330453428 None admin] RBAC: Adding query filter params (role.id=91418844a31b44b885804c221d52c38b, user.id=7b44626818d14b1da90b2504e357592d, scope.system=all) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:08.040559 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc72e24-6b44-404e-89b8-dfc330453428 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:08.042041 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc72e24-6b44-404e-89b8-dfc330453428 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:08.048245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 150/310] 10.222.0.40 () {56 vars in 1308 bytes} [Tue Jul 12 14:21:07 2022] GET /identity/v3/role_assignments?user.id=7b44626818d14b1da90b2504e357592d&scope.system=all&role.id=91418844a31b44b885804c221d52c38b => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:08.292051 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd48ea-bd0f-4b65-bd7e-5fcf6b989946 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:08.292371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd48ea-bd0f-4b65-bd7e-5fcf6b989946 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:08.292615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd48ea-bd0f-4b65-bd7e-5fcf6b989946 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:08.294270 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 161/311] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:08.299560 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad4e24-2a41-4323-9bf8-f1eee40bc3bd None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:08.299857 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad4e24-2a41-4323-9bf8-f1eee40bc3bd None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:08.300144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad4e24-2a41-4323-9bf8-f1eee40bc3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:08.317364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-0fad4e24-2a41-4323-9bf8-f1eee40bc3bd None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:08.318566 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0fad4e24-2a41-4323-9bf8-f1eee40bc3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:08.389361 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 151/312] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:08.413460 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd48ea-bd0f-4b65-bd7e-5fcf6b989946 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:08.451868 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:08.528262 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd48ea-bd0f-4b65-bd7e-5fcf6b989946 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:08.564881 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9e028-f0f0-4c0e-b65e-acf675655cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:08.565714 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9e028-f0f0-4c0e-b65e-acf675655cbf None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:08.566198 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9e028-f0f0-4c0e-b65e-acf675655cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:08.566473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9e028-f0f0-4c0e-b65e-acf675655cbf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:08.577540 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9e028-f0f0-4c0e-b65e-acf675655cbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:08.585597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-aff9e028-f0f0-4c0e-b65e-acf675655cbf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:21:08.585597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:08.585597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:08.585597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:08.585597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:08.585597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:08.585597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:08.585597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:08.585597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:08.585597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:08.585597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:08.585597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:08.585597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:08.585597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:08.585597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:08.585597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:08.586969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:08.586969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:08.586969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:08.586969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:08.586969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:08.586969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:08.586969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:08.586969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:08.586969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:08.586969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:08.586969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:08.586969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:08.586969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:08.586969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:08.586969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:08.586969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:08.588420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:08.588420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:08.588420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:08.588420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:08.588420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:08.588420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:08.588420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:08.588420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:08.588420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:08.588420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:08.588420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:21:08.588420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:08.588420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 162/313] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:08.593479 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad4e24-2a41-4323-9bf8-f1eee40bc3bd None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:08.604232 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:08.702012 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad4e24-2a41-4323-9bf8-f1eee40bc3bd None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:08.739250 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20211aed-e677-48d2-8d5c-97485bcf39f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:08.739960 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20211aed-e677-48d2-8d5c-97485bcf39f1 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:08.740250 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20211aed-e677-48d2-8d5c-97485bcf39f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:08.740534 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20211aed-e677-48d2-8d5c-97485bcf39f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:08.741297 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20211aed-e677-48d2-8d5c-97485bcf39f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:08.741609 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20211aed-e677-48d2-8d5c-97485bcf39f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:08.743376 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20211aed-e677-48d2-8d5c-97485bcf39f1 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:08.753183 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 152/314] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:21:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:08.759347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9e028-f0f0-4c0e-b65e-acf675655cbf None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:08.857235 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:08.867350 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9e028-f0f0-4c0e-b65e-acf675655cbf None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:08.903907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e97b69-85e7-4a01-8737-df47914f0917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:08.904830 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e97b69-85e7-4a01-8737-df47914f0917 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:08.905111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e97b69-85e7-4a01-8737-df47914f0917 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:08.905429 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e97b69-85e7-4a01-8737-df47914f0917 None admin] PATH_INFO: `/v3/users/b1e77579c0b64edcadea6c90fcc5b24c` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:08.906625 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e97b69-85e7-4a01-8737-df47914f0917 None admin] RBAC: Authorizing `identity:get_user(user_id=b1e77579c0b64edcadea6c90fcc5b24c)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:08.908082 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e97b69-85e7-4a01-8737-df47914f0917 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:08.909999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 163/315] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:08 2022] GET /identity/v3/users/b1e77579c0b64edcadea6c90fcc5b24c => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:08.915874 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20211aed-e677-48d2-8d5c-97485bcf39f1 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:08.993779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:09.027479 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20211aed-e677-48d2-8d5c-97485bcf39f1 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:09.064185 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf1856-7923-4206-a720-4cad3f1c2800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:09.064853 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1856-7923-4206-a720-4cad3f1c2800 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:09.065142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1856-7923-4206-a720-4cad3f1c2800 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:09.065422 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1856-7923-4206-a720-4cad3f1c2800 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:09.140043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf1856-7923-4206-a720-4cad3f1c2800 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:09.141518 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf1856-7923-4206-a720-4cad3f1c2800 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:09.219673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:09.249201 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 153/316] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:09.256288 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e97b69-85e7-4a01-8737-df47914f0917 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:09.359574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e97b69-85e7-4a01-8737-df47914f0917 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:09.394328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836793b4-f2d5-429b-b321-2a4b0242bbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:09.395511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836793b4-f2d5-429b-b321-2a4b0242bbba None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:09.395987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836793b4-f2d5-429b-b321-2a4b0242bbba None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:09.396453 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836793b4-f2d5-429b-b321-2a4b0242bbba None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:09.397822 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836793b4-f2d5-429b-b321-2a4b0242bbba None admin] RBAC: Authorizing `identity:get_project(project_id=a67548b777b24c2d88cd5789350f5c35)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:09.400103 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836793b4-f2d5-429b-b321-2a4b0242bbba None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:09.402318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 164/317] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:09 2022] GET /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:09.408284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf1856-7923-4206-a720-4cad3f1c2800 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:09.512663 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf1856-7923-4206-a720-4cad3f1c2800 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:09.548460 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae053724-aeb2-4fe4-be0b-c4e9fa388489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:09.549492 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae053724-aeb2-4fe4-be0b-c4e9fa388489 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:09.549967 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae053724-aeb2-4fe4-be0b-c4e9fa388489 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:09.550435 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae053724-aeb2-4fe4-be0b-c4e9fa388489 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:09.551500 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae053724-aeb2-4fe4-be0b-c4e9fa388489 None admin] RBAC: Adding query filter params (role.id=91418844a31b44b885804c221d52c38b, scope.project.id=a67548b777b24c2d88cd5789350f5c35, user.id=b1e77579c0b64edcadea6c90fcc5b24c) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:09.552022 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae053724-aeb2-4fe4-be0b-c4e9fa388489 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:09.553655 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae053724-aeb2-4fe4-be0b-c4e9fa388489 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:09.561209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 154/318] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:09 2022] GET /identity/v3/role_assignments?user.id=b1e77579c0b64edcadea6c90fcc5b24c&scope.project.id=a67548b777b24c2d88cd5789350f5c35&role.id=91418844a31b44b885804c221d52c38b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:09.719266 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196867f-0e24-4d32-855a-1d7443397db4 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:09.719777 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196867f-0e24-4d32-855a-1d7443397db4 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:09.719777 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196867f-0e24-4d32-855a-1d7443397db4 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:09.721298 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 165/319] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:09.727174 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afd8ad-5f08-4f30-925d-3fe425002ed1 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:09.727635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afd8ad-5f08-4f30-925d-3fe425002ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:09.727914 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afd8ad-5f08-4f30-925d-3fe425002ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:09.746148 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-31afd8ad-5f08-4f30-925d-3fe425002ed1 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:09.747382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-31afd8ad-5f08-4f30-925d-3fe425002ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:09.775876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:09.823867 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 155/320] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:09.849098 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196867f-0e24-4d32-855a-1d7443397db4 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:09.879171 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:09.955496 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196867f-0e24-4d32-855a-1d7443397db4 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:09.990073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413fc6d-81cd-409d-89c9-3deeb468e7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:09.990842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413fc6d-81cd-409d-89c9-3deeb468e7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:09.991125 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413fc6d-81cd-409d-89c9-3deeb468e7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:09.991472 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413fc6d-81cd-409d-89c9-3deeb468e7f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.002144 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413fc6d-81cd-409d-89c9-3deeb468e7f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:10.010129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-8413fc6d-81cd-409d-89c9-3deeb468e7f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:10.010129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:10.010129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:10.010129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:10.010129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:10.010129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:10.010129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:10.010129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:10.010129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:10.010129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:10.010129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:10.010129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:10.010129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:10.010129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:10.010129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:10.010129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:10.010975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:10.010975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:10.010975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:10.010975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:10.010975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:10.010975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:10.010975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:10.010975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:10.010975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:10.010975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:10.010975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:10.010975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:10.010975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:10.010975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:10.010975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:10.010975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:10.011799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:10.011799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:10.011799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:10.011799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:10.011799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:10.011799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:10.011799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:10.011799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:10.011799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:10.011799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:10.011799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:10.011799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:10.011799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 166/321] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:10.017287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afd8ad-5f08-4f30-925d-3fe425002ed1 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:10.053463 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73cd3d-d4e2-44f5-8726-51e958ea552e None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.053795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73cd3d-d4e2-44f5-8726-51e958ea552e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.054018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73cd3d-d4e2-44f5-8726-51e958ea552e None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.056193 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 167/322] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:21:10.060922 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8403d5-2428-4c11-b78d-4125d9234210 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.061265 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8403d5-2428-4c11-b78d-4125d9234210 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.061545 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8403d5-2428-4c11-b78d-4125d9234210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.079962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-9d8403d5-2428-4c11-b78d-4125d9234210 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:10.081399 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-9d8403d5-2428-4c11-b78d-4125d9234210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:10.121577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afd8ad-5f08-4f30-925d-3fe425002ed1 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:10.155020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 168/323] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:21:10.161727 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a3fd8-c455-4332-a0f7-80af6f5889d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:10.162432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a3fd8-c455-4332-a0f7-80af6f5889d6 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.162715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a3fd8-c455-4332-a0f7-80af6f5889d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.162986 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a3fd8-c455-4332-a0f7-80af6f5889d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.163767 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a3fd8-c455-4332-a0f7-80af6f5889d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:10.164196 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a3fd8-c455-4332-a0f7-80af6f5889d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:10.166148 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a3fd8-c455-4332-a0f7-80af6f5889d6 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:10.179169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 156/324] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:21:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:10.179365 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8403d5-2428-4c11-b78d-4125d9234210 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:10.181628 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a3fd8-c455-4332-a0f7-80af6f5889d6 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:10.194853 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:10.213993 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:10.283982 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8403d5-2428-4c11-b78d-4125d9234210 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:10.291803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a3fd8-c455-4332-a0f7-80af6f5889d6 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:10.318492 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1d68d-c323-4acd-84d3-34af39ee2933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:10.319302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1d68d-c323-4acd-84d3-34af39ee2933 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.319601 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1d68d-c323-4acd-84d3-34af39ee2933 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.319875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1d68d-c323-4acd-84d3-34af39ee2933 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.321742 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1d68d-c323-4acd-84d3-34af39ee2933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:10.323189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1d68d-c323-4acd-84d3-34af39ee2933 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:10.325007 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38bae3-890e-461b-aab0-e34956358301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:10.325129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 169/325] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:10.325633 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38bae3-890e-461b-aab0-e34956358301 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.325915 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38bae3-890e-461b-aab0-e34956358301 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.326211 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587540b0-1597-4ffb-b846-1b6be47a43e3 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.326316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38bae3-890e-461b-aab0-e34956358301 None admin] PATH_INFO: `/v3/users/0ed7246ac8d54c7eb5473f1929379454` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.326500 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587540b0-1597-4ffb-b846-1b6be47a43e3 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.326782 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587540b0-1597-4ffb-b846-1b6be47a43e3 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.327446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38bae3-890e-461b-aab0-e34956358301 None admin] RBAC: Authorizing `identity:get_user(user_id=0ed7246ac8d54c7eb5473f1929379454)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:10.328139 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 170/326] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:10.328861 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38bae3-890e-461b-aab0-e34956358301 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:10.335020 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 157/327] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:10 2022] GET /identity/v3/users/0ed7246ac8d54c7eb5473f1929379454 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:10.335153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587540b0-1597-4ffb-b846-1b6be47a43e3 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:10.335243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9094cb9-dc97-47d7-8a1b-f9387dd229f3 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.335243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9094cb9-dc97-47d7-8a1b-f9387dd229f3 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.335243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9094cb9-dc97-47d7-8a1b-f9387dd229f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.350954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-d9094cb9-dc97-47d7-8a1b-f9387dd229f3 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:10.352200 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-d9094cb9-dc97-47d7-8a1b-f9387dd229f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:10.417814 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 158/328] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:21:10.418375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:10.418645 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9094cb9-dc97-47d7-8a1b-f9387dd229f3 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:10.439984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587540b0-1597-4ffb-b846-1b6be47a43e3 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:10.448642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:10.475932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d2b1a-2316-4e31-a3d7-907137b19494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:10.476724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d2b1a-2316-4e31-a3d7-907137b19494 None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.477114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d2b1a-2316-4e31-a3d7-907137b19494 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.477394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d2b1a-2316-4e31-a3d7-907137b19494 None admin] PATH_INFO: `/v3/groups` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.478085 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d2b1a-2316-4e31-a3d7-907137b19494 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:10.479569 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d2b1a-2316-4e31-a3d7-907137b19494 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:10.522448 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9094cb9-dc97-47d7-8a1b-f9387dd229f3 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:10.553953 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 171/329] 10.222.0.40 () {60 vars in 1134 bytes} [Tue Jul 12 14:21:10 2022] POST /identity/v3/groups => generated 226 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:21:10.555062 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d2b1a-2316-4e31-a3d7-907137b19494 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:10.566047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4974f4-72f2-4cb8-9f0e-500cdedeaa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:10.566734 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4974f4-72f2-4cb8-9f0e-500cdedeaa15 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.567021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4974f4-72f2-4cb8-9f0e-500cdedeaa15 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.567320 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4974f4-72f2-4cb8-9f0e-500cdedeaa15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.568190 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4974f4-72f2-4cb8-9f0e-500cdedeaa15 None admin] RBAC: Adding query filter params (role.id=5444412a1f604ebaa9282a244859c051, user.id=0ed7246ac8d54c7eb5473f1929379454, scope.system=all) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:10.568501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4974f4-72f2-4cb8-9f0e-500cdedeaa15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:10.570109 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4974f4-72f2-4cb8-9f0e-500cdedeaa15 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:10.584604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 159/330] 10.222.0.40 () {56 vars in 1308 bytes} [Tue Jul 12 14:21:10 2022] GET /identity/v3/role_assignments?user.id=0ed7246ac8d54c7eb5473f1929379454&scope.system=all&role.id=5444412a1f604ebaa9282a244859c051 => generated 510 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:10.698503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d2b1a-2316-4e31-a3d7-907137b19494 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:10.745755 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3d287-de22-44fa-bf5b-5f5c511ceda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:10.746574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3d287-de22-44fa-bf5b-5f5c511ceda0 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.746884 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3d287-de22-44fa-bf5b-5f5c511ceda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.747161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3d287-de22-44fa-bf5b-5f5c511ceda0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.760290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3d287-de22-44fa-bf5b-5f5c511ceda0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:10.768296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-02e3d287-de22-44fa-bf5b-5f5c511ceda0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:21:10.768296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:10.768296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:10.768296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:10.768296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:10.768296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:10.768296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:10.768296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:10.768296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:10.768296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:10.768296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:10.768296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:10.768296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:10.768296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:10.768296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:10.768296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:10.769218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:10.769218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:10.769218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:10.769218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:10.769218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:10.769218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:10.769218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:10.769218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:10.769218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:10.769218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:10.769218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:10.769218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:10.769218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:10.769218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:10.769218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:10.769218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:10.769998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:10.769998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:10.769998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:10.769998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:10.769998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:10.769998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:10.769998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:10.769998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:10.769998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:10.769998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:10.769998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:21:10.769998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:10.769998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 172/331] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:10.776248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4974f4-72f2-4cb8-9f0e-500cdedeaa15 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:10.875830 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:10.896153 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4974f4-72f2-4cb8-9f0e-500cdedeaa15 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:10.933701 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878aafbd-8f5d-45f6-ba03-ecc984a52cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:10.934401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878aafbd-8f5d-45f6-ba03-ecc984a52cdb None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:10.934688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878aafbd-8f5d-45f6-ba03-ecc984a52cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:10.934974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878aafbd-8f5d-45f6-ba03-ecc984a52cdb None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:10.935802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878aafbd-8f5d-45f6-ba03-ecc984a52cdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:10.936097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878aafbd-8f5d-45f6-ba03-ecc984a52cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:10.937490 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878aafbd-8f5d-45f6-ba03-ecc984a52cdb None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:10.947864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 160/332] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:21:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:10.953107 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3d287-de22-44fa-bf5b-5f5c511ceda0 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:10.957229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:11.070142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3d287-de22-44fa-bf5b-5f5c511ceda0 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:11.106416 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb712ea4-7332-4312-b347-ec390253f9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:11.107317 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb712ea4-7332-4312-b347-ec390253f9cc None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:11.107609 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb712ea4-7332-4312-b347-ec390253f9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:11.107885 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb712ea4-7332-4312-b347-ec390253f9cc None admin] PATH_INFO: `/v3/users/7b44626818d14b1da90b2504e357592d` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:11.109253 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb712ea4-7332-4312-b347-ec390253f9cc None admin] RBAC: Authorizing `identity:get_user(user_id=7b44626818d14b1da90b2504e357592d)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:11.111033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb712ea4-7332-4312-b347-ec390253f9cc None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:11.112914 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 173/333] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:10 2022] GET /identity/v3/users/7b44626818d14b1da90b2504e357592d => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:11.119095 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878aafbd-8f5d-45f6-ba03-ecc984a52cdb None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:11.241837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878aafbd-8f5d-45f6-ba03-ecc984a52cdb None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:11.277144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76d87e-6a21-42d6-bab2-5b08db1fd0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:11.278082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76d87e-6a21-42d6-bab2-5b08db1fd0c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:11.278423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76d87e-6a21-42d6-bab2-5b08db1fd0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:11.278654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76d87e-6a21-42d6-bab2-5b08db1fd0c1 None admin] PATH_INFO: `/v3/system/users/7b44626818d14b1da90b2504e357592d/roles/91418844a31b44b885804c221d52c38b` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:11.280221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76d87e-6a21-42d6-bab2-5b08db1fd0c1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7b44626818d14b1da90b2504e357592d, role_id=91418844a31b44b885804c221d52c38b)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:11.281617 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be76d87e-6a21-42d6-bab2-5b08db1fd0c1 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:11.393309 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 161/334] 10.222.0.40 () {58 vars in 1334 bytes} [Tue Jul 12 14:21:11 2022] PUT /identity/v3/system/users/7b44626818d14b1da90b2504e357592d/roles/91418844a31b44b885804c221d52c38b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:21:13.155833 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6e501-4802-438e-8c49-550e64872e9f None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:13.156407 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6e501-4802-438e-8c49-550e64872e9f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:13.156407 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6e501-4802-438e-8c49-550e64872e9f None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:13.158115 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 174/335] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:13.163062 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7822f-4186-41a2-be82-1bab628b604b None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:13.163519 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7822f-4186-41a2-be82-1bab628b604b None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:13.163704 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7822f-4186-41a2-be82-1bab628b604b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:13.187832 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-b3b7822f-4186-41a2-be82-1bab628b604b None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:13.189283 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b3b7822f-4186-41a2-be82-1bab628b604b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:13.191604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:13.283890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 162/336] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:13.321991 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6e501-4802-438e-8c49-550e64872e9f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:13.401861 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:13.443161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6e501-4802-438e-8c49-550e64872e9f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:13.490591 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458f1a0-5051-440e-93a5-645be7c5657f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:13.491447 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458f1a0-5051-440e-93a5-645be7c5657f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:13.491739 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458f1a0-5051-440e-93a5-645be7c5657f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:13.492022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458f1a0-5051-440e-93a5-645be7c5657f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:13.507639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458f1a0-5051-440e-93a5-645be7c5657f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:13.515967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-1458f1a0-5051-440e-93a5-645be7c5657f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:13.515967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:13.515967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:13.515967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:13.515967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:13.515967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:13.515967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:13.515967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:13.515967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:13.515967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:13.515967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:13.515967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:13.515967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:13.515967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:13.515967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:13.515967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:13.516912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:13.516912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:13.516912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:13.516912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:13.516912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:13.516912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:13.516912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:13.516912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:13.516912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:13.516912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:13.516912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:13.516912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:13.516912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:13.516912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:13.516912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:13.516912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:13.518369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:13.518369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:13.518369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:13.518369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:13.518369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:13.518369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:13.518369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:13.518369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:13.518369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:13.518369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:13.518369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:13.518369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:13.518369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 175/337] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:13.523004 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7822f-4186-41a2-be82-1bab628b604b None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:13.657965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7822f-4186-41a2-be82-1bab628b604b None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:13.700315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b6ee6-0b9f-405b-9a60-cc09adfab2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:13.700914 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b6ee6-0b9f-405b-9a60-cc09adfab2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:13.701206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b6ee6-0b9f-405b-9a60-cc09adfab2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:13.701538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b6ee6-0b9f-405b-9a60-cc09adfab2a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:13.702305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b6ee6-0b9f-405b-9a60-cc09adfab2a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:13.702616 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b6ee6-0b9f-405b-9a60-cc09adfab2a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:13.704020 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b6ee6-0b9f-405b-9a60-cc09adfab2a9 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:13.716252 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:13.716653 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 163/338] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:21:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:13.718433 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c9efa-7cad-406a-a21e-ab2f26c0c115 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:13.718727 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c9efa-7cad-406a-a21e-ab2f26c0c115 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:13.719011 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c9efa-7cad-406a-a21e-ab2f26c0c115 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:13.720568 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 176/339] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:13.724454 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b6ee6-0b9f-405b-9a60-cc09adfab2a9 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:13.729171 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c7412-5499-4afa-8d93-0089db1d4f02 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:13.729458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c7412-5499-4afa-8d93-0089db1d4f02 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:13.729739 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c7412-5499-4afa-8d93-0089db1d4f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:13.760882 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-983c7412-5499-4afa-8d93-0089db1d4f02 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:13.762073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-983c7412-5499-4afa-8d93-0089db1d4f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:13.895224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b6ee6-0b9f-405b-9a60-cc09adfab2a9 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:13.900976 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 177/340] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:21:13.902380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c40ce5-312e-4aa1-97e1-bea1f63031ea None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:13.902667 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c40ce5-312e-4aa1-97e1-bea1f63031ea None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:13.902943 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c40ce5-312e-4aa1-97e1-bea1f63031ea None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:13.908823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 178/341] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:13.919814 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbeef9-c3ec-4368-8d24-8d6190b560cf None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:13.920129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbeef9-c3ec-4368-8d24-8d6190b560cf None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:13.920369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbeef9-c3ec-4368-8d24-8d6190b560cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:13.948460 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-93dbeef9-c3ec-4368-8d24-8d6190b560cf None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:13.949644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-93dbeef9-c3ec-4368-8d24-8d6190b560cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:13.973411 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756b02d-c9c4-40ea-9e42-063a228b0cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:13.973987 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756b02d-c9c4-40ea-9e42-063a228b0cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:13.974270 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756b02d-c9c4-40ea-9e42-063a228b0cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:13.974542 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756b02d-c9c4-40ea-9e42-063a228b0cb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:14.060799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:14.081573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 179/342] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:21:14.082439 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbeef9-c3ec-4368-8d24-8d6190b560cf None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:14.104614 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:14.106373 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756b02d-c9c4-40ea-9e42-063a228b0cb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:14.111974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756b02d-c9c4-40ea-9e42-063a228b0cb0 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:14.257593 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbeef9-c3ec-4368-8d24-8d6190b560cf None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:14.303884 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b9263-1403-40b2-a05b-46802dac41d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:14.304711 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b9263-1403-40b2-a05b-46802dac41d7 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:14.305607 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b9263-1403-40b2-a05b-46802dac41d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:14.305880 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b9263-1403-40b2-a05b-46802dac41d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:14.321365 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b9263-1403-40b2-a05b-46802dac41d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:14.330984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-7e0b9263-1403-40b2-a05b-46802dac41d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:21:14.330984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:14.330984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:14.330984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:14.330984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:14.330984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:14.330984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:14.330984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:14.330984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:14.330984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:14.330984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:14.330984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:14.330984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:14.330984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:14.330984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:14.330984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:14.332163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:14.332163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:14.332163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:14.332163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:14.332163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:14.332163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:14.332163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:14.332163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:14.332163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:14.332163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:14.332163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:14.332163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:14.332163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:14.332163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:14.332163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:14.332163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:14.333094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:14.333094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:14.333094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:14.333094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:14.333094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:14.333094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:14.333094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:14.333094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:14.333094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:14.333094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:14.333094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:21:14.333094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:14.335572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 180/343] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:21:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:14.338019 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b9263-1403-40b2-a05b-46802dac41d7 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:14.402690 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 164/344] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:14.403606 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756b02d-c9c4-40ea-9e42-063a228b0cb0 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:14.415668 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:14.533153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b9263-1403-40b2-a05b-46802dac41d7 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:14.539448 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:14.544096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756b02d-c9c4-40ea-9e42-063a228b0cb0 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:14.587956 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea2ceb-82b8-41f8-b10c-0c80e875966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:14.589098 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea2ceb-82b8-41f8-b10c-0c80e875966a None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:14.589381 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea2ceb-82b8-41f8-b10c-0c80e875966a None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:14.589657 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea2ceb-82b8-41f8-b10c-0c80e875966a None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:14.590567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea2ceb-82b8-41f8-b10c-0c80e875966a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:14.590996 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea2ceb-82b8-41f8-b10c-0c80e875966a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:14.592701 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea2ceb-82b8-41f8-b10c-0c80e875966a None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:14.603324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 165/345] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:14.603979 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30ac9f-d338-47d7-9fa7-90e7cb248695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:14.604194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea2ceb-82b8-41f8-b10c-0c80e875966a None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:14.605196 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30ac9f-d338-47d7-9fa7-90e7cb248695 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:14.605674 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30ac9f-d338-47d7-9fa7-90e7cb248695 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:14.606148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30ac9f-d338-47d7-9fa7-90e7cb248695 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:14.618979 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30ac9f-d338-47d7-9fa7-90e7cb248695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:14.628123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-ca30ac9f-d338-47d7-9fa7-90e7cb248695 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:14.628123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:14.628123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:14.628123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:14.628123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:14.628123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:14.628123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:14.628123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:14.628123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:14.628123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:14.628123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:14.628123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:14.628123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:14.628123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:14.628123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:14.628123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:14.629095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:14.629095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:14.629095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:14.629095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:14.629095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:14.629095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:14.629095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:14.629095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:14.629095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:14.629095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:14.629095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:14.629095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:14.629095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:14.629095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:14.629095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:14.629095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:14.629966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:14.629966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:14.629966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:14.629966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:14.629966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:14.629966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:14.629966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:14.629966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:14.629966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:14.629966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:14.629966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:14.629966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:14.634221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 181/346] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:14.635976 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9112574-74fe-45c1-bee6-a9221c5e40cb None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:14.636556 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9112574-74fe-45c1-bee6-a9221c5e40cb None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:14.637036 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9112574-74fe-45c1-bee6-a9221c5e40cb None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:14.638843 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 182/347] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:14.639847 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9112574-74fe-45c1-bee6-a9221c5e40cb None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:14.744020 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea2ceb-82b8-41f8-b10c-0c80e875966a None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:14.786907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9112574-74fe-45c1-bee6-a9221c5e40cb None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:14.787488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b678669-83d0-4b31-8b0a-c5a0f4aa8dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:14.788774 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b678669-83d0-4b31-8b0a-c5a0f4aa8dcd None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:14.790264 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b678669-83d0-4b31-8b0a-c5a0f4aa8dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:14.790750 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b678669-83d0-4b31-8b0a-c5a0f4aa8dcd None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:14.792266 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b678669-83d0-4b31-8b0a-c5a0f4aa8dcd None admin] RBAC: Authorizing `identity:get_project(project_id=21f896d0c1d8492287fcd5e0801dec94)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:14.793925 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b678669-83d0-4b31-8b0a-c5a0f4aa8dcd None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:14.796797 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 166/348] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:14 2022] GET /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:14.797925 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b678669-83d0-4b31-8b0a-c5a0f4aa8dcd None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:14.804678 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:14.834603 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7503f1f-47b7-459d-8aac-b29a9a3d9a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:14.837599 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7503f1f-47b7-459d-8aac-b29a9a3d9a6e None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:14.837884 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7503f1f-47b7-459d-8aac-b29a9a3d9a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:14.838161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7503f1f-47b7-459d-8aac-b29a9a3d9a6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:14.842711 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:14.932318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b678669-83d0-4b31-8b0a-c5a0f4aa8dcd None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:14.939574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7503f1f-47b7-459d-8aac-b29a9a3d9a6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:14.941078 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7503f1f-47b7-459d-8aac-b29a9a3d9a6e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:14.972478 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b981017-d0f5-4352-a2de-eb90dd87a6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:14.973587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b981017-d0f5-4352-a2de-eb90dd87a6fd None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:14.974167 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b981017-d0f5-4352-a2de-eb90dd87a6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:14.974516 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b981017-d0f5-4352-a2de-eb90dd87a6fd None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:14.975293 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b981017-d0f5-4352-a2de-eb90dd87a6fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:14.975598 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b981017-d0f5-4352-a2de-eb90dd87a6fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:14.977618 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b981017-d0f5-4352-a2de-eb90dd87a6fd None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:14.988226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 167/349] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:21:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:14.989511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a904461-5669-4e1e-a883-947149d69fff None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:14.989799 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a904461-5669-4e1e-a883-947149d69fff None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:14.990132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a904461-5669-4e1e-a883-947149d69fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.009296 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-8a904461-5669-4e1e-a883-947149d69fff None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:15.010485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-8a904461-5669-4e1e-a883-947149d69fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:15.056286 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 183/350] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:15.057653 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5767f1f-1598-45ff-9dd5-9af86e83080e None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.057947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5767f1f-1598-45ff-9dd5-9af86e83080e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.058228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5767f1f-1598-45ff-9dd5-9af86e83080e None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.059761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 184/351] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:15.065324 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5767f1f-1598-45ff-9dd5-9af86e83080e None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:15.081400 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:15.089458 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 168/352] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:15.092429 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a904461-5669-4e1e-a883-947149d69fff None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:15.121797 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:15.197669 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5767f1f-1598-45ff-9dd5-9af86e83080e None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:15.219908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a904461-5669-4e1e-a883-947149d69fff None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:15.236079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f95a1-1deb-4fb4-bdc3-fca156ac0176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:15.237047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f95a1-1deb-4fb4-bdc3-fca156ac0176 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.237220 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f95a1-1deb-4fb4-bdc3-fca156ac0176 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.237493 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f95a1-1deb-4fb4-bdc3-fca156ac0176 None admin] PATH_INFO: `/v3/groups/3017be6af6364ad2a4f2c33e39d528c8` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.250963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f95a1-1deb-4fb4-bdc3-fca156ac0176 None admin] RBAC: Authorizing `identity:get_group(group_id=3017be6af6364ad2a4f2c33e39d528c8)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:15.252056 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f95a1-1deb-4fb4-bdc3-fca156ac0176 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:15.253969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 185/353] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Jul 12 14:21:15 2022] GET /identity/v3/groups/3017be6af6364ad2a4f2c33e39d528c8 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:15.256271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d87d43-a78f-489d-8fa5-c6faa3920411 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.256566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d87d43-a78f-489d-8fa5-c6faa3920411 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.256848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d87d43-a78f-489d-8fa5-c6faa3920411 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.259504 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 186/354] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:15.264226 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d87d43-a78f-489d-8fa5-c6faa3920411 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:15.271818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0000f9e-ccb1-483f-8deb-2344b0e358f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:15.271818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000f9e-ccb1-483f-8deb-2344b0e358f9 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.271818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000f9e-ccb1-483f-8deb-2344b0e358f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.271818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000f9e-ccb1-483f-8deb-2344b0e358f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.360228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0000f9e-ccb1-483f-8deb-2344b0e358f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:15.361989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0000f9e-ccb1-483f-8deb-2344b0e358f9 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:15.371795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:15.392091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:15.411578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d87d43-a78f-489d-8fa5-c6faa3920411 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:15.460435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fcd31-2da7-47fb-8434-41391f5a6675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:15.461470 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fcd31-2da7-47fb-8434-41391f5a6675 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.461754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fcd31-2da7-47fb-8434-41391f5a6675 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.463510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fcd31-2da7-47fb-8434-41391f5a6675 None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.464042 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fcd31-2da7-47fb-8434-41391f5a6675 None admin] RBAC: Authorizing `identity:get_project(project_id=21f896d0c1d8492287fcd5e0801dec94)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:15.466982 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2fcd31-2da7-47fb-8434-41391f5a6675 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:15.467794 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 187/355] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:15 2022] GET /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:15.469840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ab270-b4d0-4731-80e0-933330f93e80 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.469840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ab270-b4d0-4731-80e0-933330f93e80 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.469840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ab270-b4d0-4731-80e0-933330f93e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.488605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-e53ab270-b4d0-4731-80e0-933330f93e80 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:15.490337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e53ab270-b4d0-4731-80e0-933330f93e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:15.494696 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 169/356] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:15.495944 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0000f9e-ccb1-483f-8deb-2344b0e358f9 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:15.574039 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 188/357] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:15.575175 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ab270-b4d0-4731-80e0-933330f93e80 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:15.639191 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0000f9e-ccb1-483f-8deb-2344b0e358f9 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:15.669590 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:15.674305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:15.689510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a70f5f-ff2f-4398-afcd-d015bb913e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:15.690058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a70f5f-ff2f-4398-afcd-d015bb913e6f None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.690433 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a70f5f-ff2f-4398-afcd-d015bb913e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.690637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a70f5f-ff2f-4398-afcd-d015bb913e6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.701974 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ab270-b4d0-4731-80e0-933330f93e80 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:15.704376 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a70f5f-ff2f-4398-afcd-d015bb913e6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:15.713546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-65a70f5f-ff2f-4398-afcd-d015bb913e6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:21:15.713546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:15.713546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:15.713546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:15.713546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:15.713546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:15.713546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:15.713546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:15.713546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:15.713546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:15.713546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:15.713546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:15.713546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:15.713546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:15.713546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:15.713546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:15.714748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:15.714748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:15.714748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:15.714748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:15.714748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:15.714748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:15.714748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:15.714748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:15.714748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:15.714748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:15.714748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:15.714748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:15.714748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:15.714748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:15.714748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:15.714748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:15.715798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:15.715798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:15.715798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:15.715798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:15.715798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:15.715798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:15.715798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:15.715798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:15.715798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:15.715798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:15.715798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:21:15.715798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:15.715798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 170/358] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:21:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:15.716635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eea755-3f3f-4640-8982-b55e6aebf9be None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.716635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eea755-3f3f-4640-8982-b55e6aebf9be None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.716635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eea755-3f3f-4640-8982-b55e6aebf9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.734975 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-c5eea755-3f3f-4640-8982-b55e6aebf9be None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:15.736244 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-c5eea755-3f3f-4640-8982-b55e6aebf9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:15.746376 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dba4a-01d5-4b8c-9030-1e659cbb5332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:15.747041 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dba4a-01d5-4b8c-9030-1e659cbb5332 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.747351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dba4a-01d5-4b8c-9030-1e659cbb5332 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.747631 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dba4a-01d5-4b8c-9030-1e659cbb5332 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.748850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9dba4a-01d5-4b8c-9030-1e659cbb5332 None admin] RBAC: Adding query filter params (group.id=3017be6af6364ad2a4f2c33e39d528c8, role.id=5444412a1f604ebaa9282a244859c051, scope.project.id=21f896d0c1d8492287fcd5e0801dec94) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:15.749464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9dba4a-01d5-4b8c-9030-1e659cbb5332 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:15.751201 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9dba4a-01d5-4b8c-9030-1e659cbb5332 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:15.759124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 189/359] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Jul 12 14:21:15 2022] GET /identity/v3/role_assignments?group.id=3017be6af6364ad2a4f2c33e39d528c8&scope.project.id=21f896d0c1d8492287fcd5e0801dec94&role.id=5444412a1f604ebaa9282a244859c051 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:15.761688 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dba4a-01d5-4b8c-9030-1e659cbb5332 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:15.830946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 171/360] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:15.832208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eea755-3f3f-4640-8982-b55e6aebf9be None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:15.924676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dba4a-01d5-4b8c-9030-1e659cbb5332 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:15.969414 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eea755-3f3f-4640-8982-b55e6aebf9be None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:15.971073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32924ec4-4c90-4ddb-9bb9-3af888e51577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:15.972134 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32924ec4-4c90-4ddb-9bb9-3af888e51577 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:15.974349 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32924ec4-4c90-4ddb-9bb9-3af888e51577 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:15.974349 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32924ec4-4c90-4ddb-9bb9-3af888e51577 None admin] PATH_INFO: `/v3/groups/3017be6af6364ad2a4f2c33e39d528c8` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:15.974950 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32924ec4-4c90-4ddb-9bb9-3af888e51577 None admin] RBAC: Authorizing `identity:get_group(group_id=3017be6af6364ad2a4f2c33e39d528c8)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:15.976456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32924ec4-4c90-4ddb-9bb9-3af888e51577 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:15.979323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 190/361] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Jul 12 14:21:15 2022] GET /identity/v3/groups/3017be6af6364ad2a4f2c33e39d528c8 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:15.980137 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32924ec4-4c90-4ddb-9bb9-3af888e51577 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:15.989857 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:15.990046 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:16.016904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85536ee9-2115-4887-9605-d341a59d5502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:16.017842 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85536ee9-2115-4887-9605-d341a59d5502 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:16.018131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85536ee9-2115-4887-9605-d341a59d5502 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:16.018409 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85536ee9-2115-4887-9605-d341a59d5502 None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:16.019685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85536ee9-2115-4887-9605-d341a59d5502 None admin] RBAC: Authorizing `identity:get_project(project_id=a67548b777b24c2d88cd5789350f5c35)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:16.021160 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85536ee9-2115-4887-9605-d341a59d5502 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:16.024133 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 172/362] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:15 2022] GET /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:16.025911 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85536ee9-2115-4887-9605-d341a59d5502 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:16.114513 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32924ec4-4c90-4ddb-9bb9-3af888e51577 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:16.156109 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85536ee9-2115-4887-9605-d341a59d5502 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:16.161792 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f58f0-a7db-4b57-894f-025b7a21e1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:16.162915 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f58f0-a7db-4b57-894f-025b7a21e1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:16.163518 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f58f0-a7db-4b57-894f-025b7a21e1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:16.164011 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f58f0-a7db-4b57-894f-025b7a21e1e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:16.183227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f58f0-a7db-4b57-894f-025b7a21e1e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:16.193729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-6f1f58f0-a7db-4b57-894f-025b7a21e1e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:21:16.193729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:16.193729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:16.193729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:16.193729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:16.193729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:16.193729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:16.193729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:16.193729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:16.193729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:16.193729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:16.193729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:16.193729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:16.193729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:16.193729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:16.193729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:16.194651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:16.194651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:16.194651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:16.194651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:16.194651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:16.194651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:16.194651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:16.194651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:16.194651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:16.194651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:16.194651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:16.194651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:16.194651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:16.194651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:16.194651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:16.194651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:16.196001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:16.196001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:16.196001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:16.196001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:16.196001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:16.196001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:16.196001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:16.196001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:16.196001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:16.196001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:16.196001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 14:21:16.196001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:16.196001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 191/363] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:16.196688 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f58f0-a7db-4b57-894f-025b7a21e1e6 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:16.200665 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401fe84-1430-4634-a05d-b2921c75a9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:16.201359 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401fe84-1430-4634-a05d-b2921c75a9ab None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:16.201645 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401fe84-1430-4634-a05d-b2921c75a9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:16.201922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401fe84-1430-4634-a05d-b2921c75a9ab None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:16.202996 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401fe84-1430-4634-a05d-b2921c75a9ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:16.203174 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401fe84-1430-4634-a05d-b2921c75a9ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:16.204458 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401fe84-1430-4634-a05d-b2921c75a9ab None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:16.218402 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 173/364] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:16.219235 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401fe84-1430-4634-a05d-b2921c75a9ab None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:16.286066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:16.293487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:16.344992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f58f0-a7db-4b57-894f-025b7a21e1e6 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:16.365709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401fe84-1430-4634-a05d-b2921c75a9ab None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:16.387863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ad616-6daf-471b-a79a-1917b775c10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:16.388673 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ad616-6daf-471b-a79a-1917b775c10b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:16.388961 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ad616-6daf-471b-a79a-1917b775c10b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:16.389240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ad616-6daf-471b-a79a-1917b775c10b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:16.406637 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ad616-6daf-471b-a79a-1917b775c10b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:16.416809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-fa0ad616-6daf-471b-a79a-1917b775c10b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:16.416809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:16.416809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:16.416809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:16.416809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:16.416809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:16.416809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:16.416809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:16.416809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:16.416809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:16.416809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:16.416809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:16.416809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:16.416809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:16.416809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:16.416809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:16.417952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:16.417952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:16.417952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:16.417952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:16.417952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:16.417952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:16.417952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:16.417952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:16.417952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:16.417952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:16.417952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:16.417952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:16.417952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:16.417952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:16.417952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:16.417952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:16.418935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:16.418935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:16.418935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:16.418935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:16.418935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:16.418935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:16.418935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:16.418935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:16.418935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:16.418935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:16.418935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:16.418935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:16.420706 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e44e3-de6a-47df-9f28-e8f675410583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:16.421267 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 192/365] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:21:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:16.421384 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e44e3-de6a-47df-9f28-e8f675410583 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:16.421649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e44e3-de6a-47df-9f28-e8f675410583 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:16.421931 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e44e3-de6a-47df-9f28-e8f675410583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:16.422039 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ad616-6daf-471b-a79a-1917b775c10b None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:16.422792 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e44e3-de6a-47df-9f28-e8f675410583 None admin] RBAC: Adding query filter params (group.id=3017be6af6364ad2a4f2c33e39d528c8, role.id=6184586642114a188e13c695442669f8, scope.project.id=21f896d0c1d8492287fcd5e0801dec94) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:16.423109 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e44e3-de6a-47df-9f28-e8f675410583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:16.424601 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e44e3-de6a-47df-9f28-e8f675410583 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:16.436533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 174/366] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Jul 12 14:21:16 2022] GET /identity/v3/role_assignments?group.id=3017be6af6364ad2a4f2c33e39d528c8&scope.project.id=21f896d0c1d8492287fcd5e0801dec94&role.id=6184586642114a188e13c695442669f8 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:16.437684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e44e3-de6a-47df-9f28-e8f675410583 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:16.578487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ad616-6daf-471b-a79a-1917b775c10b None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:16.589558 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e44e3-de6a-47df-9f28-e8f675410583 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:16.597652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:16.611852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:16.629824 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58016273-bb25-44ad-b800-42e31d6a8e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:16.630702 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58016273-bb25-44ad-b800-42e31d6a8e91 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:16.630990 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58016273-bb25-44ad-b800-42e31d6a8e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:16.631290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58016273-bb25-44ad-b800-42e31d6a8e91 None admin] PATH_INFO: `/v3/groups/3017be6af6364ad2a4f2c33e39d528c8` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:16.633638 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58016273-bb25-44ad-b800-42e31d6a8e91 None admin] RBAC: Authorizing `identity:get_group(group_id=3017be6af6364ad2a4f2c33e39d528c8)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:16.635394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58016273-bb25-44ad-b800-42e31d6a8e91 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:16.637272 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 193/367] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Jul 12 14:21:16 2022] GET /identity/v3/groups/3017be6af6364ad2a4f2c33e39d528c8 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:16.637863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58016273-bb25-44ad-b800-42e31d6a8e91 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:16.638520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dda94-c409-4d55-b052-9699ad49968b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:16.639570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dda94-c409-4d55-b052-9699ad49968b None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:16.640150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dda94-c409-4d55-b052-9699ad49968b None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:16.640724 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dda94-c409-4d55-b052-9699ad49968b None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:16.641712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6dda94-c409-4d55-b052-9699ad49968b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:16.642024 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6dda94-c409-4d55-b052-9699ad49968b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:16.643470 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6dda94-c409-4d55-b052-9699ad49968b None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:16.652777 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 175/368] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:21:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:16.653708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dda94-c409-4d55-b052-9699ad49968b None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:16.763412 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58016273-bb25-44ad-b800-42e31d6a8e91 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:16.783763 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dda94-c409-4d55-b052-9699ad49968b None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:16.810867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4b544-2302-4078-90b7-cf075fb8b938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:16.811560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4b544-2302-4078-90b7-cf075fb8b938 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:16.811848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4b544-2302-4078-90b7-cf075fb8b938 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:16.812127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4b544-2302-4078-90b7-cf075fb8b938 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:16.822102 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aec6c9-cf34-450d-a880-b09500a50166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:16.823094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aec6c9-cf34-450d-a880-b09500a50166 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:16.823638 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aec6c9-cf34-450d-a880-b09500a50166 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:16.824141 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aec6c9-cf34-450d-a880-b09500a50166 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:16.825097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aec6c9-cf34-450d-a880-b09500a50166 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:16.825621 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aec6c9-cf34-450d-a880-b09500a50166 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:16.827247 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aec6c9-cf34-450d-a880-b09500a50166 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:16.836847 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 176/369] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:16.842234 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aec6c9-cf34-450d-a880-b09500a50166 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:16.883479 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:16.889059 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:16.897719 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4b544-2302-4078-90b7-cf075fb8b938 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:16.900436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4b544-2302-4078-90b7-cf075fb8b938 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:16.967902 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aec6c9-cf34-450d-a880-b09500a50166 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:17.003294 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a5f50-2e3b-4adb-be82-ca6abb266aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:17.003986 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a5f50-2e3b-4adb-be82-ca6abb266aff None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:17.004260 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a5f50-2e3b-4adb-be82-ca6abb266aff None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:17.004545 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a5f50-2e3b-4adb-be82-ca6abb266aff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:17.005384 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a5f50-2e3b-4adb-be82-ca6abb266aff None admin] RBAC: Adding query filter params (group.id=3017be6af6364ad2a4f2c33e39d528c8, role.id=5444412a1f604ebaa9282a244859c051, scope.project.id=a67548b777b24c2d88cd5789350f5c35) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:17.005703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a5f50-2e3b-4adb-be82-ca6abb266aff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:17.007140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a5f50-2e3b-4adb-be82-ca6abb266aff None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:17.019390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 177/370] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Jul 12 14:21:16 2022] GET /identity/v3/role_assignments?group.id=3017be6af6364ad2a4f2c33e39d528c8&scope.project.id=a67548b777b24c2d88cd5789350f5c35&role.id=5444412a1f604ebaa9282a244859c051 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:17.019390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a5f50-2e3b-4adb-be82-ca6abb266aff None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:17.022765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 194/371] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:17.031628 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4b544-2302-4078-90b7-cf075fb8b938 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:17.123542 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:17.134900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a5f50-2e3b-4adb-be82-ca6abb266aff None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:17.182166 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7188e06-e46e-42e0-abdb-aa9549633019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:17.187303 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7188e06-e46e-42e0-abdb-aa9549633019 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:17.187303 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7188e06-e46e-42e0-abdb-aa9549633019 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:17.187303 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7188e06-e46e-42e0-abdb-aa9549633019 None admin] PATH_INFO: `/v3/users/7b44626818d14b1da90b2504e357592d` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:17.190558 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7188e06-e46e-42e0-abdb-aa9549633019 None admin] RBAC: Authorizing `identity:get_user(user_id=7b44626818d14b1da90b2504e357592d)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:17.192110 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7188e06-e46e-42e0-abdb-aa9549633019 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:17.193963 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 178/372] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:21:17 2022] GET /identity/v3/users/7b44626818d14b1da90b2504e357592d => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:17.194820 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7188e06-e46e-42e0-abdb-aa9549633019 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:17.233573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:17.248275 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4b544-2302-4078-90b7-cf075fb8b938 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:17.314101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb14a2b-3346-436d-8642-7f2a6c17962f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:17.316771 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb14a2b-3346-436d-8642-7f2a6c17962f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:17.317475 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb14a2b-3346-436d-8642-7f2a6c17962f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:17.317999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb14a2b-3346-436d-8642-7f2a6c17962f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:17.388657 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7188e06-e46e-42e0-abdb-aa9549633019 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:17.430295 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f9a98-9c21-4202-83cf-28fa72ea97d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:17.431649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f9a98-9c21-4202-83cf-28fa72ea97d7 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:17.432180 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f9a98-9c21-4202-83cf-28fa72ea97d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:17.432662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f9a98-9c21-4202-83cf-28fa72ea97d7 None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:17.434681 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f9a98-9c21-4202-83cf-28fa72ea97d7 None admin] RBAC: Authorizing `identity:get_project(project_id=a67548b777b24c2d88cd5789350f5c35)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:17.436428 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f9a98-9c21-4202-83cf-28fa72ea97d7 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:17.438743 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 179/373] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:17 2022] GET /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:17.439824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f9a98-9c21-4202-83cf-28fa72ea97d7 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:17.480092 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:17.510111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb14a2b-3346-436d-8642-7f2a6c17962f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:17.511599 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb14a2b-3346-436d-8642-7f2a6c17962f None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:17.605360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f9a98-9c21-4202-83cf-28fa72ea97d7 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:17.643285 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:17.651245 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 195/374] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:17.652183 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb14a2b-3346-436d-8642-7f2a6c17962f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:17.700361 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f2b9a-2726-4c71-ae1c-adc0d6cf6adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:17.701065 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f2b9a-2726-4c71-ae1c-adc0d6cf6adc None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:17.701351 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f2b9a-2726-4c71-ae1c-adc0d6cf6adc None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:17.701629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f2b9a-2726-4c71-ae1c-adc0d6cf6adc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:17.702472 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f2b9a-2726-4c71-ae1c-adc0d6cf6adc None admin] RBAC: Adding query filter params (role.id=91418844a31b44b885804c221d52c38b, user.id=7b44626818d14b1da90b2504e357592d, scope.system=all) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:17.702787 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f2b9a-2726-4c71-ae1c-adc0d6cf6adc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:17.704298 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f2b9a-2726-4c71-ae1c-adc0d6cf6adc None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:17.761812 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 180/375] 10.222.0.40 () {56 vars in 1308 bytes} [Tue Jul 12 14:21:17 2022] GET /identity/v3/role_assignments?user.id=7b44626818d14b1da90b2504e357592d&scope.system=all&role.id=91418844a31b44b885804c221d52c38b => generated 510 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:17.762699 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f2b9a-2726-4c71-ae1c-adc0d6cf6adc None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:17.791761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb14a2b-3346-436d-8642-7f2a6c17962f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:17.849978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cddfc5-e02e-42ff-972c-2de12710a5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:17.851215 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cddfc5-e02e-42ff-972c-2de12710a5fb None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:17.851995 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cddfc5-e02e-42ff-972c-2de12710a5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:17.852494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cddfc5-e02e-42ff-972c-2de12710a5fb None admin] PATH_INFO: `/v3/groups/3017be6af6364ad2a4f2c33e39d528c8` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:17.854282 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cddfc5-e02e-42ff-972c-2de12710a5fb None admin] RBAC: Authorizing `identity:get_group(group_id=3017be6af6364ad2a4f2c33e39d528c8)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:17.856051 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cddfc5-e02e-42ff-972c-2de12710a5fb None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:17.858209 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 196/376] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Jul 12 14:21:17 2022] GET /identity/v3/groups/3017be6af6364ad2a4f2c33e39d528c8 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:17.865302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cddfc5-e02e-42ff-972c-2de12710a5fb None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:17.954049 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:18.008401 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cddfc5-e02e-42ff-972c-2de12710a5fb None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:18.050773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f2d6b-d3c1-4f73-af90-ed446596c753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:18.051763 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f2d6b-d3c1-4f73-af90-ed446596c753 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:18.052054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f2d6b-d3c1-4f73-af90-ed446596c753 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:18.052336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f2d6b-d3c1-4f73-af90-ed446596c753 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:18.053193 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f2d6b-d3c1-4f73-af90-ed446596c753 None admin] RBAC: Adding query filter params (group.id=3017be6af6364ad2a4f2c33e39d528c8, role.id=6184586642114a188e13c695442669f8, scope.project.id=a67548b777b24c2d88cd5789350f5c35) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:18.053513 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f2d6b-d3c1-4f73-af90-ed446596c753 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:18.056342 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f2d6b-d3c1-4f73-af90-ed446596c753 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:18.063362 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:18.064349 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 197/377] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Jul 12 14:21:17 2022] GET /identity/v3/role_assignments?group.id=3017be6af6364ad2a4f2c33e39d528c8&scope.project.id=a67548b777b24c2d88cd5789350f5c35&role.id=6184586642114a188e13c695442669f8 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:18.065742 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe56d35-9508-4d05-8ba4-8569f1eb5ddc None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:18.066030 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe56d35-9508-4d05-8ba4-8569f1eb5ddc None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:18.066310 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe56d35-9508-4d05-8ba4-8569f1eb5ddc None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:18.068212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 198/378] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:18.074882 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad9a57-8601-4ac2-98fd-33a58cbf47be None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:18.075163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad9a57-8601-4ac2-98fd-33a58cbf47be None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:18.076420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad9a57-8601-4ac2-98fd-33a58cbf47be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:18.097638 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-25ad9a57-8601-4ac2-98fd-33a58cbf47be None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:18.099213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-25ad9a57-8601-4ac2-98fd-33a58cbf47be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:18.113443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f2b9a-2726-4c71-ae1c-adc0d6cf6adc None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:18.184277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 199/379] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:18.207731 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6989edb-2352-4e30-b849-b720b4e15112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:18.208730 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6989edb-2352-4e30-b849-b720b4e15112 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:18.209027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6989edb-2352-4e30-b849-b720b4e15112 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:18.209307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6989edb-2352-4e30-b849-b720b4e15112 None admin] PATH_INFO: `/v3/projects/e19a2306c9b043c3b84bdeaf0a418bdb` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:18.210575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad9a57-8601-4ac2-98fd-33a58cbf47be None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:18.210705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6989edb-2352-4e30-b849-b720b4e15112 None admin] RBAC: Authorizing `identity:get_project(project_id=e19a2306c9b043c3b84bdeaf0a418bdb)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:18.213435 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6989edb-2352-4e30-b849-b720b4e15112 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:18.215252 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 181/380] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:17 2022] GET /identity/v3/projects/e19a2306c9b043c3b84bdeaf0a418bdb => generated 344 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:18.224369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6989edb-2352-4e30-b849-b720b4e15112 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:18.302207 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:18.360380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad9a57-8601-4ac2-98fd-33a58cbf47be None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:18.384583 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6989edb-2352-4e30-b849-b720b4e15112 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:18.411197 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795b6db-e7aa-46bb-b75f-185caf79c9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:18.412607 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795b6db-e7aa-46bb-b75f-185caf79c9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:18.413234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795b6db-e7aa-46bb-b75f-185caf79c9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:18.413691 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795b6db-e7aa-46bb-b75f-185caf79c9b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:18.429066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795b6db-e7aa-46bb-b75f-185caf79c9b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:18.439372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-d795b6db-e7aa-46bb-b75f-185caf79c9b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:18.439372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:18.439372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:18.439372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:18.439372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:18.439372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:18.439372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:18.439372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:18.439372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:18.439372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:18.439372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:18.439372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:18.439372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:18.439372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:18.439372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:18.439372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:18.440340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:18.440340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:18.440340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:18.440340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:18.440340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:18.440340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:18.440340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:18.440340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:18.440340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:18.440340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:18.440340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:18.440340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:18.440340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:18.440340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:18.440340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:18.440340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:18.441111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:18.441111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:18.441111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:18.441111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:18.441111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:18.441111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:18.441111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:18.441111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:18.441111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:18.441111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:18.441111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:18.441111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:18.443928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 200/381] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:18.451533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795b6db-e7aa-46bb-b75f-185caf79c9b0 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:18.488640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcb905-b964-4808-9d2a-f998a2c528d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:18.489745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcb905-b964-4808-9d2a-f998a2c528d0 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:18.490180 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcb905-b964-4808-9d2a-f998a2c528d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:18.490672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcb905-b964-4808-9d2a-f998a2c528d0 None admin] PATH_INFO: `/v3/groups/d73d46ff350c422fadc311f221ecc64c` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:18.506347 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcb905-b964-4808-9d2a-f998a2c528d0 None admin] RBAC: Authorizing `identity:get_group(group_id=d73d46ff350c422fadc311f221ecc64c)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:18.508036 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcb905-b964-4808-9d2a-f998a2c528d0 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:18.510122 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 182/382] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Jul 12 14:21:18 2022] GET /identity/v3/groups/d73d46ff350c422fadc311f221ecc64c => generated 229 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:18.516197 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcb905-b964-4808-9d2a-f998a2c528d0 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:18.558582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:18.577226 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795b6db-e7aa-46bb-b75f-185caf79c9b0 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:18.600121 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:18.625618 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501f8ca-3ddb-4eac-a172-1937715f6255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:18.626571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501f8ca-3ddb-4eac-a172-1937715f6255 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:18.627493 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501f8ca-3ddb-4eac-a172-1937715f6255 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:18.629144 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501f8ca-3ddb-4eac-a172-1937715f6255 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:18.630421 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501f8ca-3ddb-4eac-a172-1937715f6255 None admin] RBAC: Adding query filter params (name=member) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:18.630876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501f8ca-3ddb-4eac-a172-1937715f6255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:18.633678 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501f8ca-3ddb-4eac-a172-1937715f6255 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:18.645698 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 201/383] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:21:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:18.652045 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501f8ca-3ddb-4eac-a172-1937715f6255 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:18.655677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcb905-b964-4808-9d2a-f998a2c528d0 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:18.693412 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730a9a2-7865-466c-a328-a4c180f96fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:18.694198 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730a9a2-7865-466c-a328-a4c180f96fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:18.695369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730a9a2-7865-466c-a328-a4c180f96fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:18.695369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730a9a2-7865-466c-a328-a4c180f96fb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:18.695978 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730a9a2-7865-466c-a328-a4c180f96fb3 None admin] RBAC: Adding query filter params (group.id=d73d46ff350c422fadc311f221ecc64c, role.id=ae530119fc5c42358179521ce865b5d7, scope.project.id=e19a2306c9b043c3b84bdeaf0a418bdb) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:18.696421 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730a9a2-7865-466c-a328-a4c180f96fb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:18.697985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730a9a2-7865-466c-a328-a4c180f96fb3 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:18.705483 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 183/384] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Jul 12 14:21:18 2022] GET /identity/v3/role_assignments?group.id=d73d46ff350c422fadc311f221ecc64c&scope.project.id=e19a2306c9b043c3b84bdeaf0a418bdb&role.id=ae530119fc5c42358179521ce865b5d7 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:18.773937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501f8ca-3ddb-4eac-a172-1937715f6255 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:18.813372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26b090-03ed-4f2b-9bac-17291978a86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:18.814510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26b090-03ed-4f2b-9bac-17291978a86b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:18.814938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26b090-03ed-4f2b-9bac-17291978a86b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:18.815406 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26b090-03ed-4f2b-9bac-17291978a86b None admin] PATH_INFO: `/v3/groups/3017be6af6364ad2a4f2c33e39d528c8` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:18.816922 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26b090-03ed-4f2b-9bac-17291978a86b None admin] RBAC: Authorizing `identity:get_group(group_id=3017be6af6364ad2a4f2c33e39d528c8)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:18.818550 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26b090-03ed-4f2b-9bac-17291978a86b None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:18.820539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 202/385] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Jul 12 14:21:18 2022] GET /identity/v3/groups/3017be6af6364ad2a4f2c33e39d528c8 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:18.826309 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730a9a2-7865-466c-a328-a4c180f96fb3 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:18.955156 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:18.978619 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730a9a2-7865-466c-a328-a4c180f96fb3 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:19.017301 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d8073-d7b3-483d-af35-b57083b01f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:19.024323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d8073-d7b3-483d-af35-b57083b01f04 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:19.025173 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d8073-d7b3-483d-af35-b57083b01f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:19.025470 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d8073-d7b3-483d-af35-b57083b01f04 None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:19.026853 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d8073-d7b3-483d-af35-b57083b01f04 None admin] RBAC: Authorizing `identity:get_project(project_id=21f896d0c1d8492287fcd5e0801dec94)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:19.028457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d8073-d7b3-483d-af35-b57083b01f04 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:19.030502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 184/386] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:18 2022] GET /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:19.036206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26b090-03ed-4f2b-9bac-17291978a86b None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:19.099068 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:19.171631 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26b090-03ed-4f2b-9bac-17291978a86b None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:19.214885 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c893d84-2599-4f16-a4ac-1ae92b635654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:19.216148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c893d84-2599-4f16-a4ac-1ae92b635654 None admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:19.216634 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c893d84-2599-4f16-a4ac-1ae92b635654 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:19.217110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c893d84-2599-4f16-a4ac-1ae92b635654 None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94/groups/3017be6af6364ad2a4f2c33e39d528c8/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:19.219429 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c893d84-2599-4f16-a4ac-1ae92b635654 None admin] RBAC: Authorizing `identity:create_grant(project_id=21f896d0c1d8492287fcd5e0801dec94, group_id=3017be6af6364ad2a4f2c33e39d528c8, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:19.221091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c893d84-2599-4f16-a4ac-1ae92b635654 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:19.294734 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 203/387] 10.222.0.40 () {58 vars in 1442 bytes} [Tue Jul 12 14:21:19 2022] PUT /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94/groups/3017be6af6364ad2a4f2c33e39d528c8/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:21:19.319032 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bb090-ab2d-4634-8a80-6671da37bb86 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:19.319384 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bb090-ab2d-4634-8a80-6671da37bb86 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:19.319629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bb090-ab2d-4634-8a80-6671da37bb86 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:19.321372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 185/388] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:19.327204 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db37ca-27c8-46ba-a9e7-2d38457de444 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:19.327532 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db37ca-27c8-46ba-a9e7-2d38457de444 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:19.327803 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db37ca-27c8-46ba-a9e7-2d38457de444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:19.353172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-74db37ca-27c8-46ba-a9e7-2d38457de444 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:19.354416 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-74db37ca-27c8-46ba-a9e7-2d38457de444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:19.471912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 204/389] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:19.496648 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bb090-ab2d-4634-8a80-6671da37bb86 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:19.621102 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bb090-ab2d-4634-8a80-6671da37bb86 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:19.664082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d908c5-cd8c-4495-91f8-9834feae897d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:19.665701 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d908c5-cd8c-4495-91f8-9834feae897d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:19.666182 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d908c5-cd8c-4495-91f8-9834feae897d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:19.666690 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d908c5-cd8c-4495-91f8-9834feae897d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:19.678564 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d908c5-cd8c-4495-91f8-9834feae897d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:19.688130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-59d908c5-cd8c-4495-91f8-9834feae897d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:21:19.688130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:19.688130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:19.688130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:19.688130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:19.688130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:19.688130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:19.688130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:19.688130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:19.688130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:19.688130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:19.688130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:19.688130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:19.688130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:19.688130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:19.688130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:19.689018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:19.689018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:19.689018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:19.689018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:19.689018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:19.689018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:19.689018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:19.689018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:19.689018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:19.689018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:19.689018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:19.689018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:19.689018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:19.689018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:19.689018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:19.689018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:19.689850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:19.689850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:19.689850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:19.689850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:19.689850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:19.689850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:19.689850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:19.689850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:19.689850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:19.689850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:19.689850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:21:19.689850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:19.692603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 186/390] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:21:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:19.699507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db37ca-27c8-46ba-a9e7-2d38457de444 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:19.768409 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:19.827595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b342a5-55d0-429d-b0f5-ef42ad96bd13 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:19.828226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b342a5-55d0-429d-b0f5-ef42ad96bd13 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:19.828703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b342a5-55d0-429d-b0f5-ef42ad96bd13 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:19.830628 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 187/391] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:19.836634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406efc4-cfe8-4655-9d6d-26d166ae88e5 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:19.837315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406efc4-cfe8-4655-9d6d-26d166ae88e5 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:19.837810 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406efc4-cfe8-4655-9d6d-26d166ae88e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:19.856270 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-a406efc4-cfe8-4655-9d6d-26d166ae88e5 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:19.857780 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-a406efc4-cfe8-4655-9d6d-26d166ae88e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:19.866364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:19.872079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db37ca-27c8-46ba-a9e7-2d38457de444 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:19.916446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a87b78-b735-48f7-9c54-37ca3ea7802f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:19.917176 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a87b78-b735-48f7-9c54-37ca3ea7802f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:19.917461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a87b78-b735-48f7-9c54-37ca3ea7802f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:19.917786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a87b78-b735-48f7-9c54-37ca3ea7802f None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:19.918559 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a87b78-b735-48f7-9c54-37ca3ea7802f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:19.918869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a87b78-b735-48f7-9c54-37ca3ea7802f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:19.920272 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a87b78-b735-48f7-9c54-37ca3ea7802f None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:19.935976 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 205/392] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:19.941979 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a87b78-b735-48f7-9c54-37ca3ea7802f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:19.988033 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 188/393] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:20.011461 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406efc4-cfe8-4655-9d6d-26d166ae88e5 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:20.143513 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:20.154767 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a87b78-b735-48f7-9c54-37ca3ea7802f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:20.211485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406efc4-cfe8-4655-9d6d-26d166ae88e5 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:20.227998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917fec1-fe9b-42c8-aabd-15fa734e0f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:20.228879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917fec1-fe9b-42c8-aabd-15fa734e0f65 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:20.229162 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917fec1-fe9b-42c8-aabd-15fa734e0f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:20.229438 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917fec1-fe9b-42c8-aabd-15fa734e0f65 None admin] PATH_INFO: `/v3/groups/3017be6af6364ad2a4f2c33e39d528c8` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:20.230677 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917fec1-fe9b-42c8-aabd-15fa734e0f65 None admin] RBAC: Authorizing `identity:get_group(group_id=3017be6af6364ad2a4f2c33e39d528c8)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:20.232158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917fec1-fe9b-42c8-aabd-15fa734e0f65 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:20.234784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 206/394] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Jul 12 14:21:19 2022] GET /identity/v3/groups/3017be6af6364ad2a4f2c33e39d528c8 => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:20.239449 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917fec1-fe9b-42c8-aabd-15fa734e0f65 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:20.272223 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7af4ad-842f-439d-8909-756b1079077d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:20.273044 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7af4ad-842f-439d-8909-756b1079077d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:20.273357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7af4ad-842f-439d-8909-756b1079077d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:20.273647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7af4ad-842f-439d-8909-756b1079077d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:20.296801 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7af4ad-842f-439d-8909-756b1079077d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:20.309511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-2c7af4ad-842f-439d-8909-756b1079077d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:20.309511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:20.309511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:20.309511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:20.309511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:20.309511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:20.309511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:20.309511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:20.309511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:20.309511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:20.309511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:20.309511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:20.309511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:20.309511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:20.309511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:20.309511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:20.311664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:20.311664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:20.311664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:20.311664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:20.311664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:20.311664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:20.311664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:20.311664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:20.311664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:20.311664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:20.311664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:20.311664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:20.311664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:20.311664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:20.311664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:20.311664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:20.313586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:20.313586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:20.313586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:20.313586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:20.313586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:20.313586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:20.313586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:20.313586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:20.313586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:20.313586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:20.313586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:20.313586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:20.313586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 189/395] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:20.323497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7af4ad-842f-439d-8909-756b1079077d None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:20.329359 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:20.442168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917fec1-fe9b-42c8-aabd-15fa734e0f65 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:20.506970 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f5773-16c4-4a2e-baa1-95c53d1c358a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:20.508300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f5773-16c4-4a2e-baa1-95c53d1c358a None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:20.508823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f5773-16c4-4a2e-baa1-95c53d1c358a None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:20.509128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f5773-16c4-4a2e-baa1-95c53d1c358a None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:20.511103 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f5773-16c4-4a2e-baa1-95c53d1c358a None admin] RBAC: Authorizing `identity:get_project(project_id=21f896d0c1d8492287fcd5e0801dec94)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:20.512575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f5773-16c4-4a2e-baa1-95c53d1c358a None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:20.514310 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 207/396] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:20 2022] GET /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:20.520049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7af4ad-842f-439d-8909-756b1079077d None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:20.522300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f5773-16c4-4a2e-baa1-95c53d1c358a None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:20.566239 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095e0cc-776e-4485-b26d-69c8f56c748d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:20.566924 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095e0cc-776e-4485-b26d-69c8f56c748d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:20.567211 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095e0cc-776e-4485-b26d-69c8f56c748d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:20.567523 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095e0cc-776e-4485-b26d-69c8f56c748d None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:20.568293 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095e0cc-776e-4485-b26d-69c8f56c748d None admin] RBAC: Adding query filter params (name=member) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:20.568604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095e0cc-776e-4485-b26d-69c8f56c748d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:20.570004 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095e0cc-776e-4485-b26d-69c8f56c748d None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:20.595118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 190/397] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:21:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:20.599307 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:20.601373 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095e0cc-776e-4485-b26d-69c8f56c748d None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:20.715077 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:20.745968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f5773-16c4-4a2e-baa1-95c53d1c358a None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:20.796694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095e0cc-776e-4485-b26d-69c8f56c748d None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:20.819630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954e1aa-9a91-4c35-ae7f-42f5018cd568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:20.821304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954e1aa-9a91-4c35-ae7f-42f5018cd568 None admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:20.821595 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954e1aa-9a91-4c35-ae7f-42f5018cd568 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:20.822074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954e1aa-9a91-4c35-ae7f-42f5018cd568 None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94/groups/3017be6af6364ad2a4f2c33e39d528c8/roles/6184586642114a188e13c695442669f8` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:20.826986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954e1aa-9a91-4c35-ae7f-42f5018cd568 None admin] RBAC: Authorizing `identity:create_grant(project_id=21f896d0c1d8492287fcd5e0801dec94, group_id=3017be6af6364ad2a4f2c33e39d528c8, role_id=6184586642114a188e13c695442669f8)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:20.828489 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954e1aa-9a91-4c35-ae7f-42f5018cd568 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:20.858470 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255786c-3bc0-4a74-a799-597769fcaa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:20.859431 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255786c-3bc0-4a74-a799-597769fcaa47 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:20.859717 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255786c-3bc0-4a74-a799-597769fcaa47 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:20.859996 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255786c-3bc0-4a74-a799-597769fcaa47 None admin] PATH_INFO: `/v3/groups/3017be6af6364ad2a4f2c33e39d528c8` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:20.864939 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255786c-3bc0-4a74-a799-597769fcaa47 None admin] RBAC: Authorizing `identity:get_group(group_id=3017be6af6364ad2a4f2c33e39d528c8)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:20.864939 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255786c-3bc0-4a74-a799-597769fcaa47 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:20.864939 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 191/398] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Jul 12 14:21:20 2022] GET /identity/v3/groups/3017be6af6364ad2a4f2c33e39d528c8 => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:20.870782 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255786c-3bc0-4a74-a799-597769fcaa47 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:20.909313 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 208/399] 10.222.0.40 () {58 vars in 1442 bytes} [Tue Jul 12 14:21:20 2022] PUT /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94/groups/3017be6af6364ad2a4f2c33e39d528c8/roles/6184586642114a188e13c695442669f8 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:21:20.910638 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c284d-acf1-4732-a683-ff333e9edb67 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:20.910917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c284d-acf1-4732-a683-ff333e9edb67 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:20.911196 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c284d-acf1-4732-a683-ff333e9edb67 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:20.912668 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 209/400] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:20.920960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aac1f5-d250-462d-92ff-4d634f991b18 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:20.921300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aac1f5-d250-462d-92ff-4d634f991b18 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:20.921525 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aac1f5-d250-462d-92ff-4d634f991b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:20.957104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-56aac1f5-d250-462d-92ff-4d634f991b18 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:20.959444 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-56aac1f5-d250-462d-92ff-4d634f991b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:21.041451 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255786c-3bc0-4a74-a799-597769fcaa47 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:21.079856 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 210/401] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:21.100741 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:21.107248 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aac1f5-d250-462d-92ff-4d634f991b18 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:21.107886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2bad0-3ea7-4bfb-b7a3-eb11c754c229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:21.109052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2bad0-3ea7-4bfb-b7a3-eb11c754c229 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:21.109548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2bad0-3ea7-4bfb-b7a3-eb11c754c229 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:21.109975 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2bad0-3ea7-4bfb-b7a3-eb11c754c229 None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:21.111403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2bad0-3ea7-4bfb-b7a3-eb11c754c229 None admin] RBAC: Authorizing `identity:get_project(project_id=a67548b777b24c2d88cd5789350f5c35)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:21.113075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2bad0-3ea7-4bfb-b7a3-eb11c754c229 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:21.115260 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 192/402] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:20 2022] GET /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:21.120859 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2bad0-3ea7-4bfb-b7a3-eb11c754c229 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:21.137850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:21.241729 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2bad0-3ea7-4bfb-b7a3-eb11c754c229 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:21.282353 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9d13e-b3fc-478c-840e-c87a56836853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:21.283569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9d13e-b3fc-478c-840e-c87a56836853 None admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:21.283951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9d13e-b3fc-478c-840e-c87a56836853 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:21.284326 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9d13e-b3fc-478c-840e-c87a56836853 None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35/groups/3017be6af6364ad2a4f2c33e39d528c8/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:21.286442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9d13e-b3fc-478c-840e-c87a56836853 None admin] RBAC: Authorizing `identity:create_grant(project_id=a67548b777b24c2d88cd5789350f5c35, group_id=3017be6af6364ad2a4f2c33e39d528c8, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:21.288020 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9d13e-b3fc-478c-840e-c87a56836853 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:21.288392 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aac1f5-d250-462d-92ff-4d634f991b18 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:21.325254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f598b60-1dfc-4e63-913b-12842c3fadda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:21.326062 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f598b60-1dfc-4e63-913b-12842c3fadda None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:21.326340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f598b60-1dfc-4e63-913b-12842c3fadda None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:21.326613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f598b60-1dfc-4e63-913b-12842c3fadda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:21.338145 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f598b60-1dfc-4e63-913b-12842c3fadda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:21.346337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-8f598b60-1dfc-4e63-913b-12842c3fadda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:21:21.346337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:21.346337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:21.346337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:21.346337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:21.346337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:21.346337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:21.346337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:21.346337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:21.346337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:21.346337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:21.346337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:21.346337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:21.346337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:21.346337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:21.346337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:21.347614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:21.347614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:21.347614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:21.347614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:21.347614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:21.347614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:21.347614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:21.347614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:21.347614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:21.347614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:21.347614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:21.347614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:21.347614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:21.347614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:21.347614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:21.347614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:21.348398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:21.348398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:21.348398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:21.348398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:21.348398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:21.348398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:21.348398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:21.348398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:21.348398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:21.348398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:21.348398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:21:21.348398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:21.348398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 211/403] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:21:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:21.353368 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b1a5a-04a1-45c5-80aa-44206319356b None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:21.353368 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b1a5a-04a1-45c5-80aa-44206319356b None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:21.353368 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b1a5a-04a1-45c5-80aa-44206319356b None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:21.353368 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 212/404] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:21.356005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b1a5a-04a1-45c5-80aa-44206319356b None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:21.415685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 193/405] 10.222.0.40 () {58 vars in 1442 bytes} [Tue Jul 12 14:21:21 2022] PUT /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35/groups/3017be6af6364ad2a4f2c33e39d528c8/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:21:21.417396 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb88266-2a2a-496f-8882-9255d3fba751 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:21.418020 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb88266-2a2a-496f-8882-9255d3fba751 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:21.418311 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb88266-2a2a-496f-8882-9255d3fba751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:21.459433 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-ddb88266-2a2a-496f-8882-9255d3fba751 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:21.466845 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ddb88266-2a2a-496f-8882-9255d3fba751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:21.487581 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:21.525981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b1a5a-04a1-45c5-80aa-44206319356b None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:21.564048 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb0ba1-353d-4ce6-84bb-dc8f3bb47e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:21.564733 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb0ba1-353d-4ce6-84bb-dc8f3bb47e35 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:21.565014 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb0ba1-353d-4ce6-84bb-dc8f3bb47e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:21.565288 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb0ba1-353d-4ce6-84bb-dc8f3bb47e35 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:21.566392 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb0ba1-353d-4ce6-84bb-dc8f3bb47e35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:21.566392 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb0ba1-353d-4ce6-84bb-dc8f3bb47e35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:21.569072 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb0ba1-353d-4ce6-84bb-dc8f3bb47e35 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:21.577871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 213/406] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:21.582228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:21.584420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb0ba1-353d-4ce6-84bb-dc8f3bb47e35 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:21.614157 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 194/407] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:21.642245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec81527-f1ff-4c0c-8433-6003bc0a55fc None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:21.642544 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec81527-f1ff-4c0c-8433-6003bc0a55fc None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:21.642801 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec81527-f1ff-4c0c-8433-6003bc0a55fc None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:21.644377 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 195/408] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:21.647383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec81527-f1ff-4c0c-8433-6003bc0a55fc None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:21.722167 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb0ba1-353d-4ce6-84bb-dc8f3bb47e35 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:21.767026 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec81527-f1ff-4c0c-8433-6003bc0a55fc None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:21.767574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764d429-ef24-43ae-8672-de833d3f2eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:21.768444 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764d429-ef24-43ae-8672-de833d3f2eae None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:21.768727 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764d429-ef24-43ae-8672-de833d3f2eae None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:21.769002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764d429-ef24-43ae-8672-de833d3f2eae None admin] PATH_INFO: `/v3/groups/3017be6af6364ad2a4f2c33e39d528c8` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:21.770501 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764d429-ef24-43ae-8672-de833d3f2eae None admin] RBAC: Authorizing `identity:get_group(group_id=3017be6af6364ad2a4f2c33e39d528c8)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:21.772906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764d429-ef24-43ae-8672-de833d3f2eae None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:21.775202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 214/409] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Jul 12 14:21:21 2022] GET /identity/v3/groups/3017be6af6364ad2a4f2c33e39d528c8 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:21.776581 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef50c5-70b3-470b-8980-951587cc4e74 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:21.776874 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef50c5-70b3-470b-8980-951587cc4e74 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:21.777157 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef50c5-70b3-470b-8980-951587cc4e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:21.799637 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-e9ef50c5-70b3-470b-8980-951587cc4e74 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:21.801084 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e9ef50c5-70b3-470b-8980-951587cc4e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:21.810594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f815b66-3c27-40fa-b637-2899ce843985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:21.811821 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f815b66-3c27-40fa-b637-2899ce843985 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:21.812351 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f815b66-3c27-40fa-b637-2899ce843985 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:21.812838 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f815b66-3c27-40fa-b637-2899ce843985 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:21.813347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:21.827696 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f815b66-3c27-40fa-b637-2899ce843985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:21.836684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-6f815b66-3c27-40fa-b637-2899ce843985 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:21.836684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:21.836684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:21.836684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:21.836684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:21.836684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:21.836684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:21.836684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:21.836684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:21.836684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:21.836684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:21.836684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:21.836684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:21.836684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:21.836684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:21.836684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:21.837695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:21.837695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:21.837695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:21.837695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:21.837695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:21.837695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:21.837695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:21.837695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:21.837695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:21.837695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:21.837695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:21.837695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:21.837695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:21.837695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:21.837695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:21.837695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:21.838467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:21.838467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:21.838467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:21.838467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:21.838467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:21.838467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:21.838467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:21.838467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:21.838467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:21.838467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:21.838467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:21.838467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:21.841506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 196/410] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:21:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:21.842667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f815b66-3c27-40fa-b637-2899ce843985 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:21.891370 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 215/411] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:21.892839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef50c5-70b3-470b-8980-951587cc4e74 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:21.908732 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:21.991318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f815b66-3c27-40fa-b637-2899ce843985 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:22.021051 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef50c5-70b3-470b-8980-951587cc4e74 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:22.029265 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76dc9d-800c-4c23-a81b-8d9bd52fbafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:22.030657 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76dc9d-800c-4c23-a81b-8d9bd52fbafc None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:22.030941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76dc9d-800c-4c23-a81b-8d9bd52fbafc None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:22.031218 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76dc9d-800c-4c23-a81b-8d9bd52fbafc None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:22.032960 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76dc9d-800c-4c23-a81b-8d9bd52fbafc None admin] RBAC: Authorizing `identity:get_project(project_id=a67548b777b24c2d88cd5789350f5c35)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:22.035229 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76dc9d-800c-4c23-a81b-8d9bd52fbafc None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:22.038376 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 197/412] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:21 2022] GET /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:22.039823 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76dc9d-800c-4c23-a81b-8d9bd52fbafc None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:22.058825 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fa839-bbcd-433e-8cd5-6aee1b3f1ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:22.059616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fa839-bbcd-433e-8cd5-6aee1b3f1ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:22.059967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fa839-bbcd-433e-8cd5-6aee1b3f1ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:22.060318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fa839-bbcd-433e-8cd5-6aee1b3f1ee0 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:22.061155 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fa839-bbcd-433e-8cd5-6aee1b3f1ee0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:22.061524 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fa839-bbcd-433e-8cd5-6aee1b3f1ee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:22.062956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fa839-bbcd-433e-8cd5-6aee1b3f1ee0 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:22.072935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 216/413] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:22.073821 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fa839-bbcd-433e-8cd5-6aee1b3f1ee0 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:22.084375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:22.182003 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fa839-bbcd-433e-8cd5-6aee1b3f1ee0 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:22.186525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76dc9d-800c-4c23-a81b-8d9bd52fbafc None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:22.208907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:22.220380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26937169-617a-4526-92c0-84896f3f5089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:22.236742 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26937169-617a-4526-92c0-84896f3f5089 None admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:22.236742 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26937169-617a-4526-92c0-84896f3f5089 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:22.236742 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26937169-617a-4526-92c0-84896f3f5089 None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35/groups/3017be6af6364ad2a4f2c33e39d528c8/roles/6184586642114a188e13c695442669f8` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:22.236742 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26937169-617a-4526-92c0-84896f3f5089 None admin] RBAC: Authorizing `identity:create_grant(project_id=a67548b777b24c2d88cd5789350f5c35, group_id=3017be6af6364ad2a4f2c33e39d528c8, role_id=6184586642114a188e13c695442669f8)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:22.236742 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26937169-617a-4526-92c0-84896f3f5089 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:22.237106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185043b6-576d-4801-a587-5f7fe4c0643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:22.237106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185043b6-576d-4801-a587-5f7fe4c0643f None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:22.237106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185043b6-576d-4801-a587-5f7fe4c0643f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:22.237106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185043b6-576d-4801-a587-5f7fe4c0643f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:22.241427 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185043b6-576d-4801-a587-5f7fe4c0643f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:22.251310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-185043b6-576d-4801-a587-5f7fe4c0643f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:22.251310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:22.251310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:22.251310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:22.251310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:22.251310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:22.251310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:22.251310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:22.251310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:22.251310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:22.251310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:22.251310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:22.251310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:22.251310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:22.251310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:22.251310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:22.252263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:22.252263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:22.252263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:22.252263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:22.252263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:22.252263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:22.252263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:22.252263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:22.252263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:22.252263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:22.252263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:22.252263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:22.252263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:22.252263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:22.252263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:22.252263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:22.253072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:22.253072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:22.253072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:22.253072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:22.253072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:22.253072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:22.253072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:22.253072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:22.253072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:22.253072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:22.253072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:22.253072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:22.253072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 198/414] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:22.253072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185043b6-576d-4801-a587-5f7fe4c0643f None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:22.323939 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 217/415] 10.222.0.40 () {58 vars in 1442 bytes} [Tue Jul 12 14:21:22 2022] PUT /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35/groups/3017be6af6364ad2a4f2c33e39d528c8/roles/6184586642114a188e13c695442669f8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:21:22.325065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26937169-617a-4526-92c0-84896f3f5089 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:22.386522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185043b6-576d-4801-a587-5f7fe4c0643f None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:22.403383 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:22.430640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770547f-406c-4526-b8fe-0284b0e520d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:22.431546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770547f-406c-4526-b8fe-0284b0e520d3 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:22.431830 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770547f-406c-4526-b8fe-0284b0e520d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:22.432160 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770547f-406c-4526-b8fe-0284b0e520d3 None admin] PATH_INFO: `/v3/groups/d73d46ff350c422fadc311f221ecc64c` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:22.433486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770547f-406c-4526-b8fe-0284b0e520d3 None admin] RBAC: Authorizing `identity:get_group(group_id=d73d46ff350c422fadc311f221ecc64c)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:22.435041 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770547f-406c-4526-b8fe-0284b0e520d3 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:22.437139 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 199/416] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Jul 12 14:21:22 2022] GET /identity/v3/groups/d73d46ff350c422fadc311f221ecc64c => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:22.442470 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770547f-406c-4526-b8fe-0284b0e520d3 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:22.461322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26937169-617a-4526-92c0-84896f3f5089 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:22.529239 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:22.563624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570647c9-1b1c-436b-8762-9e2aea366e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:22.564303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570647c9-1b1c-436b-8762-9e2aea366e8b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:22.564590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570647c9-1b1c-436b-8762-9e2aea366e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:22.564865 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570647c9-1b1c-436b-8762-9e2aea366e8b None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:22.565632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570647c9-1b1c-436b-8762-9e2aea366e8b None admin] RBAC: Adding query filter params (name=member) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:22.565936 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570647c9-1b1c-436b-8762-9e2aea366e8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:22.567317 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570647c9-1b1c-436b-8762-9e2aea366e8b None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:22.580758 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 218/417] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:21:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:22.587044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570647c9-1b1c-436b-8762-9e2aea366e8b None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:22.596330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770547f-406c-4526-b8fe-0284b0e520d3 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:22.641714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371f75-a4d1-423f-b966-1fc30c8b32af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:22.642936 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371f75-a4d1-423f-b966-1fc30c8b32af None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:22.643493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371f75-a4d1-423f-b966-1fc30c8b32af None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:22.643983 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371f75-a4d1-423f-b966-1fc30c8b32af None admin] PATH_INFO: `/v3/projects/e19a2306c9b043c3b84bdeaf0a418bdb` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:22.650841 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff371f75-a4d1-423f-b966-1fc30c8b32af None admin] RBAC: Authorizing `identity:get_project(project_id=e19a2306c9b043c3b84bdeaf0a418bdb)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:22.652869 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff371f75-a4d1-423f-b966-1fc30c8b32af None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:22.655220 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 200/418] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:22 2022] GET /identity/v3/projects/e19a2306c9b043c3b84bdeaf0a418bdb => generated 344 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:22.660398 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371f75-a4d1-423f-b966-1fc30c8b32af None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:22.713111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570647c9-1b1c-436b-8762-9e2aea366e8b None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:22.751639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:22.780006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c901a8c-8be1-4866-99fb-abeab2941724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:22.780671 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c901a8c-8be1-4866-99fb-abeab2941724 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:22.780954 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c901a8c-8be1-4866-99fb-abeab2941724 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:22.781231 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c901a8c-8be1-4866-99fb-abeab2941724 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:22.869503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371f75-a4d1-423f-b966-1fc30c8b32af None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:22.870019 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c901a8c-8be1-4866-99fb-abeab2941724 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:22.871829 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c901a8c-8be1-4866-99fb-abeab2941724 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:22.906816 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:22.934336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7a75d-1a07-4707-ac07-9bfcfe076f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:22.935598 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7a75d-1a07-4707-ac07-9bfcfe076f19 None admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:22.935889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7a75d-1a07-4707-ac07-9bfcfe076f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:22.936168 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7a75d-1a07-4707-ac07-9bfcfe076f19 None admin] PATH_INFO: `/v3/projects/e19a2306c9b043c3b84bdeaf0a418bdb/groups/d73d46ff350c422fadc311f221ecc64c/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:22.938481 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7a75d-1a07-4707-ac07-9bfcfe076f19 None admin] RBAC: Authorizing `identity:create_grant(project_id=e19a2306c9b043c3b84bdeaf0a418bdb, group_id=d73d46ff350c422fadc311f221ecc64c, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:22.940138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7a75d-1a07-4707-ac07-9bfcfe076f19 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:23.002749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 219/419] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 14:21:23.012338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c901a8c-8be1-4866-99fb-abeab2941724 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:23.033133 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 201/420] 10.222.0.40 () {58 vars in 1442 bytes} [Tue Jul 12 14:21:22 2022] PUT /identity/v3/projects/e19a2306c9b043c3b84bdeaf0a418bdb/groups/d73d46ff350c422fadc311f221ecc64c/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:21:23.051778 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:23.133907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c901a8c-8be1-4866-99fb-abeab2941724 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:23.171743 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e64381-30e2-486d-96d8-ea19b1b745ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:23.172629 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e64381-30e2-486d-96d8-ea19b1b745ed None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:23.172913 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e64381-30e2-486d-96d8-ea19b1b745ed None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:23.173189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e64381-30e2-486d-96d8-ea19b1b745ed None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:23.174476 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e64381-30e2-486d-96d8-ea19b1b745ed None admin] RBAC: Authorizing `identity:get_project(project_id=21f896d0c1d8492287fcd5e0801dec94)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:23.176002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e64381-30e2-486d-96d8-ea19b1b745ed None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:23.178103 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 220/421] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:23 2022] GET /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:23.184115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7a75d-1a07-4707-ac07-9bfcfe076f19 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:23.325904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7a75d-1a07-4707-ac07-9bfcfe076f19 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:23.363122 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ed201-dcb7-4808-9e24-fa6454c57dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:23.364016 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ed201-dcb7-4808-9e24-fa6454c57dfb None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:23.364299 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ed201-dcb7-4808-9e24-fa6454c57dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:23.364581 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ed201-dcb7-4808-9e24-fa6454c57dfb None admin] PATH_INFO: `/v3/groups/3017be6af6364ad2a4f2c33e39d528c8` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:23.365786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ed201-dcb7-4808-9e24-fa6454c57dfb None admin] RBAC: Authorizing `identity:get_group(group_id=3017be6af6364ad2a4f2c33e39d528c8)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:23.367778 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ed201-dcb7-4808-9e24-fa6454c57dfb None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:23.369892 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 202/422] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Jul 12 14:21:23 2022] GET /identity/v3/groups/3017be6af6364ad2a4f2c33e39d528c8 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:23.375843 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e64381-30e2-486d-96d8-ea19b1b745ed None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:23.452264 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd74e77-c6da-4936-94b0-da3168854706 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:23.452604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd74e77-c6da-4936-94b0-da3168854706 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:23.452878 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd74e77-c6da-4936-94b0-da3168854706 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:23.454369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 203/423] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:23.459549 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92834019-245c-44b3-952c-6b14aa8c98d3 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:23.460099 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92834019-245c-44b3-952c-6b14aa8c98d3 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:23.460569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92834019-245c-44b3-952c-6b14aa8c98d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:23.478934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-92834019-245c-44b3-952c-6b14aa8c98d3 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:23.480458 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-92834019-245c-44b3-952c-6b14aa8c98d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:23.497658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:23.506219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e64381-30e2-486d-96d8-ea19b1b745ed None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:23.544263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:23.552024 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6e471-f839-40c8-b8a0-6e37cc193edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:23.552687 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6e471-f839-40c8-b8a0-6e37cc193edc None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:23.553031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6e471-f839-40c8-b8a0-6e37cc193edc None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:23.553296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6e471-f839-40c8-b8a0-6e37cc193edc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:23.554136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6e471-f839-40c8-b8a0-6e37cc193edc None admin] RBAC: Adding query filter params (group.id=3017be6af6364ad2a4f2c33e39d528c8, role.id=5444412a1f604ebaa9282a244859c051, scope.project.id=21f896d0c1d8492287fcd5e0801dec94) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:23.554492 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6e471-f839-40c8-b8a0-6e37cc193edc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:23.556465 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6e471-f839-40c8-b8a0-6e37cc193edc None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:23.567480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 221/424] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Jul 12 14:21:23 2022] GET /identity/v3/role_assignments?group.id=3017be6af6364ad2a4f2c33e39d528c8&scope.project.id=21f896d0c1d8492287fcd5e0801dec94&role.id=5444412a1f604ebaa9282a244859c051 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:23.592749 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 204/425] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:21:23.618061 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6e471-f839-40c8-b8a0-6e37cc193edc None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:23.762292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25814fa7-2cbe-45fd-b076-9083c658f374 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:23.762578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25814fa7-2cbe-45fd-b076-9083c658f374 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:23.762856 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25814fa7-2cbe-45fd-b076-9083c658f374 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:23.764262 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 205/426] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:23.776965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc12d47-e974-4dba-a7e6-3feae405cb93 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:23.777266 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc12d47-e974-4dba-a7e6-3feae405cb93 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:23.777529 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc12d47-e974-4dba-a7e6-3feae405cb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:23.794966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6e471-f839-40c8-b8a0-6e37cc193edc None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:23.797017 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-ffc12d47-e974-4dba-a7e6-3feae405cb93 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:23.799310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ffc12d47-e974-4dba-a7e6-3feae405cb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:23.842672 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1704c4-2c69-4161-8314-1f478b62ef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:23.844600 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1704c4-2c69-4161-8314-1f478b62ef08 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:23.845097 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1704c4-2c69-4161-8314-1f478b62ef08 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:23.845576 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1704c4-2c69-4161-8314-1f478b62ef08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:23.859151 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1704c4-2c69-4161-8314-1f478b62ef08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:23.871222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-1f1704c4-2c69-4161-8314-1f478b62ef08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:21:23.871222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:23.871222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:23.871222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:23.871222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:23.871222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:23.871222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:23.871222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:23.871222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:23.871222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:23.871222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:23.871222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:23.871222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:23.871222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:23.871222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:23.871222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:23.872228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:23.872228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:23.872228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:23.872228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:23.872228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:23.872228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:23.872228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:23.872228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:23.872228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:23.872228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:23.872228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:23.872228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:23.872228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:23.872228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:23.872228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:23.872228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:23.873026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:23.873026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:23.873026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:23.873026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:23.873026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:23.873026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:23.873026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:23.873026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:23.873026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:23.873026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:23.873026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:21:23.873026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:23.883544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 222/427] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:21:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:23.883744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1704c4-2c69-4161-8314-1f478b62ef08 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:23.905660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 206/428] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:23.914357 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:23.931764 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc12d47-e974-4dba-a7e6-3feae405cb93 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:24.019056 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1704c4-2c69-4161-8314-1f478b62ef08 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:24.052270 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc12d47-e974-4dba-a7e6-3feae405cb93 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:24.053990 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:24.071159 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ca797-07de-41a5-9026-549c06cf7b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:24.072338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ca797-07de-41a5-9026-549c06cf7b66 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:24.072674 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ca797-07de-41a5-9026-549c06cf7b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:24.072957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ca797-07de-41a5-9026-549c06cf7b66 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:24.073904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ca797-07de-41a5-9026-549c06cf7b66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:24.074614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ca797-07de-41a5-9026-549c06cf7b66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:24.076303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ca797-07de-41a5-9026-549c06cf7b66 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:24.088845 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 223/429] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:24.094725 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ca797-07de-41a5-9026-549c06cf7b66 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:24.112466 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed43af-e118-4fa5-95f9-6e16e96c717e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:24.113613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed43af-e118-4fa5-95f9-6e16e96c717e None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:24.113952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed43af-e118-4fa5-95f9-6e16e96c717e None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:24.114233 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed43af-e118-4fa5-95f9-6e16e96c717e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:24.130754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed43af-e118-4fa5-95f9-6e16e96c717e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:24.140789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-86ed43af-e118-4fa5-95f9-6e16e96c717e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:24.140789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:24.140789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:24.140789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:24.140789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:24.140789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:24.140789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:24.140789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:24.140789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:24.140789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:24.140789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:24.140789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:24.140789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:24.140789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:24.140789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:24.140789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:24.141738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:24.141738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:24.141738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:24.141738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:24.141738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:24.141738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:24.141738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:24.141738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:24.141738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:24.141738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:24.141738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:24.141738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:24.141738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:24.141738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:24.141738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:24.141738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:24.142517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:24.142517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:24.142517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:24.142517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:24.142517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:24.142517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:24.142517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:24.142517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:24.142517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:24.142517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:24.142517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 14:21:24.142517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:24.143432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 207/430] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:24.152357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed43af-e118-4fa5-95f9-6e16e96c717e None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:24.223676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:24.232338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ca797-07de-41a5-9026-549c06cf7b66 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:24.283049 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145dbba-ed2a-4e68-bde5-bfeff263bdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:24.283817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145dbba-ed2a-4e68-bde5-bfeff263bdbb None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:24.284106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145dbba-ed2a-4e68-bde5-bfeff263bdbb None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:24.284454 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145dbba-ed2a-4e68-bde5-bfeff263bdbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:24.291207 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed43af-e118-4fa5-95f9-6e16e96c717e None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:24.337767 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faafbfb-bf23-4994-8c78-4f7bb758ce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:24.338842 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faafbfb-bf23-4994-8c78-4f7bb758ce7d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:24.339134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faafbfb-bf23-4994-8c78-4f7bb758ce7d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:24.339609 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faafbfb-bf23-4994-8c78-4f7bb758ce7d None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:24.340564 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faafbfb-bf23-4994-8c78-4f7bb758ce7d None admin] RBAC: Adding query filter params (name=member) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:24.341036 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faafbfb-bf23-4994-8c78-4f7bb758ce7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:24.342725 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faafbfb-bf23-4994-8c78-4f7bb758ce7d None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:24.355063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 208/431] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:21:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:24.361615 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faafbfb-bf23-4994-8c78-4f7bb758ce7d None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:24.370177 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145dbba-ed2a-4e68-bde5-bfeff263bdbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:24.372018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145dbba-ed2a-4e68-bde5-bfeff263bdbb None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:24.399463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:24.484996 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:24.509704 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faafbfb-bf23-4994-8c78-4f7bb758ce7d None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:24.515304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 224/432] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:24.521362 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145dbba-ed2a-4e68-bde5-bfeff263bdbb None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:24.552317 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0281b92-2520-4dcf-bec0-168b8687f72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:24.553459 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0281b92-2520-4dcf-bec0-168b8687f72a None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:24.553930 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0281b92-2520-4dcf-bec0-168b8687f72a None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:24.555365 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0281b92-2520-4dcf-bec0-168b8687f72a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:24.648970 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0281b92-2520-4dcf-bec0-168b8687f72a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:24.649457 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145dbba-ed2a-4e68-bde5-bfeff263bdbb None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:24.651633 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0281b92-2520-4dcf-bec0-168b8687f72a None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:24.686179 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:24.690050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839db416-6dae-4ccb-80e1-5a0636feecc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:24.691038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839db416-6dae-4ccb-80e1-5a0636feecc3 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:24.691411 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839db416-6dae-4ccb-80e1-5a0636feecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:24.691746 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839db416-6dae-4ccb-80e1-5a0636feecc3 None admin] PATH_INFO: `/v3/projects/21f896d0c1d8492287fcd5e0801dec94` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:24.693029 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839db416-6dae-4ccb-80e1-5a0636feecc3 None admin] RBAC: Authorizing `identity:get_project(project_id=21f896d0c1d8492287fcd5e0801dec94)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:24.694628 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839db416-6dae-4ccb-80e1-5a0636feecc3 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:24.696920 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 225/433] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:24 2022] GET /identity/v3/projects/21f896d0c1d8492287fcd5e0801dec94 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:24.708476 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839db416-6dae-4ccb-80e1-5a0636feecc3 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:24.770344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:24.787720 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 209/434] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:24.789082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0281b92-2520-4dcf-bec0-168b8687f72a None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:24.823105 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839db416-6dae-4ccb-80e1-5a0636feecc3 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:24.858904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f0130-9b10-43fa-a494-d5c51cde3e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:24.860038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f0130-9b10-43fa-a494-d5c51cde3e8d None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:24.860487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f0130-9b10-43fa-a494-d5c51cde3e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:24.860896 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f0130-9b10-43fa-a494-d5c51cde3e8d None admin] PATH_INFO: `/v3/groups/3017be6af6364ad2a4f2c33e39d528c8` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:24.862218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f0130-9b10-43fa-a494-d5c51cde3e8d None admin] RBAC: Authorizing `identity:get_group(group_id=3017be6af6364ad2a4f2c33e39d528c8)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:24.863830 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f0130-9b10-43fa-a494-d5c51cde3e8d None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:24.865872 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 226/435] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Jul 12 14:21:24 2022] GET /identity/v3/groups/3017be6af6364ad2a4f2c33e39d528c8 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:24.873442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f0130-9b10-43fa-a494-d5c51cde3e8d None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:24.904786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0281b92-2520-4dcf-bec0-168b8687f72a None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:24.931302 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:24.943410 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51a67d-174f-456a-ab75-3cdb1909c6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:24.944286 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51a67d-174f-456a-ab75-3cdb1909c6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:24.944575 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51a67d-174f-456a-ab75-3cdb1909c6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:24.944855 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51a67d-174f-456a-ab75-3cdb1909c6b4 None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:24.947170 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51a67d-174f-456a-ab75-3cdb1909c6b4 None admin] RBAC: Authorizing `identity:get_project(project_id=a67548b777b24c2d88cd5789350f5c35)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:24.948692 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51a67d-174f-456a-ab75-3cdb1909c6b4 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:24.950454 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 210/436] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:24 2022] GET /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:24.951669 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deaeadb-f74b-430e-8bf1-819e348d2e6c None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:24.951960 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deaeadb-f74b-430e-8bf1-819e348d2e6c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:24.952242 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deaeadb-f74b-430e-8bf1-819e348d2e6c None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:24.957708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 211/437] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:24.957708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deaeadb-f74b-430e-8bf1-819e348d2e6c None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:24.994794 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f0130-9b10-43fa-a494-d5c51cde3e8d None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:25.014205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:25.033444 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6994c-7861-421a-9c41-f122790482b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:25.034203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6994c-7861-421a-9c41-f122790482b2 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:25.034487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6994c-7861-421a-9c41-f122790482b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:25.035562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6994c-7861-421a-9c41-f122790482b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:25.035839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6994c-7861-421a-9c41-f122790482b2 None admin] RBAC: Adding query filter params (group.id=3017be6af6364ad2a4f2c33e39d528c8, role.id=6184586642114a188e13c695442669f8, scope.project.id=21f896d0c1d8492287fcd5e0801dec94) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:25.036155 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6994c-7861-421a-9c41-f122790482b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:25.037712 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6994c-7861-421a-9c41-f122790482b2 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:25.055322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 227/438] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Jul 12 14:21:24 2022] GET /identity/v3/role_assignments?group.id=3017be6af6364ad2a4f2c33e39d528c8&scope.project.id=21f896d0c1d8492287fcd5e0801dec94&role.id=6184586642114a188e13c695442669f8 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:25.055322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77659441-b101-4f4e-a631-1139a8d217f2 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:25.055322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77659441-b101-4f4e-a631-1139a8d217f2 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:25.055322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77659441-b101-4f4e-a631-1139a8d217f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:25.075650 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-77659441-b101-4f4e-a631-1139a8d217f2 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:25.075970 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-77659441-b101-4f4e-a631-1139a8d217f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:25.082991 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deaeadb-f74b-430e-8bf1-819e348d2e6c None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:25.122682 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e0ad8-3cee-4e97-95ce-e64bc3b8eac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:25.124101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e0ad8-3cee-4e97-95ce-e64bc3b8eac1 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:25.124487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e0ad8-3cee-4e97-95ce-e64bc3b8eac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:25.124862 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e0ad8-3cee-4e97-95ce-e64bc3b8eac1 None admin] PATH_INFO: `/v3/groups/3017be6af6364ad2a4f2c33e39d528c8` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:25.126315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e0ad8-3cee-4e97-95ce-e64bc3b8eac1 None admin] RBAC: Authorizing `identity:get_group(group_id=3017be6af6364ad2a4f2c33e39d528c8)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:25.129118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e0ad8-3cee-4e97-95ce-e64bc3b8eac1 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:25.130193 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 212/439] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Jul 12 14:21:24 2022] GET /identity/v3/groups/3017be6af6364ad2a4f2c33e39d528c8 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:25.141101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e0ad8-3cee-4e97-95ce-e64bc3b8eac1 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:25.175426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 228/440] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:25.194351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77659441-b101-4f4e-a631-1139a8d217f2 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:25.218456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:25.268530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e0ad8-3cee-4e97-95ce-e64bc3b8eac1 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:25.315545 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e269a7-b558-4512-895f-a71454119f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:25.316423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e269a7-b558-4512-895f-a71454119f3c None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:25.316793 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e269a7-b558-4512-895f-a71454119f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:25.317141 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e269a7-b558-4512-895f-a71454119f3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:25.318328 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e269a7-b558-4512-895f-a71454119f3c None admin] RBAC: Adding query filter params (group.id=3017be6af6364ad2a4f2c33e39d528c8, role.id=5444412a1f604ebaa9282a244859c051, scope.project.id=a67548b777b24c2d88cd5789350f5c35) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:25.318711 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e269a7-b558-4512-895f-a71454119f3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:25.321944 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e269a7-b558-4512-895f-a71454119f3c None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:25.339308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 213/441] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Jul 12 14:21:25 2022] GET /identity/v3/role_assignments?group.id=3017be6af6364ad2a4f2c33e39d528c8&scope.project.id=a67548b777b24c2d88cd5789350f5c35&role.id=5444412a1f604ebaa9282a244859c051 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:25.342021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77659441-b101-4f4e-a631-1139a8d217f2 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:25.359637 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:25.383733 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2a930-9d8f-4989-8212-3845703eb0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:25.384582 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2a930-9d8f-4989-8212-3845703eb0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:25.384858 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2a930-9d8f-4989-8212-3845703eb0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:25.385125 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2a930-9d8f-4989-8212-3845703eb0a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:25.398110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2a930-9d8f-4989-8212-3845703eb0a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:25.407426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-8eb2a930-9d8f-4989-8212-3845703eb0a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:21:25.407426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:25.407426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:25.407426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:25.407426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:25.407426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:25.407426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:25.407426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:25.407426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:25.407426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:25.407426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:25.407426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:25.407426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:25.407426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:25.407426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:25.407426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:25.408456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:25.408456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:25.408456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:25.408456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:25.408456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:25.408456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:25.408456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:25.408456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:25.408456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:25.408456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:25.408456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:25.408456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:25.408456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:25.408456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:25.408456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:25.408456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:25.409229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:25.409229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:25.409229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:25.409229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:25.409229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:25.409229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:25.409229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:25.409229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:25.409229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:25.409229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:25.409229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:21:25.409229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:25.409229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 229/442] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:21:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:25.415720 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e269a7-b558-4512-895f-a71454119f3c None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:25.532515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e269a7-b558-4512-895f-a71454119f3c None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:25.559854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:25.570724 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c145827-a7e0-4b81-b3c5-30bf896565aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:25.574011 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c145827-a7e0-4b81-b3c5-30bf896565aa None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:25.574011 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c145827-a7e0-4b81-b3c5-30bf896565aa None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:25.574011 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c145827-a7e0-4b81-b3c5-30bf896565aa None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:25.574011 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c145827-a7e0-4b81-b3c5-30bf896565aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:25.574011 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c145827-a7e0-4b81-b3c5-30bf896565aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:25.574667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c145827-a7e0-4b81-b3c5-30bf896565aa None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:25.576757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b2d73-c5dc-4c10-bab5-0c6baeb8721e None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:25.577050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b2d73-c5dc-4c10-bab5-0c6baeb8721e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:25.577328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b2d73-c5dc-4c10-bab5-0c6baeb8721e None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:25.578696 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 230/443] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:25.583937 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 214/444] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:25.585036 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c5eed-8c3e-4c67-825a-168f611a7898 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:25.585324 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c5eed-8c3e-4c67-825a-168f611a7898 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:25.585602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c5eed-8c3e-4c67-825a-168f611a7898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:25.591202 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c145827-a7e0-4b81-b3c5-30bf896565aa None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:25.606590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-2e7c5eed-8c3e-4c67-825a-168f611a7898 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:25.607819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-2e7c5eed-8c3e-4c67-825a-168f611a7898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:25.709519 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 231/445] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:21:25.723200 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c145827-a7e0-4b81-b3c5-30bf896565aa None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:25.734990 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c5eed-8c3e-4c67-825a-168f611a7898 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:25.762836 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38646a7a-ae14-4851-8b5e-c1d7463d59dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:25.763524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38646a7a-ae14-4851-8b5e-c1d7463d59dc None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:25.763812 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38646a7a-ae14-4851-8b5e-c1d7463d59dc None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:25.764089 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38646a7a-ae14-4851-8b5e-c1d7463d59dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:25.818640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:25.832901 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38646a7a-ae14-4851-8b5e-c1d7463d59dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:25.834456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38646a7a-ae14-4851-8b5e-c1d7463d59dc None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:25.837445 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c5eed-8c3e-4c67-825a-168f611a7898 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:25.838962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:25.872727 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf85ce-e349-4f26-a2a8-4d5495d85a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:25.873528 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf85ce-e349-4f26-a2a8-4d5495d85a16 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:25.873822 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf85ce-e349-4f26-a2a8-4d5495d85a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:25.874305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf85ce-e349-4f26-a2a8-4d5495d85a16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:25.885393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf85ce-e349-4f26-a2a8-4d5495d85a16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:25.893023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-25cf85ce-e349-4f26-a2a8-4d5495d85a16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:25.893023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:25.893023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:25.893023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:25.893023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:25.893023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:25.893023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:25.893023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:25.893023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:25.893023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:25.893023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:25.893023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:25.893023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:25.893023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:25.893023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:25.893023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:25.893887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:25.893887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:25.893887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:25.893887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:25.893887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:25.893887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:25.893887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:25.893887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:25.893887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:25.893887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:25.893887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:25.893887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:25.893887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:25.893887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:25.893887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:25.893887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:25.894665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:25.894665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:25.894665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:25.894665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:25.894665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:25.894665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:25.894665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:25.894665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:25.894665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:25.894665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:25.894665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:25.894665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:25.894665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 232/446] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:21:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:25.900051 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf85ce-e349-4f26-a2a8-4d5495d85a16 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:25.938969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 215/447] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:25.944627 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38646a7a-ae14-4851-8b5e-c1d7463d59dc None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:25.999911 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf85ce-e349-4f26-a2a8-4d5495d85a16 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:26.027981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:26.036570 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d60ae-6bd3-45a2-b94e-0f3b42da1071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:26.037337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d60ae-6bd3-45a2-b94e-0f3b42da1071 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:26.037650 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d60ae-6bd3-45a2-b94e-0f3b42da1071 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:26.037963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d60ae-6bd3-45a2-b94e-0f3b42da1071 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:26.038786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d60ae-6bd3-45a2-b94e-0f3b42da1071 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:26.040155 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d60ae-6bd3-45a2-b94e-0f3b42da1071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:26.041478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d60ae-6bd3-45a2-b94e-0f3b42da1071 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:26.043305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38646a7a-ae14-4851-8b5e-c1d7463d59dc None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:26.050719 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 233/448] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:26.057744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d60ae-6bd3-45a2-b94e-0f3b42da1071 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:26.079085 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b049f-81d8-453e-b0c8-6f18ba212695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:26.079829 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b049f-81d8-453e-b0c8-6f18ba212695 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:26.080119 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b049f-81d8-453e-b0c8-6f18ba212695 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:26.080392 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b049f-81d8-453e-b0c8-6f18ba212695 None admin] PATH_INFO: `/v3/projects/a67548b777b24c2d88cd5789350f5c35` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:26.081561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b049f-81d8-453e-b0c8-6f18ba212695 None admin] RBAC: Authorizing `identity:get_project(project_id=a67548b777b24c2d88cd5789350f5c35)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:26.082992 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b049f-81d8-453e-b0c8-6f18ba212695 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:26.084705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 216/449] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:25 2022] GET /identity/v3/projects/a67548b777b24c2d88cd5789350f5c35 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:26.088625 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:26.090486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b049f-81d8-453e-b0c8-6f18ba212695 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:26.168000 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d60ae-6bd3-45a2-b94e-0f3b42da1071 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:26.194564 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b049f-81d8-453e-b0c8-6f18ba212695 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:26.201242 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086f28b-44e7-4c01-8f46-c299e426bb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:26.201894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086f28b-44e7-4c01-8f46-c299e426bb35 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:26.202182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086f28b-44e7-4c01-8f46-c299e426bb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:26.202456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086f28b-44e7-4c01-8f46-c299e426bb35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:26.229518 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e96fa-ab9b-4a48-8918-51cc4d7efeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:26.230373 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e96fa-ab9b-4a48-8918-51cc4d7efeca None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:26.230655 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e96fa-ab9b-4a48-8918-51cc4d7efeca None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:26.230928 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e96fa-ab9b-4a48-8918-51cc4d7efeca None admin] PATH_INFO: `/v3/groups/3017be6af6364ad2a4f2c33e39d528c8` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:26.232144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e96fa-ab9b-4a48-8918-51cc4d7efeca None admin] RBAC: Authorizing `identity:get_group(group_id=3017be6af6364ad2a4f2c33e39d528c8)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:26.233578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e96fa-ab9b-4a48-8918-51cc4d7efeca None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:26.235375 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 217/450] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Jul 12 14:21:26 2022] GET /identity/v3/groups/3017be6af6364ad2a4f2c33e39d528c8 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:26.240979 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e96fa-ab9b-4a48-8918-51cc4d7efeca None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:26.266625 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:26.271907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086f28b-44e7-4c01-8f46-c299e426bb35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:26.273518 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086f28b-44e7-4c01-8f46-c299e426bb35 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:26.297733 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:26.341397 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e96fa-ab9b-4a48-8918-51cc4d7efeca None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:26.376140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f992f6-1868-416a-9dbb-883cdca30b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:26.376349 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 234/451] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 14:21:26.376804 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f992f6-1868-416a-9dbb-883cdca30b3c None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:26.377088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f992f6-1868-416a-9dbb-883cdca30b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:26.377366 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f992f6-1868-416a-9dbb-883cdca30b3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:26.378202 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f992f6-1868-416a-9dbb-883cdca30b3c None admin] RBAC: Adding query filter params (group.id=3017be6af6364ad2a4f2c33e39d528c8, role.id=6184586642114a188e13c695442669f8, scope.project.id=a67548b777b24c2d88cd5789350f5c35) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:26.378519 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f992f6-1868-416a-9dbb-883cdca30b3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:26.379990 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f992f6-1868-416a-9dbb-883cdca30b3c None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:26.381863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086f28b-44e7-4c01-8f46-c299e426bb35 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:26.387071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 218/452] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Jul 12 14:21:26 2022] GET /identity/v3/role_assignments?group.id=3017be6af6364ad2a4f2c33e39d528c8&scope.project.id=a67548b777b24c2d88cd5789350f5c35&role.id=6184586642114a188e13c695442669f8 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:26.497384 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086f28b-44e7-4c01-8f46-c299e426bb35 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:26.522996 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:26.533813 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47b158-72ac-412e-92e7-7dc9dca45f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:26.534684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47b158-72ac-412e-92e7-7dc9dca45f9b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:26.534969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47b158-72ac-412e-92e7-7dc9dca45f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:26.535243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47b158-72ac-412e-92e7-7dc9dca45f9b None admin] PATH_INFO: `/v3/projects/e19a2306c9b043c3b84bdeaf0a418bdb` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:26.536536 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47b158-72ac-412e-92e7-7dc9dca45f9b None admin] RBAC: Authorizing `identity:get_project(project_id=e19a2306c9b043c3b84bdeaf0a418bdb)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:26.537974 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47b158-72ac-412e-92e7-7dc9dca45f9b None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:26.539844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 235/453] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:21:26 2022] GET /identity/v3/projects/e19a2306c9b043c3b84bdeaf0a418bdb => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:26.545829 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f992f6-1868-416a-9dbb-883cdca30b3c None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:26.632436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:26.649009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f992f6-1868-416a-9dbb-883cdca30b3c None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:26.686080 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0dfc8-35e6-4f6d-ae63-46fbe60def57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:26.686941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0dfc8-35e6-4f6d-ae63-46fbe60def57 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:26.687229 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0dfc8-35e6-4f6d-ae63-46fbe60def57 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:26.687525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0dfc8-35e6-4f6d-ae63-46fbe60def57 None admin] PATH_INFO: `/v3/groups/d73d46ff350c422fadc311f221ecc64c` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:26.688729 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0dfc8-35e6-4f6d-ae63-46fbe60def57 None admin] RBAC: Authorizing `identity:get_group(group_id=d73d46ff350c422fadc311f221ecc64c)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:26.690160 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0dfc8-35e6-4f6d-ae63-46fbe60def57 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:26.691967 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 219/454] 10.222.0.40 () {56 vars in 1180 bytes} [Tue Jul 12 14:21:26 2022] GET /identity/v3/groups/d73d46ff350c422fadc311f221ecc64c => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:26.699014 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47b158-72ac-412e-92e7-7dc9dca45f9b None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:26.799291 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47b158-72ac-412e-92e7-7dc9dca45f9b None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:26.832047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b4636-df9a-441f-9976-9a96c5767d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:26.832703 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b4636-df9a-441f-9976-9a96c5767d66 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:26.832985 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b4636-df9a-441f-9976-9a96c5767d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:26.833264 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b4636-df9a-441f-9976-9a96c5767d66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:26.834099 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b4636-df9a-441f-9976-9a96c5767d66 None admin] RBAC: Adding query filter params (group.id=d73d46ff350c422fadc311f221ecc64c, role.id=ae530119fc5c42358179521ce865b5d7, scope.project.id=e19a2306c9b043c3b84bdeaf0a418bdb) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:26.834412 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b4636-df9a-441f-9976-9a96c5767d66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:26.836531 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b4636-df9a-441f-9976-9a96c5767d66 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:26.842438 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 236/455] 10.222.0.40 () {56 vars in 1376 bytes} [Tue Jul 12 14:21:26 2022] GET /identity/v3/role_assignments?group.id=d73d46ff350c422fadc311f221ecc64c&scope.project.id=e19a2306c9b043c3b84bdeaf0a418bdb&role.id=ae530119fc5c42358179521ce865b5d7 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:29.476960 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6792c5e-d39d-4b09-833c-230c5a5d6191 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:29.477503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e8a91-2e89-45d4-8c6b-58ec18f16885 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:29.477839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e8a91-2e89-45d4-8c6b-58ec18f16885 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:29.477909 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e8a91-2e89-45d4-8c6b-58ec18f16885 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:29.478500 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6792c5e-d39d-4b09-833c-230c5a5d6191 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:29.478979 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6792c5e-d39d-4b09-833c-230c5a5d6191 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:29.479554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 237/456] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:21:29.480810 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 220/457] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:29.484900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc243618-9d26-4ebd-a085-412aacff7b51 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:29.485197 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc243618-9d26-4ebd-a085-412aacff7b51 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:29.485480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc243618-9d26-4ebd-a085-412aacff7b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:29.488473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbec7b-6c0c-454c-8cf0-8e1c07208260 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:29.489011 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbec7b-6c0c-454c-8cf0-8e1c07208260 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:29.489518 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbec7b-6c0c-454c-8cf0-8e1c07208260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:29.514715 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-dc243618-9d26-4ebd-a085-412aacff7b51 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:29.517943 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-dc243618-9d26-4ebd-a085-412aacff7b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:29.525018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-2bcbec7b-6c0c-454c-8cf0-8e1c07208260 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:29.526519 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2bcbec7b-6c0c-454c-8cf0-8e1c07208260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:29.646690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:29.664554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 221/458] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:21:29.667612 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 238/459] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:29.709479 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbec7b-6c0c-454c-8cf0-8e1c07208260 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:29.716325 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc243618-9d26-4ebd-a085-412aacff7b51 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:29.849831 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:29.867809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbec7b-6c0c-454c-8cf0-8e1c07208260 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:29.871001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc243618-9d26-4ebd-a085-412aacff7b51 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:29.908346 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dce619-ecbe-428b-a82b-02ed568426dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:29.909440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dce619-ecbe-428b-a82b-02ed568426dc None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:29.909874 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dce619-ecbe-428b-a82b-02ed568426dc None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:29.910293 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dce619-ecbe-428b-a82b-02ed568426dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:29.910407 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bc480-c5cf-4643-88c7-0fa99f20a667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:29.911190 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bc480-c5cf-4643-88c7-0fa99f20a667 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:29.911742 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bc480-c5cf-4643-88c7-0fa99f20a667 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:29.912157 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bc480-c5cf-4643-88c7-0fa99f20a667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:29.923150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dce619-ecbe-428b-a82b-02ed568426dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:29.923943 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bc480-c5cf-4643-88c7-0fa99f20a667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:29.925049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dce619-ecbe-428b-a82b-02ed568426dc None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:29.925407 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bc480-c5cf-4643-88c7-0fa99f20a667 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:29.944366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-816bc480-c5cf-4643-88c7-0fa99f20a667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:29.944366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:29.944366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:29.944366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:29.944366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:29.944366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:29.944366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:29.944366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:29.944366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:29.944366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:29.944366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:29.944366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:29.944366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:29.944366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:29.944366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:29.946720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:29.946720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:29.946720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:29.946720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:29.946720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:29.946720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:29.946720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:29.946720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:29.946720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:29.946720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:29.946720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:29.946720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:29.946720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:29.946720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:29.946720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:29.946720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:29.946720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:29.947707 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:29.947707 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:29.947707 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:29.947707 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:29.947707 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 239/460] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:29.948024 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab1c09-4864-4a30-a30f-b5cc33d3f9d5 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:29.948309 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab1c09-4864-4a30-a30f-b5cc33d3f9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:29.948585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab1c09-4864-4a30-a30f-b5cc33d3f9d5 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:29.950106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-91dce619-ecbe-428b-a82b-02ed568426dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:29.950106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:29.950106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:29.950106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:29.950106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:29.950106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:29.950106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:29.950106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:29.950106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:29.950106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:29.950106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:29.950106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:29.950106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:29.950106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:29.950106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:29.950918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:29.950918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:29.950918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:29.950918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:29.950918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:29.950918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:29.950918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:29.950918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:29.950918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:29.950918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:29.950918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:29.950918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:29.950918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:29.950918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:29.950918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:29.950918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:29.950918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:29.951806 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:29.951806 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:29.951806 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:29.951806 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:29.952030 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 240/461] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:29.952543 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab1c09-4864-4a30-a30f-b5cc33d3f9d5 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:29.954150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 222/462] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:29.958866 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d91ca8-2dfe-4278-9e47-cbdb3956a7a8 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:29.958866 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d91ca8-2dfe-4278-9e47-cbdb3956a7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:29.958866 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d91ca8-2dfe-4278-9e47-cbdb3956a7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:29.977537 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-08d91ca8-2dfe-4278-9e47-cbdb3956a7a8 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:29.979189 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-08d91ca8-2dfe-4278-9e47-cbdb3956a7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:30.003310 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:30.062552 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 223/463] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:30.063944 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d91ca8-2dfe-4278-9e47-cbdb3956a7a8 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:30.072610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab1c09-4864-4a30-a30f-b5cc33d3f9d5 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:30.111818 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e490b01-aee6-464f-96b1-3e68bbf92259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:30.112405 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e490b01-aee6-464f-96b1-3e68bbf92259 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.112739 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e490b01-aee6-464f-96b1-3e68bbf92259 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.113020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e490b01-aee6-464f-96b1-3e68bbf92259 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.113750 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e490b01-aee6-464f-96b1-3e68bbf92259 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:30.114055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e490b01-aee6-464f-96b1-3e68bbf92259 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:30.115606 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e490b01-aee6-464f-96b1-3e68bbf92259 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:30.130112 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 241/464] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:30.130993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e490b01-aee6-464f-96b1-3e68bbf92259 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:30.143408 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:30.190939 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d91ca8-2dfe-4278-9e47-cbdb3956a7a8 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:30.230634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eda9df-8bfb-4f86-b421-c1f83c848965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:30.231317 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eda9df-8bfb-4f86-b421-c1f83c848965 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.231776 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eda9df-8bfb-4f86-b421-c1f83c848965 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.232148 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eda9df-8bfb-4f86-b421-c1f83c848965 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.232981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eda9df-8bfb-4f86-b421-c1f83c848965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:30.233459 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eda9df-8bfb-4f86-b421-c1f83c848965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:30.234895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eda9df-8bfb-4f86-b421-c1f83c848965 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:30.252600 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:30.257344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e490b01-aee6-464f-96b1-3e68bbf92259 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:30.259910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 224/465] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:30.260977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eda9df-8bfb-4f86-b421-c1f83c848965 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:30.297609 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd42da-3ba6-4e68-bc0d-cc93fd48f102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:30.298411 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd42da-3ba6-4e68-bc0d-cc93fd48f102 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.298694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd42da-3ba6-4e68-bc0d-cc93fd48f102 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.299079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd42da-3ba6-4e68-bc0d-cc93fd48f102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.311202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd42da-3ba6-4e68-bc0d-cc93fd48f102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:30.313037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd42da-3ba6-4e68-bc0d-cc93fd48f102 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:30.333852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-a2bd42da-3ba6-4e68-bc0d-cc93fd48f102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:30.333852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:30.333852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:30.333852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:30.333852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:30.333852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:30.333852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:30.333852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:30.333852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:30.333852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:30.333852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:30.333852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:30.333852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:30.333852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:30.333852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:30.334741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:30.334741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:30.334741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:30.334741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:30.334741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:30.334741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:30.334741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:30.334741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:30.334741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:30.334741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:30.334741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:30.334741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:30.334741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:30.334741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:30.334741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:30.334741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:30.334741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:30.336543 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:30.336543 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:30.336543 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:30.336543 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:30.336543 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 242/466] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:30.337204 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586868-b864-4a04-a7bf-eb97411308ae None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.337546 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586868-b864-4a04-a7bf-eb97411308ae None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.337822 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586868-b864-4a04-a7bf-eb97411308ae None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.343345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 243/467] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:30.343345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53586868-b864-4a04-a7bf-eb97411308ae None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:30.377571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eda9df-8bfb-4f86-b421-c1f83c848965 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:30.406610 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:30.417115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dd804-ba6b-4cda-b182-553005768894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:30.417809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dd804-ba6b-4cda-b182-553005768894 None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.418102 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dd804-ba6b-4cda-b182-553005768894 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.418388 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dd804-ba6b-4cda-b182-553005768894 None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.419149 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030dd804-ba6b-4cda-b182-553005768894 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:30.420671 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030dd804-ba6b-4cda-b182-553005768894 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:30.454296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53586868-b864-4a04-a7bf-eb97411308ae None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:30.488239 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32bebe-b353-4104-97f5-685f70f6ed46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:30.488905 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32bebe-b353-4104-97f5-685f70f6ed46 None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.489186 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32bebe-b353-4104-97f5-685f70f6ed46 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.489456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32bebe-b353-4104-97f5-685f70f6ed46 None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.490159 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32bebe-b353-4104-97f5-685f70f6ed46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:30.491613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32bebe-b353-4104-97f5-685f70f6ed46 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:30.508904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 225/468] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Jul 12 14:21:30 2022] POST /identity/v3/users => generated 246 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:21:30.510339 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7c9bc-9a99-44ed-a69c-6c17f36c195f None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.510632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7c9bc-9a99-44ed-a69c-6c17f36c195f None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.510952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7c9bc-9a99-44ed-a69c-6c17f36c195f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.530570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-54b7c9bc-9a99-44ed-a69c-6c17f36c195f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:30.531745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-54b7c9bc-9a99-44ed-a69c-6c17f36c195f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:30.583128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 244/469] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Jul 12 14:21:30 2022] POST /identity/v3/users => generated 248 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:21:30.584455 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32bebe-b353-4104-97f5-685f70f6ed46 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:30.598405 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:30.652645 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 226/470] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:30.662192 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d6fef-6a14-4ebb-829d-38ff879c5f8c None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.662546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d6fef-6a14-4ebb-829d-38ff879c5f8c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.662830 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d6fef-6a14-4ebb-829d-38ff879c5f8c None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.664992 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 227/471] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:30.670662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72804ba2-b449-4461-beb2-79eb6dd5ad1d None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.673694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72804ba2-b449-4461-beb2-79eb6dd5ad1d None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.673694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72804ba2-b449-4461-beb2-79eb6dd5ad1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.692013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-72804ba2-b449-4461-beb2-79eb6dd5ad1d None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:30.693533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-72804ba2-b449-4461-beb2-79eb6dd5ad1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:30.739028 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32bebe-b353-4104-97f5-685f70f6ed46 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:30.784612 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 228/472] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:21:30.788407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72804ba2-b449-4461-beb2-79eb6dd5ad1d None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:30.792017 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618bb7c-edd1-4dd7-9864-326b8e76930f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:30.792957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618bb7c-edd1-4dd7-9864-326b8e76930f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.793436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618bb7c-edd1-4dd7-9864-326b8e76930f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.793887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618bb7c-edd1-4dd7-9864-326b8e76930f None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.794817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618bb7c-edd1-4dd7-9864-326b8e76930f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:30.795305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618bb7c-edd1-4dd7-9864-326b8e76930f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:30.797580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618bb7c-edd1-4dd7-9864-326b8e76930f None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:30.819435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 245/473] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:30.825566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618bb7c-edd1-4dd7-9864-326b8e76930f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:30.848459 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:30.911081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:30.930912 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72804ba2-b449-4461-beb2-79eb6dd5ad1d None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:30.960085 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618bb7c-edd1-4dd7-9864-326b8e76930f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:30.974796 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801cfcd-970e-4911-be12-d1d5ace31cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:30.975723 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801cfcd-970e-4911-be12-d1d5ace31cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:30.975918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801cfcd-970e-4911-be12-d1d5ace31cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:30.976223 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801cfcd-970e-4911-be12-d1d5ace31cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:30.987482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801cfcd-970e-4911-be12-d1d5ace31cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:30.988971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801cfcd-970e-4911-be12-d1d5ace31cb3 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:31.003086 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf11a0-c56e-401d-81f2-77b939220ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:31.004154 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf11a0-c56e-401d-81f2-77b939220ab8 None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:31.004665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf11a0-c56e-401d-81f2-77b939220ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:31.005133 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf11a0-c56e-401d-81f2-77b939220ab8 None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:31.006034 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf11a0-c56e-401d-81f2-77b939220ab8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:31.008316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf11a0-c56e-401d-81f2-77b939220ab8 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:31.010324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-f801cfcd-970e-4911-be12-d1d5ace31cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:31.010324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:31.010324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:31.010324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:31.010324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:31.010324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:31.010324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:31.010324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:31.010324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:31.010324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:31.010324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:31.010324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:31.010324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:31.010324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:31.010324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:31.011138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:31.011138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:31.011138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:31.011138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:31.011138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:31.011138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:31.011138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:31.011138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:31.011138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:31.011138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:31.011138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:31.011138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:31.011138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:31.011138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:31.011138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:31.011138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:31.011138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:31.012027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:31.012027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:31.012027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:31.012027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:31.012027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 229/474] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:31.012712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801cfcd-970e-4911-be12-d1d5ace31cb3 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:31.128079 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:31.129670 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 246/475] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Jul 12 14:21:30 2022] POST /identity/v3/users => generated 248 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:21:31.130954 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf11a0-c56e-401d-81f2-77b939220ab8 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:31.153522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801cfcd-970e-4911-be12-d1d5ace31cb3 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:31.242723 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521a14e-1489-4318-a445-315417dea10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:31.245374 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521a14e-1489-4318-a445-315417dea10b None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:31.245374 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521a14e-1489-4318-a445-315417dea10b None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:31.245764 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521a14e-1489-4318-a445-315417dea10b None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:31.249233 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521a14e-1489-4318-a445-315417dea10b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:31.249233 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521a14e-1489-4318-a445-315417dea10b None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:31.291780 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.sql.core [None req-e521a14e-1489-4318-a445-315417dea10b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 14:21:31.291780 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 14:21:31.291780 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [parameters: {'id': '1f87a81625364f6393257716901588cb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 14:21:31.291780 dv-cinder-820027-12-smb devstack@keystone.service[80634]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80634) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 14:21:31.311220 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf11a0-c56e-401d-81f2-77b939220ab8 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:31.325758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-e521a14e-1489-4318-a445-315417dea10b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 14:21:31.325758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:31.325758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 14:21:31.325758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 14:21:31.325758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 14:21:31.325758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 14:21:31.325758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 14:21:31.325758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 14:21:31.325758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 14:21:31.325758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application conn.query(q) Jul 12 14:21:31.325758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 14:21:31.325758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 14:21:31.325758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 14:21:31.325758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application result.read() Jul 12 14:21:31.325758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 14:21:31.326715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 14:21:31.326715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 14:21:31.326715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 14:21:31.326715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 14:21:31.326715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 14:21:31.326715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 14:21:31.326715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 14:21:31.326715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 14:21:31.326715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:31.326715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 14:21:31.326715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:31.326715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:31.326715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 14:21:31.326715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 14:21:31.326715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 12 14:21:31.326715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return ref.to_dict() Jul 12 14:21:31.326715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 14:21:31.326715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application next(self.gen) Jul 12 14:21:31.327642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 14:21:31.327642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application yield resource Jul 12 14:21:31.327642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 14:21:31.327642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application next(self.gen) Jul 12 14:21:31.327642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 14:21:31.327642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 14:21:31.327642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 14:21:31.327642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 14:21:31.327642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 14:21:31.327642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise self.value Jul 12 14:21:31.327642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 14:21:31.327642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 14:21:31.327642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 14:21:31.327642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application session.commit() Jul 12 14:21:31.327642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 14:21:31.327642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 14:21:31.327642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 14:21:31.328473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 14:21:31.328473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 14:21:31.328473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self.session.flush() Jul 12 14:21:31.328473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 14:21:31.328473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 14:21:31.328473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 14:21:31.328473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 14:21:31.328473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 14:21:31.328473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application compat.raise_( Jul 12 14:21:31.328473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 14:21:31.328473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception Jul 12 14:21:31.328473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 14:21:31.328473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 14:21:31.328473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 14:21:31.328473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 14:21:31.328473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 14:21:31.328473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 14:21:31.329316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 14:21:31.329316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 14:21:31.329316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 14:21:31.329316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 14:21:31.329316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 14:21:31.329316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 14:21:31.329316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 14:21:31.329316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 14:21:31.329316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 14:21:31.329316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 14:21:31.329316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 14:21:31.329316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 14:21:31.329316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 14:21:31.329316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 14:21:31.329316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 14:21:31.329316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception Jul 12 14:21:31.330115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 14:21:31.330115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 14:21:31.330115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 14:21:31.330115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 14:21:31.330115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 14:21:31.330115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 14:21:31.330115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 14:21:31.330115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application conn.query(q) Jul 12 14:21:31.330115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 14:21:31.330115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 14:21:31.330115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 14:21:31.330115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application result.read() Jul 12 14:21:31.330115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 14:21:31.330115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 14:21:31.330115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 14:21:31.330115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 14:21:31.330863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 14:21:31.330863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 14:21:31.330863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 14:21:31.330863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 14:21:31.330863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 14:21:31.330863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 14:21:31.330863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [parameters: {'id': '1f87a81625364f6393257716901588cb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 14:21:31.330863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 14:21:31.330863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:31.330863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:31.330863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:31.330863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:31.330863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:31.330863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:31.330863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:31.330863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:31.333413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:31.333413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:31.333413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:31.333413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:31.333413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:31.333413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:31.333413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 12 14:21:31.333413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 12 14:21:31.333413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:31.333413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:31.333413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 12 14:21:31.333413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 12 14:21:31.333413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 14:21:31.333413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 14:21:31.333413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 14:21:31.333413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:31.335268 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 230/476] 10.222.0.40 () {60 vars in 1131 bytes} [Tue Jul 12 14:21:31 2022] POST /identity/v3/roles => generated 144 bytes in 320 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:31.335268 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521a14e-1489-4318-a445-315417dea10b None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:31.339315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:31.364822 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76873ef5-7d96-4292-81cf-f5251776d54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:31.365510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873ef5-7d96-4292-81cf-f5251776d54e None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:31.365799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873ef5-7d96-4292-81cf-f5251776d54e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:31.366074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873ef5-7d96-4292-81cf-f5251776d54e None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:31.366840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76873ef5-7d96-4292-81cf-f5251776d54e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:31.367165 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76873ef5-7d96-4292-81cf-f5251776d54e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:31.368709 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76873ef5-7d96-4292-81cf-f5251776d54e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:31.389160 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 247/477] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:31.394411 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76873ef5-7d96-4292-81cf-f5251776d54e None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:31.474118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521a14e-1489-4318-a445-315417dea10b None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:31.512025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e0f67-ba97-41fb-b017-f85a37be50fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:31.512756 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e0f67-ba97-41fb-b017-f85a37be50fd None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:31.513088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e0f67-ba97-41fb-b017-f85a37be50fd None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:31.513372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e0f67-ba97-41fb-b017-f85a37be50fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:31.525277 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e0f67-ba97-41fb-b017-f85a37be50fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:31.533401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-7b3e0f67-ba97-41fb-b017-f85a37be50fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:21:31.533401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:31.533401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:31.533401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:31.533401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:31.533401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:31.533401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:31.533401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:31.533401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:31.533401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:31.533401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:31.533401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:31.533401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:31.533401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:31.533401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:31.533401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:31.535052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:31.535052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:31.535052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:31.535052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:31.535052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:31.535052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:31.535052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:31.535052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:31.535052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:31.535052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:31.535052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:31.535052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:31.535052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:31.535052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:31.535052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:31.535052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:31.535946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:31.535946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:31.535946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:31.535946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:31.535946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:31.535946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:31.535946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:31.535946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:31.535946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:31.535946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:31.535946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 14:21:31.535946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:31.535946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 231/478] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:21:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:31.541066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76873ef5-7d96-4292-81cf-f5251776d54e None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:31.545685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e0f67-ba97-41fb-b017-f85a37be50fd None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:31.569123 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:31.601213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b027f-5bcb-4a45-a29c-44fd5732d71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:31.602417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b027f-5bcb-4a45-a29c-44fd5732d71c None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:31.602881 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b027f-5bcb-4a45-a29c-44fd5732d71c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:31.603165 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b027f-5bcb-4a45-a29c-44fd5732d71c None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:31.608106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b027f-5bcb-4a45-a29c-44fd5732d71c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:31.609644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b027f-5bcb-4a45-a29c-44fd5732d71c None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:31.663001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e0f67-ba97-41fb-b017-f85a37be50fd None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:31.786518 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b656d-a22b-43cf-860b-6d6daef931ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:31.787123 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b656d-a22b-43cf-860b-6d6daef931ad None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:31.787446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b656d-a22b-43cf-860b-6d6daef931ad None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:31.787777 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b656d-a22b-43cf-860b-6d6daef931ad None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:31.788660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b656d-a22b-43cf-860b-6d6daef931ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:31.789766 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b656d-a22b-43cf-860b-6d6daef931ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:31.791480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b656d-a22b-43cf-860b-6d6daef931ad None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:31.802370 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 232/479] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:31.904836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 248/480] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Jul 12 14:21:31 2022] POST /identity/v3/users => generated 249 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:21:32.806677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b79f4f-5187-4a09-bd72-8067244ecaeb None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:32.807430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b79f4f-5187-4a09-bd72-8067244ecaeb None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:32.807430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b79f4f-5187-4a09-bd72-8067244ecaeb None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:32.808780 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 233/481] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:32.814199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a510644-4722-4953-96db-b6f716d073ef None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:32.814692 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a510644-4722-4953-96db-b6f716d073ef None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:32.814841 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a510644-4722-4953-96db-b6f716d073ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:32.836884 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-6a510644-4722-4953-96db-b6f716d073ef None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:32.838102 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-6a510644-4722-4953-96db-b6f716d073ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:32.879679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:32.926882 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 249/482] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:32.963392 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b79f4f-5187-4a09-bd72-8067244ecaeb None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:33.074697 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:33.099087 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b79f4f-5187-4a09-bd72-8067244ecaeb None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:33.145818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfae509-dca5-41d6-ba21-fa7f4e6f36fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:33.146632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfae509-dca5-41d6-ba21-fa7f4e6f36fd None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.146918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfae509-dca5-41d6-ba21-fa7f4e6f36fd None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.147197 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfae509-dca5-41d6-ba21-fa7f4e6f36fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.168203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfae509-dca5-41d6-ba21-fa7f4e6f36fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:33.176052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-fcfae509-dca5-41d6-ba21-fa7f4e6f36fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:33.176052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:33.176052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:33.176052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:33.176052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:33.176052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:33.176052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:33.176052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:33.176052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:33.176052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:33.176052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:33.176052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:33.176052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:33.176052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:33.176052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:33.176052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:33.176982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:33.176982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:33.176982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:33.176982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:33.176982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:33.176982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:33.176982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:33.176982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:33.176982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:33.176982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:33.176982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:33.176982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:33.176982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:33.176982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:33.176982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:33.176982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:33.177757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:33.177757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:33.177757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:33.177757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:33.177757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:33.177757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:33.177757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:33.177757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:33.177757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:33.177757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:33.177757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:33.177757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:33.177757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 234/483] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:33.184696 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a510644-4722-4953-96db-b6f716d073ef None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:33.207254 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a1e3a-b08a-4d58-a70f-6b019841949e None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.207587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a1e3a-b08a-4d58-a70f-6b019841949e None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.207872 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a1e3a-b08a-4d58-a70f-6b019841949e None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.209645 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 235/484] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:21:33.215581 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c30962-f1f4-4ef4-8cbc-ab749d85da48 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.215870 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c30962-f1f4-4ef4-8cbc-ab749d85da48 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.216151 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c30962-f1f4-4ef4-8cbc-ab749d85da48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.250490 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-21c30962-f1f4-4ef4-8cbc-ab749d85da48 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:33.251607 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-21c30962-f1f4-4ef4-8cbc-ab749d85da48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:33.340117 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a510644-4722-4953-96db-b6f716d073ef None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:33.350602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 236/485] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:33.376519 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d86ee-3ca6-4dab-9f3b-482fedc60853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:33.376877 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c30962-f1f4-4ef4-8cbc-ab749d85da48 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:33.377340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d86ee-3ca6-4dab-9f3b-482fedc60853 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.377688 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d86ee-3ca6-4dab-9f3b-482fedc60853 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.378030 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d86ee-3ca6-4dab-9f3b-482fedc60853 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.378876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d86ee-3ca6-4dab-9f3b-482fedc60853 None admin] RBAC: Adding query filter params (name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:33.379248 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d86ee-3ca6-4dab-9f3b-482fedc60853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:33.380763 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d86ee-3ca6-4dab-9f3b-482fedc60853 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:33.390231 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 250/486] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:21:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:33.395838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d86ee-3ca6-4dab-9f3b-482fedc60853 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:33.446253 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:33.457120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:33.489565 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c30962-f1f4-4ef4-8cbc-ab749d85da48 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:33.529691 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e033b-3bc6-4d89-82d3-a0c5d49fed55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:33.530936 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e033b-3bc6-4d89-82d3-a0c5d49fed55 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.531422 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e033b-3bc6-4d89-82d3-a0c5d49fed55 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.531872 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e033b-3bc6-4d89-82d3-a0c5d49fed55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.543681 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e033b-3bc6-4d89-82d3-a0c5d49fed55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:33.551850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-1b2e033b-3bc6-4d89-82d3-a0c5d49fed55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:33.551850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:33.551850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:33.551850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:33.551850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:33.551850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:33.551850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:33.551850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:33.551850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:33.551850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:33.551850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:33.551850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:33.551850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:33.551850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:33.551850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:33.551850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:33.552714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:33.552714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:33.552714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:33.552714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:33.552714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:33.552714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:33.552714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:33.552714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:33.552714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:33.552714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:33.552714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:33.552714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:33.552714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:33.552714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:33.552714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:33.552714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:33.553515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:33.553515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:33.553515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:33.553515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:33.553515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:33.553515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:33.553515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:33.553515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:33.553515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:33.553515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:33.553515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:33.553515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:33.561108 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 237/487] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:33.564120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e033b-3bc6-4d89-82d3-a0c5d49fed55 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:33.613607 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d86ee-3ca6-4dab-9f3b-482fedc60853 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:33.685116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022be5c-8cfb-47ae-8ebe-c7b208f82f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:33.686070 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022be5c-8cfb-47ae-8ebe-c7b208f82f4c None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.686357 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022be5c-8cfb-47ae-8ebe-c7b208f82f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.686631 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022be5c-8cfb-47ae-8ebe-c7b208f82f4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.698850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022be5c-8cfb-47ae-8ebe-c7b208f82f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:33.700450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022be5c-8cfb-47ae-8ebe-c7b208f82f4c None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:33.719533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-5022be5c-8cfb-47ae-8ebe-c7b208f82f4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:33.719533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:33.719533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:33.719533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:33.719533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:33.719533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:33.719533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:33.719533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:33.719533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:33.719533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:33.719533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:33.719533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:33.719533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:33.719533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:33.719533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:33.720436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:33.720436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:33.720436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:33.720436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:33.720436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:33.720436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:33.720436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:33.720436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:33.720436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:33.720436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:33.720436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:33.720436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:33.720436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:33.720436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:33.720436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:33.720436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:33.720436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:33.721258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:33.721258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:33.721258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:33.721258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:33.725404 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 251/488] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:33.726913 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da92fa-2c71-4afd-ac04-dca8dafa283c None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.727205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da92fa-2c71-4afd-ac04-dca8dafa283c None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.727509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da92fa-2c71-4afd-ac04-dca8dafa283c None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.728917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 252/489] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:33.729602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da92fa-2c71-4afd-ac04-dca8dafa283c None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:33.731642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e033b-3bc6-4d89-82d3-a0c5d49fed55 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:33.763977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:33.770950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e96b38-fb02-4180-9848-404c726ca3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:33.771929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e96b38-fb02-4180-9848-404c726ca3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.772437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e96b38-fb02-4180-9848-404c726ca3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.772948 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e96b38-fb02-4180-9848-404c726ca3d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.774558 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e96b38-fb02-4180-9848-404c726ca3d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:33.775086 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e96b38-fb02-4180-9848-404c726ca3d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:33.776639 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e96b38-fb02-4180-9848-404c726ca3d8 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:33.791188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 238/490] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:21:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:33.793052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380e833-1b5d-4a60-9554-b1dba389826e None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.793728 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380e833-1b5d-4a60-9554-b1dba389826e None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.794734 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380e833-1b5d-4a60-9554-b1dba389826e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.812589 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-6380e833-1b5d-4a60-9554-b1dba389826e None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:33.814597 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-6380e833-1b5d-4a60-9554-b1dba389826e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:33.826655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:33.848803 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da92fa-2c71-4afd-ac04-dca8dafa283c None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:33.886932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a383a0-6727-489a-911b-4bbe3f41ee30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:33.887470 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a383a0-6727-489a-911b-4bbe3f41ee30 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:33.887755 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a383a0-6727-489a-911b-4bbe3f41ee30 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:33.888031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a383a0-6727-489a-911b-4bbe3f41ee30 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:33.888765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a383a0-6727-489a-911b-4bbe3f41ee30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:33.889071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a383a0-6727-489a-911b-4bbe3f41ee30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:33.890671 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a383a0-6727-489a-911b-4bbe3f41ee30 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:33.895429 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 239/491] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:33.896616 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380e833-1b5d-4a60-9554-b1dba389826e None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:33.911785 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 253/492] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:33.917678 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a383a0-6727-489a-911b-4bbe3f41ee30 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:34.007101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380e833-1b5d-4a60-9554-b1dba389826e None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.024088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a383a0-6727-489a-911b-4bbe3f41ee30 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.032694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:34.046147 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d608d-b557-43f3-ab97-adcf2c6df138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:34.047386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d608d-b557-43f3-ab97-adcf2c6df138 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.047934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d608d-b557-43f3-ab97-adcf2c6df138 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.048407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d608d-b557-43f3-ab97-adcf2c6df138 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.058191 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d86e9-4ecd-4f57-97fb-021cc0d42200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:34.058974 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d86e9-4ecd-4f57-97fb-021cc0d42200 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.059259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d86e9-4ecd-4f57-97fb-021cc0d42200 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.059556 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d86e9-4ecd-4f57-97fb-021cc0d42200 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.061078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d608d-b557-43f3-ab97-adcf2c6df138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:34.063018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d608d-b557-43f3-ab97-adcf2c6df138 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:34.067589 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d86e9-4ecd-4f57-97fb-021cc0d42200 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:34.069021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d86e9-4ecd-4f57-97fb-021cc0d42200 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:34.082372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-c51d608d-b557-43f3-ab97-adcf2c6df138 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:34.082372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:34.082372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:34.082372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:34.082372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:34.082372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:34.082372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:34.082372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:34.082372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:34.082372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:34.082372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:34.082372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:34.082372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:34.082372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:34.082372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:34.083221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:34.083221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:34.083221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:34.083221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:34.083221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:34.083221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:34.083221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:34.083221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:34.083221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:34.083221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:34.083221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:34.083221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:34.083221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:34.083221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:34.083221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:34.083221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:34.083221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:34.084414 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:34.084414 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:34.084414 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:34.084414 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:34.084867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-531d86e9-4ecd-4f57-97fb-021cc0d42200 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:21:34.084867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:34.084867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:34.084867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:34.084867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:34.084867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:34.084867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:34.084867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:34.084867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:34.084867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:34.084867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:34.084867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:34.084867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:34.084867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:34.084867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:34.084867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:34.086380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:34.086380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:34.086380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:34.086380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:34.086380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:34.086380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:34.086380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:34.086380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:34.086380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:34.086380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:34.086380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:34.086380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:34.086380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:34.086380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:34.086380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:34.086380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:34.086380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:34.086380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:34.087258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:34.087258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:34.087258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:34.087258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:34.087258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:34.087258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:34.087258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:34.087258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:34.087258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:21:34.087258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:34.094199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 254/494] 10.222.0.40 () {56 vars in 1093 bytes} [Tue Jul 12 14:21:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:34.094199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d86e9-4ecd-4f57-97fb-021cc0d42200 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:34.094526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 240/494] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:34.094960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:34.096742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d608d-b557-43f3-ab97-adcf2c6df138 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:34.199224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d86e9-4ecd-4f57-97fb-021cc0d42200 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.213586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d608d-b557-43f3-ab97-adcf2c6df138 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.234969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d7389-8b0c-42ec-9350-f460d185e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:34.235906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d7389-8b0c-42ec-9350-f460d185e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.236198 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d7389-8b0c-42ec-9350-f460d185e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.236480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d7389-8b0c-42ec-9350-f460d185e5b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.247803 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d7389-8b0c-42ec-9350-f460d185e5b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:34.254207 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97fc40-15e7-4c52-be1c-653f0f17b496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:34.255185 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97fc40-15e7-4c52-be1c-653f0f17b496 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.255703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97fc40-15e7-4c52-be1c-653f0f17b496 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.255805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-186d7389-8b0c-42ec-9350-f460d185e5b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:34.255805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:34.255805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:34.255805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:34.255805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:34.255805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:34.255805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:34.255805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:34.255805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:34.255805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:34.255805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:34.255805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:34.255805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:34.255805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:34.255805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:34.255805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:34.256623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:34.256623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:34.256623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:34.256623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:34.256623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:34.256623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:34.256623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:34.256623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:34.256623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:34.256623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:34.256623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:34.256623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:34.256623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:34.256623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:34.256623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:34.256623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:34.258502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:34.258502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:34.258502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:34.258502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:34.258502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:34.258502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:34.258502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:34.258502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:34.258502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:34.258502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:34.258502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:34.258502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:34.259807 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97fc40-15e7-4c52-be1c-653f0f17b496 None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.260899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97fc40-15e7-4c52-be1c-653f0f17b496 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:34.261417 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97fc40-15e7-4c52-be1c-653f0f17b496 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:34.262613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 255/495] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:34.263471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97fc40-15e7-4c52-be1c-653f0f17b496 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:34.263575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d7389-8b0c-42ec-9350-f460d185e5b0 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:34.304176 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 241/496] 10.222.0.40 () {56 vars in 1133 bytes} [Tue Jul 12 14:21:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:34.305454 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97fc40-15e7-4c52-be1c-653f0f17b496 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:34.328642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:34.343910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:34.369637 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d7389-8b0c-42ec-9350-f460d185e5b0 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.407422 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b6dc0-2536-46db-9cdb-75f70ecb96b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:34.408089 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b6dc0-2536-46db-9cdb-75f70ecb96b5 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.408376 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b6dc0-2536-46db-9cdb-75f70ecb96b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.408656 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b6dc0-2536-46db-9cdb-75f70ecb96b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.409394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b6dc0-2536-46db-9cdb-75f70ecb96b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:34.409710 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b6dc0-2536-46db-9cdb-75f70ecb96b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:34.411113 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b6dc0-2536-46db-9cdb-75f70ecb96b5 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:34.423649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97fc40-15e7-4c52-be1c-653f0f17b496 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.429434 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 256/497] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:34.429434 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b6dc0-2536-46db-9cdb-75f70ecb96b5 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:34.459713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0c834-6a24-4d5d-83a5-f42022d0d0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:34.460308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0c834-6a24-4d5d-83a5-f42022d0d0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.460698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0c834-6a24-4d5d-83a5-f42022d0d0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.460983 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0c834-6a24-4d5d-83a5-f42022d0d0c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.461741 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0c834-6a24-4d5d-83a5-f42022d0d0c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:34.462057 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0c834-6a24-4d5d-83a5-f42022d0d0c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:34.463474 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0c834-6a24-4d5d-83a5-f42022d0d0c4 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:34.471884 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 242/498] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:21:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:34.473168 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cb369-129f-41fe-af68-e8176f9182a8 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.473436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cb369-129f-41fe-af68-e8176f9182a8 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.473715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cb369-129f-41fe-af68-e8176f9182a8 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.479982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 243/499] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:34.479982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cb369-129f-41fe-af68-e8176f9182a8 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:34.543299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b6dc0-2536-46db-9cdb-75f70ecb96b5 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.569626 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:34.582906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72ab83-3367-4725-a34c-4666c65b3a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:34.583318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:34.583761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72ab83-3367-4725-a34c-4666c65b3a38 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.584301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72ab83-3367-4725-a34c-4666c65b3a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.584455 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72ab83-3367-4725-a34c-4666c65b3a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.592225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cb369-129f-41fe-af68-e8176f9182a8 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.630231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99677fd-cbec-4fa4-a428-91e4fca4747a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:34.631041 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99677fd-cbec-4fa4-a428-91e4fca4747a None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.631355 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99677fd-cbec-4fa4-a428-91e4fca4747a None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.631639 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99677fd-cbec-4fa4-a428-91e4fca4747a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.639949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99677fd-cbec-4fa4-a428-91e4fca4747a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:34.641452 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99677fd-cbec-4fa4-a428-91e4fca4747a None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:34.657563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-f99677fd-cbec-4fa4-a428-91e4fca4747a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 14:21:34.657563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:34.657563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:34.657563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:34.657563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:34.657563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:34.657563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:34.657563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:34.657563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:34.657563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:34.657563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:34.657563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:34.657563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:34.657563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:34.657563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:34.657563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:34.658510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:34.658510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:34.658510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:34.658510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:34.658510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:34.658510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:34.658510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:34.658510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:34.658510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:34.658510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:34.658510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:34.658510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:34.658510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:34.658510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:34.658510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:34.658510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:34.658510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:34.658510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:34.659463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:34.659463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:34.659463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:34.659463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:34.659463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:34.659463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:34.659463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:34.659463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:34.659463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 14:21:34.659463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:34.659463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 244/500] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:34.660015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99677fd-cbec-4fa4-a428-91e4fca4747a None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:34.676113 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72ab83-3367-4725-a34c-4666c65b3a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:34.677872 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72ab83-3367-4725-a34c-4666c65b3a38 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:34.771322 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99677fd-cbec-4fa4-a428-91e4fca4747a None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.788211 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 257/501] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:34.788211 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa427264-d930-4efa-b763-1707fd5032bf None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.788211 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa427264-d930-4efa-b763-1707fd5032bf None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.788211 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa427264-d930-4efa-b763-1707fd5032bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.804195 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-aa427264-d930-4efa-b763-1707fd5032bf None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:34.806030 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-aa427264-d930-4efa-b763-1707fd5032bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:34.812233 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a87bc-efca-4c94-8bfe-584e8960540b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:34.813037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a87bc-efca-4c94-8bfe-584e8960540b None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.813588 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a87bc-efca-4c94-8bfe-584e8960540b None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.813588 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a87bc-efca-4c94-8bfe-584e8960540b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.824467 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:34.826182 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a87bc-efca-4c94-8bfe-584e8960540b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:34.827693 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a87bc-efca-4c94-8bfe-584e8960540b None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:34.845212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-ff0a87bc-efca-4c94-8bfe-584e8960540b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:34.845212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:34.845212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:34.845212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:34.845212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:34.845212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:34.845212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:34.845212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:34.845212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:34.845212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:34.845212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:34.845212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:34.845212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:34.845212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:34.845212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:34.846416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:34.846416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:34.846416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:34.846416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:34.846416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:34.846416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:34.846416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:34.846416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:34.846416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:34.846416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:34.846416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:34.846416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:34.846416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:34.846416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:34.846416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:34.846416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:34.846416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:34.847473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:34.847473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:34.847473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:34.847473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:34.847473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 245/502] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:34.847908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a87bc-efca-4c94-8bfe-584e8960540b None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:34.857102 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:34.880050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 258/503] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:34.881490 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa427264-d930-4efa-b763-1707fd5032bf None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:34.951922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a87bc-efca-4c94-8bfe-584e8960540b None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.983561 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa427264-d930-4efa-b763-1707fd5032bf None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:34.985763 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c05446-fae4-4b93-9e60-5529747d0896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:34.986445 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c05446-fae4-4b93-9e60-5529747d0896 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:34.986735 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c05446-fae4-4b93-9e60-5529747d0896 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:34.987018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c05446-fae4-4b93-9e60-5529747d0896 None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:34.987907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c05446-fae4-4b93-9e60-5529747d0896 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:34.988227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c05446-fae4-4b93-9e60-5529747d0896 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:34.989697 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c05446-fae4-4b93-9e60-5529747d0896 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:35.008721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 246/504] 10.222.0.40 () {56 vars in 1137 bytes} [Tue Jul 12 14:21:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:35.009983 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b360b-52d6-4e63-943f-d6346ad7d5ba None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:35.010276 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b360b-52d6-4e63-943f-d6346ad7d5ba None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:35.010781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b360b-52d6-4e63-943f-d6346ad7d5ba None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:35.015046 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 247/505] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:35.015046 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b360b-52d6-4e63-943f-d6346ad7d5ba None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:35.022186 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6dcca-0530-4f47-8035-ed41d12f2a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:35.022919 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6dcca-0530-4f47-8035-ed41d12f2a72 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:35.023613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6dcca-0530-4f47-8035-ed41d12f2a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:35.023894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6dcca-0530-4f47-8035-ed41d12f2a72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:35.033901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6dcca-0530-4f47-8035-ed41d12f2a72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:35.035379 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6dcca-0530-4f47-8035-ed41d12f2a72 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:35.053644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-d2d6dcca-0530-4f47-8035-ed41d12f2a72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:35.053644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:35.053644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:35.053644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:35.053644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:35.053644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:35.053644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:35.053644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:35.053644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:35.053644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:35.053644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:35.053644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:35.053644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:35.053644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:35.053644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:35.055200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:35.055200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:35.055200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:35.055200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:35.055200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:35.055200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:35.055200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:35.055200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:35.055200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:35.055200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:35.055200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:35.055200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:35.055200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:35.055200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:35.055200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:35.055200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:35.055200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:35.056077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:35.056077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:35.056077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:35.056077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:35.056077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 259/506] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:35.056344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6dcca-0530-4f47-8035-ed41d12f2a72 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:35.063188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:35.086027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:35.125906 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b360b-52d6-4e63-943f-d6346ad7d5ba None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:35.159749 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9a631-3b6a-4d72-9cf3-b5243676b8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:35.159945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6dcca-0530-4f47-8035-ed41d12f2a72 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:35.160420 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9a631-3b6a-4d72-9cf3-b5243676b8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:35.160707 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9a631-3b6a-4d72-9cf3-b5243676b8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:35.160985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9a631-3b6a-4d72-9cf3-b5243676b8d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:35.161706 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9a631-3b6a-4d72-9cf3-b5243676b8d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:35.162013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9a631-3b6a-4d72-9cf3-b5243676b8d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:35.163402 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9a631-3b6a-4d72-9cf3-b5243676b8d0 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:35.175175 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 248/507] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:35.176019 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9a631-3b6a-4d72-9cf3-b5243676b8d0 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:35.195312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25333b99-6114-4826-aa82-d7f38f428f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:35.196188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25333b99-6114-4826-aa82-d7f38f428f5d None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:35.196473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25333b99-6114-4826-aa82-d7f38f428f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:35.196747 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25333b99-6114-4826-aa82-d7f38f428f5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:35.207687 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25333b99-6114-4826-aa82-d7f38f428f5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:35.209044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25333b99-6114-4826-aa82-d7f38f428f5d None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:35.227057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-25333b99-6114-4826-aa82-d7f38f428f5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:35.227057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:35.227057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:35.227057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:35.227057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:35.227057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:35.227057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:35.227057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:35.227057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:35.227057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:35.227057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:35.227057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:35.227057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:35.227057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:35.227057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:35.228290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:35.228290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:35.228290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:35.228290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:35.228290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:35.228290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:35.228290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:35.228290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:35.228290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:35.228290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:35.228290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:35.228290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:35.228290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:35.228290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:35.228290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:35.228290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:35.228290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:35.229523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:35.229523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:35.229523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:35.229523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:35.229523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 260/508] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:35.229523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf46ce6-4c6f-4314-bccb-07f5f3ce5b9b None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:35.229857 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf46ce6-4c6f-4314-bccb-07f5f3ce5b9b None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:35.230120 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf46ce6-4c6f-4314-bccb-07f5f3ce5b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:35.247311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-dcf46ce6-4c6f-4314-bccb-07f5f3ce5b9b None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:35.248515 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-dcf46ce6-4c6f-4314-bccb-07f5f3ce5b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:35.288141 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9a631-3b6a-4d72-9cf3-b5243676b8d0 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:35.299251 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:35.311663 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:35.316004 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 261/509] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:35.316815 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf46ce6-4c6f-4314-bccb-07f5f3ce5b9b None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:35.330318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72442225-f47a-4cba-be4e-63214df5eeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:35.330985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72442225-f47a-4cba-be4e-63214df5eeec None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:35.331290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72442225-f47a-4cba-be4e-63214df5eeec None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:35.331578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72442225-f47a-4cba-be4e-63214df5eeec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:35.404817 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72442225-f47a-4cba-be4e-63214df5eeec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:35.406301 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72442225-f47a-4cba-be4e-63214df5eeec None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:35.419425 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf46ce6-4c6f-4314-bccb-07f5f3ce5b9b None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:35.452643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e8e1c-8384-4051-90ae-394be88b8ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:35.453309 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e8e1c-8384-4051-90ae-394be88b8ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:35.453596 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e8e1c-8384-4051-90ae-394be88b8ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:35.453867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e8e1c-8384-4051-90ae-394be88b8ba4 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:35.454591 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e8e1c-8384-4051-90ae-394be88b8ba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:35.454897 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e8e1c-8384-4051-90ae-394be88b8ba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:35.456308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e8e1c-8384-4051-90ae-394be88b8ba4 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:35.468371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 262/510] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:35.469192 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e8e1c-8384-4051-90ae-394be88b8ba4 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:35.509379 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 249/511] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:35.510446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72442225-f47a-4cba-be4e-63214df5eeec None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:35.515651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:35.541926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:35.571170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e8e1c-8384-4051-90ae-394be88b8ba4 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:35.604273 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2328d-0d43-44b0-856f-9b229a9afab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:35.605071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2328d-0d43-44b0-856f-9b229a9afab4 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:35.605356 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2328d-0d43-44b0-856f-9b229a9afab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:35.605639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2328d-0d43-44b0-856f-9b229a9afab4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:35.613146 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2328d-0d43-44b0-856f-9b229a9afab4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:35.614783 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2328d-0d43-44b0-856f-9b229a9afab4 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:35.618124 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72442225-f47a-4cba-be4e-63214df5eeec None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:35.630305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-9ce2328d-0d43-44b0-856f-9b229a9afab4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 14:21:35.630305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:35.630305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:35.630305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:35.630305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:35.630305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:35.630305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:35.630305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:35.630305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:35.630305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:35.630305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:35.630305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:35.630305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:35.630305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:35.630305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:35.630305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:35.631179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:35.631179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:35.631179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:35.631179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:35.631179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:35.631179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:35.631179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:35.631179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:35.631179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:35.631179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:35.631179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:35.631179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:35.631179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:35.631179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:35.631179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:35.631179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:35.631179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:35.631179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:35.632081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:35.632081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:35.632081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:35.632081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:35.632081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:35.632081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:35.632081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:35.632081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:35.632081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 14:21:35.632081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:35.632081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 263/512] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:35.633191 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2328d-0d43-44b0-856f-9b229a9afab4 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:35.658198 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fa5e4-f89d-4fc8-970a-9653fd7100fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:35.658875 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fa5e4-f89d-4fc8-970a-9653fd7100fc None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:35.659163 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fa5e4-f89d-4fc8-970a-9653fd7100fc None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:35.659481 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fa5e4-f89d-4fc8-970a-9653fd7100fc None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:35.660214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fa5e4-f89d-4fc8-970a-9653fd7100fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:35.660523 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fa5e4-f89d-4fc8-970a-9653fd7100fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:35.661924 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fa5e4-f89d-4fc8-970a-9653fd7100fc None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:35.678161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 250/513] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:35.678161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fa5e4-f89d-4fc8-970a-9653fd7100fc None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:35.732588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2328d-0d43-44b0-856f-9b229a9afab4 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:35.739317 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:35.760075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:35.767367 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41617850-8c5e-44c3-b74e-121bf7f6ded8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:35.768163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41617850-8c5e-44c3-b74e-121bf7f6ded8 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:35.768443 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41617850-8c5e-44c3-b74e-121bf7f6ded8 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:35.768717 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41617850-8c5e-44c3-b74e-121bf7f6ded8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:35.775752 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fa5e4-f89d-4fc8-970a-9653fd7100fc None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:35.778903 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41617850-8c5e-44c3-b74e-121bf7f6ded8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:35.786765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-41617850-8c5e-44c3-b74e-121bf7f6ded8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:35.786765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:35.786765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:35.786765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:35.786765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:35.786765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:35.786765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:35.786765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:35.786765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:35.786765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:35.786765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:35.786765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:35.786765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:35.786765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:35.786765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:35.786765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:35.787695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:35.787695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:35.787695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:35.787695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:35.787695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:35.787695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:35.787695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:35.787695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:35.787695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:35.787695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:35.787695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:35.787695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:35.787695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:35.787695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:35.787695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:35.787695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:35.788478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:35.788478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:35.788478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:35.788478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:35.788478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:35.788478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:35.788478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:35.788478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:35.788478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:35.788478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:35.788478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:35.788478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:35.788478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 264/514] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:35.789784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41617850-8c5e-44c3-b74e-121bf7f6ded8 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:35.811825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28550f0a-5bf6-4ff2-beef-7e689c63819d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:35.812695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28550f0a-5bf6-4ff2-beef-7e689c63819d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:35.812980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28550f0a-5bf6-4ff2-beef-7e689c63819d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:35.813255 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28550f0a-5bf6-4ff2-beef-7e689c63819d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:35.820148 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28550f0a-5bf6-4ff2-beef-7e689c63819d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:35.821839 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28550f0a-5bf6-4ff2-beef-7e689c63819d None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:35.837013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-28550f0a-5bf6-4ff2-beef-7e689c63819d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:35.837013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:35.837013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:35.837013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:35.837013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:35.837013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:35.837013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:35.837013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:35.837013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:35.837013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:35.837013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:35.837013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:35.837013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:35.837013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:35.837013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:35.838075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:35.838075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:35.838075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:35.838075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:35.838075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:35.838075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:35.838075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:35.838075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:35.838075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:35.838075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:35.838075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:35.838075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:35.838075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:35.838075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:35.838075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:35.838075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:35.838075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:35.839123 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:35.839123 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:35.839123 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:35.839123 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:35.839123 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:35.839123 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:35.839123 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:35.839123 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:35.839123 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 251/515] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:35.839123 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28550f0a-5bf6-4ff2-beef-7e689c63819d None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:35.893428 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41617850-8c5e-44c3-b74e-121bf7f6ded8 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:35.927244 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08376bad-7839-40b8-96f9-9dca480755c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:35.928058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08376bad-7839-40b8-96f9-9dca480755c2 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:35.928344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08376bad-7839-40b8-96f9-9dca480755c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:35.928626 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08376bad-7839-40b8-96f9-9dca480755c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:35.937579 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28550f0a-5bf6-4ff2-beef-7e689c63819d None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:35.940127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08376bad-7839-40b8-96f9-9dca480755c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:35.941571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08376bad-7839-40b8-96f9-9dca480755c2 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:35.958584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-08376bad-7839-40b8-96f9-9dca480755c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:35.958584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:35.958584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:35.958584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:35.958584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:35.958584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:35.958584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:35.958584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:35.958584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:35.958584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:35.958584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:35.958584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:35.958584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:35.958584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:35.958584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:35.959630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:35.959630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:35.959630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:35.959630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:35.959630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:35.959630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:35.959630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:35.959630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:35.959630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:35.959630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:35.959630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:35.959630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:35.959630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:35.959630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:35.959630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:35.959630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:35.959630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:35.965295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:35.965295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:35.965295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:35.965295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:35.965295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 265/516] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:35.965295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08376bad-7839-40b8-96f9-9dca480755c2 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:35.970578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd506c-16f6-40e1-86cd-4a98bef5e13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:35.971250 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd506c-16f6-40e1-86cd-4a98bef5e13f None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:35.971575 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd506c-16f6-40e1-86cd-4a98bef5e13f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:35.971846 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd506c-16f6-40e1-86cd-4a98bef5e13f None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:35.972683 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd506c-16f6-40e1-86cd-4a98bef5e13f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:35.972991 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd506c-16f6-40e1-86cd-4a98bef5e13f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:35.974401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd506c-16f6-40e1-86cd-4a98bef5e13f None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:35.984046 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:35.993553 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 252/517] 10.222.0.40 () {56 vars in 1137 bytes} [Tue Jul 12 14:21:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:35.996751 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd506c-16f6-40e1-86cd-4a98bef5e13f None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:35.997475 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:36.067879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08376bad-7839-40b8-96f9-9dca480755c2 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:36.104110 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd506c-16f6-40e1-86cd-4a98bef5e13f None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:36.112010 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6282a-86ab-4311-b65d-5182ef868035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:36.112702 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6282a-86ab-4311-b65d-5182ef868035 None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:36.112982 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6282a-86ab-4311-b65d-5182ef868035 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:36.113256 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6282a-86ab-4311-b65d-5182ef868035 None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:36.113989 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6282a-86ab-4311-b65d-5182ef868035 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:36.115486 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6282a-86ab-4311-b65d-5182ef868035 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:36.140593 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afc06f-9230-4413-a41b-8a04ef558034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:36.141264 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afc06f-9230-4413-a41b-8a04ef558034 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:36.141553 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afc06f-9230-4413-a41b-8a04ef558034 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:36.141830 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afc06f-9230-4413-a41b-8a04ef558034 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:36.142577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afc06f-9230-4413-a41b-8a04ef558034 None admin] RBAC: Adding query filter params (name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:36.144987 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afc06f-9230-4413-a41b-8a04ef558034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:36.144987 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afc06f-9230-4413-a41b-8a04ef558034 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:36.152805 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 253/518] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:21:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:36.153584 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afc06f-9230-4413-a41b-8a04ef558034 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:36.211995 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 266/519] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Jul 12 14:21:35 2022] POST /identity/v3/users => generated 247 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:21:36.212772 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6282a-86ab-4311-b65d-5182ef868035 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:36.216505 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:36.271647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afc06f-9230-4413-a41b-8a04ef558034 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:36.303886 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:36.314310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4dea4a-9d3e-406b-9029-c80b2f975447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:36.315000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dea4a-9d3e-406b-9029-c80b2f975447 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:36.315317 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dea4a-9d3e-406b-9029-c80b2f975447 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:36.315604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dea4a-9d3e-406b-9029-c80b2f975447 None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:36.316426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4dea4a-9d3e-406b-9029-c80b2f975447 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:36.316740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4dea4a-9d3e-406b-9029-c80b2f975447 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:36.318308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4dea4a-9d3e-406b-9029-c80b2f975447 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:36.339200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6282a-86ab-4311-b65d-5182ef868035 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:36.345817 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 254/520] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:36.345817 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4dea4a-9d3e-406b-9029-c80b2f975447 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:36.382797 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118fee7-8bbe-4f3e-8c92-6f49875d57f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:36.384065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118fee7-8bbe-4f3e-8c92-6f49875d57f9 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:36.384065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118fee7-8bbe-4f3e-8c92-6f49875d57f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:36.384065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118fee7-8bbe-4f3e-8c92-6f49875d57f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:36.384750 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118fee7-8bbe-4f3e-8c92-6f49875d57f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:36.385066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118fee7-8bbe-4f3e-8c92-6f49875d57f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:36.386516 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118fee7-8bbe-4f3e-8c92-6f49875d57f9 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:36.403265 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 267/521] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:36.404605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118fee7-8bbe-4f3e-8c92-6f49875d57f9 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:36.482349 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4dea4a-9d3e-406b-9029-c80b2f975447 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:36.514746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:36.521797 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118fee7-8bbe-4f3e-8c92-6f49875d57f9 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:36.529547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e4b01-28e0-4b5b-b4cc-b008064a44a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:36.529547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e4b01-28e0-4b5b-b4cc-b008064a44a9 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:36.529547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e4b01-28e0-4b5b-b4cc-b008064a44a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:36.529547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e4b01-28e0-4b5b-b4cc-b008064a44a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:36.560606 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d3761-dc5c-4bda-a0fa-219311acf74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:36.561404 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d3761-dc5c-4bda-a0fa-219311acf74b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:36.561690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d3761-dc5c-4bda-a0fa-219311acf74b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:36.561969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d3761-dc5c-4bda-a0fa-219311acf74b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:36.568970 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:36.573821 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d3761-dc5c-4bda-a0fa-219311acf74b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:36.575315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d3761-dc5c-4bda-a0fa-219311acf74b None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:36.594963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-c37d3761-dc5c-4bda-a0fa-219311acf74b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:36.594963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:36.594963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:36.594963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:36.594963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:36.594963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:36.594963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:36.594963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:36.594963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:36.594963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:36.594963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:36.594963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:36.594963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:36.594963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:36.594963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:36.595932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:36.595932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:36.595932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:36.595932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:36.595932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:36.595932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:36.595932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:36.595932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:36.595932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:36.595932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:36.595932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:36.595932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:36.595932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:36.595932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:36.595932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:36.595932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:36.595932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:36.596769 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:36.596769 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:36.596769 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:36.596769 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:36.596769 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 268/522] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:36.597773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d3761-dc5c-4bda-a0fa-219311acf74b None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:36.616169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e4b01-28e0-4b5b-b4cc-b008064a44a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:36.618626 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e4b01-28e0-4b5b-b4cc-b008064a44a9 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:36.728910 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d3761-dc5c-4bda-a0fa-219311acf74b None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:36.741082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 255/523] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:36.742176 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e4b01-28e0-4b5b-b4cc-b008064a44a9 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:36.770278 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:36.772871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b62c6-e576-4ed7-8e47-3dd325eb4e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:36.774123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b62c6-e576-4ed7-8e47-3dd325eb4e02 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:36.774409 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b62c6-e576-4ed7-8e47-3dd325eb4e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:36.774690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b62c6-e576-4ed7-8e47-3dd325eb4e02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:36.775562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b62c6-e576-4ed7-8e47-3dd325eb4e02 None admin] RBAC: Adding query filter params (role.id=c6f0b65d6ea5449ca79744ac52243ba2, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=122fc227de9d4f87a66e4a0d86ff0b16) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:36.775869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b62c6-e576-4ed7-8e47-3dd325eb4e02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:36.777334 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b62c6-e576-4ed7-8e47-3dd325eb4e02 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:36.783140 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 269/524] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:36 2022] GET /identity/v3/role_assignments?user.id=122fc227de9d4f87a66e4a0d86ff0b16&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=c6f0b65d6ea5449ca79744ac52243ba2 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:36.783991 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b62c6-e576-4ed7-8e47-3dd325eb4e02 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:36.856577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:36.883408 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e4b01-28e0-4b5b-b4cc-b008064a44a9 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:36.923243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b62c6-e576-4ed7-8e47-3dd325eb4e02 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:36.936999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39d9b0-27af-4830-b9c8-f58b92c66909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:36.938401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39d9b0-27af-4830-b9c8-f58b92c66909 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:36.938713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39d9b0-27af-4830-b9c8-f58b92c66909 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:36.939002 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39d9b0-27af-4830-b9c8-f58b92c66909 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:36.950879 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39d9b0-27af-4830-b9c8-f58b92c66909 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:36.952439 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39d9b0-27af-4830-b9c8-f58b92c66909 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:36.972425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-7f39d9b0-27af-4830-b9c8-f58b92c66909 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:36.972425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:36.972425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:36.972425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:36.972425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:36.972425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:36.972425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:36.972425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:36.972425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:36.972425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:36.972425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:36.972425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:36.972425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:36.972425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:36.972425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:36.973525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:36.973525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:36.973525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:36.973525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:36.973525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:36.973525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:36.973525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:36.973525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:36.973525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:36.973525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:36.973525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:36.973525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:36.973525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:36.973525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:36.973525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:36.973525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:36.973525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:36.974382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:36.974382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:36.974382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:36.974382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:36.974382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:36.974382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:36.974382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:36.974382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:36.974382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 256/525] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:36.974832 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39d9b0-27af-4830-b9c8-f58b92c66909 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:36.979133 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aadb3c-5d73-4bea-bbed-a30ae8e81093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:36.980192 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aadb3c-5d73-4bea-bbed-a30ae8e81093 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:36.980705 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aadb3c-5d73-4bea-bbed-a30ae8e81093 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:36.981196 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aadb3c-5d73-4bea-bbed-a30ae8e81093 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:36.982160 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aadb3c-5d73-4bea-bbed-a30ae8e81093 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:36.982693 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aadb3c-5d73-4bea-bbed-a30ae8e81093 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:36.984360 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aadb3c-5d73-4bea-bbed-a30ae8e81093 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:37.003393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 270/526] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:37.004278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aadb3c-5d73-4bea-bbed-a30ae8e81093 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:37.087657 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:37.104823 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39d9b0-27af-4830-b9c8-f58b92c66909 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:37.133789 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aadb3c-5d73-4bea-bbed-a30ae8e81093 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:37.141730 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dff1d-668e-4191-a1f3-a11e56661c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:37.142687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dff1d-668e-4191-a1f3-a11e56661c24 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:37.143127 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dff1d-668e-4191-a1f3-a11e56661c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:37.143540 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dff1d-668e-4191-a1f3-a11e56661c24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:37.150229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:37.156524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dff1d-668e-4191-a1f3-a11e56661c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:37.158159 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dff1d-668e-4191-a1f3-a11e56661c24 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:37.177267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-c83dff1d-668e-4191-a1f3-a11e56661c24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:37.177267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:37.177267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:37.177267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:37.177267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:37.177267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:37.177267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:37.177267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:37.177267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:37.177267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:37.177267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:37.177267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:37.177267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:37.177267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:37.177267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:37.178654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:37.178654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:37.178654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:37.178654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:37.178654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:37.178654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:37.178654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:37.178654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:37.178654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:37.178654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:37.178654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:37.178654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:37.178654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:37.178654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:37.178654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:37.178654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:37.178654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:37.179902 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:37.179902 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:37.179902 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:37.179902 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:37.181121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 257/527] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:37.182060 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dff1d-668e-4191-a1f3-a11e56661c24 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:37.184509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bb6cd-568f-43f3-bf0d-2c1cd649173e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:37.185513 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bb6cd-568f-43f3-bf0d-2c1cd649173e None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:37.185977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bb6cd-568f-43f3-bf0d-2c1cd649173e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:37.186444 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bb6cd-568f-43f3-bf0d-2c1cd649173e None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:37.187465 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bb6cd-568f-43f3-bf0d-2c1cd649173e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:37.188096 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bb6cd-568f-43f3-bf0d-2c1cd649173e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:37.189817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9bb6cd-568f-43f3-bf0d-2c1cd649173e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:37.215656 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 271/528] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:37.217452 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bb6cd-568f-43f3-bf0d-2c1cd649173e None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:37.327224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dff1d-668e-4191-a1f3-a11e56661c24 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:37.360559 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bb6cd-568f-43f3-bf0d-2c1cd649173e None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:37.372571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e8faa-0ce4-469a-a7aa-ce2bc54a2db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:37.373765 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e8faa-0ce4-469a-a7aa-ce2bc54a2db6 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:37.374050 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e8faa-0ce4-469a-a7aa-ce2bc54a2db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:37.374651 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e8faa-0ce4-469a-a7aa-ce2bc54a2db6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:37.378126 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:37.386512 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e8faa-0ce4-469a-a7aa-ce2bc54a2db6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:37.388291 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e8faa-0ce4-469a-a7aa-ce2bc54a2db6 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:37.408994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-be7e8faa-0ce4-469a-a7aa-ce2bc54a2db6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 14:21:37.408994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:37.408994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:37.408994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:37.408994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:37.408994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:37.408994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:37.408994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:37.408994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:37.408994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:37.408994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:37.408994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:37.408994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:37.408994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:37.408994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:37.408994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:37.410047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:37.410047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:37.410047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:37.410047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:37.410047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:37.410047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:37.410047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:37.410047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:37.410047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:37.410047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:37.410047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:37.410047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:37.410047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:37.410047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:37.410047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:37.410047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:37.410047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:37.410047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:37.411008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:37.411008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:37.411008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:37.411008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:37.411008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:37.411008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:37.411008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:37.411008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:37.411008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 14:21:37.411008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:37.415904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 258/529] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:37.419464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e8faa-0ce4-469a-a7aa-ce2bc54a2db6 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:37.421057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b8716-4bd6-4eff-938a-26b168dc73ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:37.421986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b8716-4bd6-4eff-938a-26b168dc73ff None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:37.422417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b8716-4bd6-4eff-938a-26b168dc73ff None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:37.422877 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b8716-4bd6-4eff-938a-26b168dc73ff None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:37.423983 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b8716-4bd6-4eff-938a-26b168dc73ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:37.424586 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b8716-4bd6-4eff-938a-26b168dc73ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:37.425997 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b8716-4bd6-4eff-938a-26b168dc73ff None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:37.440114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 272/530] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:37.441077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b8716-4bd6-4eff-938a-26b168dc73ff None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:37.479781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:37.561252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b8716-4bd6-4eff-938a-26b168dc73ff None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:37.572898 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e8faa-0ce4-469a-a7aa-ce2bc54a2db6 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:37.600794 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1136a02-3939-456a-8424-fe6dd0bd7b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:37.601580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1136a02-3939-456a-8424-fe6dd0bd7b05 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:37.602284 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1136a02-3939-456a-8424-fe6dd0bd7b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:37.602284 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1136a02-3939-456a-8424-fe6dd0bd7b05 None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:37.603152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1136a02-3939-456a-8424-fe6dd0bd7b05 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:37.603499 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1136a02-3939-456a-8424-fe6dd0bd7b05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:37.605130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1136a02-3939-456a-8424-fe6dd0bd7b05 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:37.614703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c090daa-94d1-4e01-b21f-fd08182b4393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:37.615689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c090daa-94d1-4e01-b21f-fd08182b4393 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:37.616139 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c090daa-94d1-4e01-b21f-fd08182b4393 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:37.616567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c090daa-94d1-4e01-b21f-fd08182b4393 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:37.618290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c090daa-94d1-4e01-b21f-fd08182b4393 None admin] RBAC: Adding query filter params (role.id=c6f0b65d6ea5449ca79744ac52243ba2, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=37932500740c4ccb96358bd751d01598) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:37.618887 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c090daa-94d1-4e01-b21f-fd08182b4393 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:37.621030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c090daa-94d1-4e01-b21f-fd08182b4393 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:37.628078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 259/531] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:37 2022] GET /identity/v3/role_assignments?user.id=37932500740c4ccb96358bd751d01598&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=c6f0b65d6ea5449ca79744ac52243ba2 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:37.629186 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c090daa-94d1-4e01-b21f-fd08182b4393 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:37.677415 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 273/532] 10.222.0.40 () {56 vars in 1139 bytes} [Tue Jul 12 14:21:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:37.683442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1136a02-3939-456a-8424-fe6dd0bd7b05 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:37.714827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:37.803312 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c090daa-94d1-4e01-b21f-fd08182b4393 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:37.815918 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:37.841423 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1136a02-3939-456a-8424-fe6dd0bd7b05 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:37.855304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739b5c4-3b94-4fd6-81dc-01bfe26fabef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:37.856950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739b5c4-3b94-4fd6-81dc-01bfe26fabef None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:37.857423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739b5c4-3b94-4fd6-81dc-01bfe26fabef None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:37.857850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739b5c4-3b94-4fd6-81dc-01bfe26fabef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:37.871608 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739b5c4-3b94-4fd6-81dc-01bfe26fabef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:37.879869 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739b5c4-3b94-4fd6-81dc-01bfe26fabef None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:37.883050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e791213-68ee-4503-8b0f-27fed4a2c803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:37.884174 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e791213-68ee-4503-8b0f-27fed4a2c803 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:37.884294 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e791213-68ee-4503-8b0f-27fed4a2c803 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:37.884513 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e791213-68ee-4503-8b0f-27fed4a2c803 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:37.905854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-8739b5c4-3b94-4fd6-81dc-01bfe26fabef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:37.905854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:37.905854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:37.905854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:37.905854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:37.905854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:37.905854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:37.905854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:37.905854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:37.905854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:37.905854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:37.905854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:37.905854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:37.905854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:37.905854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:37.907305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:37.907305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:37.907305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:37.907305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:37.907305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:37.907305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:37.907305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:37.907305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:37.907305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:37.907305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:37.907305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:37.907305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:37.907305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:37.907305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:37.907305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:37.907305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:37.907305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:37.908201 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:37.908201 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:37.908201 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:37.908201 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:37.908201 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:37.908201 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:37.908201 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:37.908201 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:37.915054 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 260/533] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:37.916414 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739b5c4-3b94-4fd6-81dc-01bfe26fabef None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:37.967802 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e791213-68ee-4503-8b0f-27fed4a2c803 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:37.969038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e791213-68ee-4503-8b0f-27fed4a2c803 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:38.074974 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:38.087976 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739b5c4-3b94-4fd6-81dc-01bfe26fabef None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:38.104379 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 274/534] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:38.114738 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e791213-68ee-4503-8b0f-27fed4a2c803 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:38.143196 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:38.177585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4ba53-0207-430a-be34-7e1a588be646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:38.177585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4ba53-0207-430a-be34-7e1a588be646 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:38.177585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4ba53-0207-430a-be34-7e1a588be646 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:38.177585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4ba53-0207-430a-be34-7e1a588be646 None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:38.178052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4ba53-0207-430a-be34-7e1a588be646 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:38.186044 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4ba53-0207-430a-be34-7e1a588be646 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:38.186044 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4ba53-0207-430a-be34-7e1a588be646 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:38.200113 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 261/535] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:38.209087 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4ba53-0207-430a-be34-7e1a588be646 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:38.372398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e791213-68ee-4503-8b0f-27fed4a2c803 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:38.460647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ab3e2-e4bc-4d4b-867e-bf15dfae42db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:38.461585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ab3e2-e4bc-4d4b-867e-bf15dfae42db None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:38.461880 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ab3e2-e4bc-4d4b-867e-bf15dfae42db None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:38.462162 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ab3e2-e4bc-4d4b-867e-bf15dfae42db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:38.473415 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ab3e2-e4bc-4d4b-867e-bf15dfae42db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:38.475055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ab3e2-e4bc-4d4b-867e-bf15dfae42db None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:38.493490 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4ba53-0207-430a-be34-7e1a588be646 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:38.510636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-046ab3e2-e4bc-4d4b-867e-bf15dfae42db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:38.510636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:38.510636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:38.510636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:38.510636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:38.510636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:38.510636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:38.510636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:38.510636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:38.510636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:38.510636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:38.510636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:38.510636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:38.510636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:38.510636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:38.511635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:38.511635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:38.511635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:38.511635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:38.511635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:38.511635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:38.511635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:38.511635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:38.511635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:38.511635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:38.511635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:38.511635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:38.511635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:38.511635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:38.511635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:38.511635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:38.511635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:38.512446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:38.512446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:38.512446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:38.512446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:38.514862 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 275/536] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:38.521359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ab3e2-e4bc-4d4b-867e-bf15dfae42db None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:38.544306 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d32aec-8cf7-4161-8cad-9e00c72f97f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:38.545039 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d32aec-8cf7-4161-8cad-9e00c72f97f3 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:38.545328 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d32aec-8cf7-4161-8cad-9e00c72f97f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:38.545607 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d32aec-8cf7-4161-8cad-9e00c72f97f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:38.546545 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d32aec-8cf7-4161-8cad-9e00c72f97f3 None admin] RBAC: Adding query filter params (role.id=c6f0b65d6ea5449ca79744ac52243ba2, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=aeb6850303f54a16bb23f05165844dda) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:38.546896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d32aec-8cf7-4161-8cad-9e00c72f97f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:38.548889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d32aec-8cf7-4161-8cad-9e00c72f97f3 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:38.556340 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 262/537] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:38 2022] GET /identity/v3/role_assignments?user.id=aeb6850303f54a16bb23f05165844dda&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=c6f0b65d6ea5449ca79744ac52243ba2 => generated 259 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:38.600550 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:38.698644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ab3e2-e4bc-4d4b-867e-bf15dfae42db None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:38.751791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686716ed-01e7-45df-8d4c-340e2a8f0fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:38.752868 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686716ed-01e7-45df-8d4c-340e2a8f0fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:38.753348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686716ed-01e7-45df-8d4c-340e2a8f0fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:38.753813 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686716ed-01e7-45df-8d4c-340e2a8f0fe3 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:38.754778 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686716ed-01e7-45df-8d4c-340e2a8f0fe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:38.755320 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686716ed-01e7-45df-8d4c-340e2a8f0fe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:38.756956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686716ed-01e7-45df-8d4c-340e2a8f0fe3 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:38.775984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 276/538] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:38.781759 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d32aec-8cf7-4161-8cad-9e00c72f97f3 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:38.783054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575158f0-75fa-469e-98b1-06722c9e1e00 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:38.783572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575158f0-75fa-469e-98b1-06722c9e1e00 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:38.784067 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575158f0-75fa-469e-98b1-06722c9e1e00 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:38.785867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 277/539] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:21:38.792391 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766a93f-6c1b-4cd4-b6a4-244b89b9210c None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:38.794723 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766a93f-6c1b-4cd4-b6a4-244b89b9210c None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:38.795254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766a93f-6c1b-4cd4-b6a4-244b89b9210c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:38.827086 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-3766a93f-6c1b-4cd4-b6a4-244b89b9210c None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:38.831578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-3766a93f-6c1b-4cd4-b6a4-244b89b9210c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:38.890257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:38.971375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 278/540] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:21:38.997923 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766a93f-6c1b-4cd4-b6a4-244b89b9210c None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:39.008690 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d32aec-8cf7-4161-8cad-9e00c72f97f3 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:39.032753 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:39.067125 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d015d-0207-4961-930a-dd5a200c7897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:39.067125 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d015d-0207-4961-930a-dd5a200c7897 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.067125 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d015d-0207-4961-930a-dd5a200c7897 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.067125 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d015d-0207-4961-930a-dd5a200c7897 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.082003 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d015d-0207-4961-930a-dd5a200c7897 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:39.083613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d015d-0207-4961-930a-dd5a200c7897 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:39.111493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-cd7d015d-0207-4961-930a-dd5a200c7897 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:39.111493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:39.111493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:39.111493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:39.111493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:39.111493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:39.111493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:39.111493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:39.111493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:39.111493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:39.111493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:39.111493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:39.111493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:39.111493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:39.111493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:39.112391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:39.112391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:39.112391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:39.112391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:39.112391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:39.112391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:39.112391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:39.112391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:39.112391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:39.112391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:39.112391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:39.112391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:39.112391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:39.112391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:39.112391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:39.112391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:39.112391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:39.113214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:39.113214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:39.113214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:39.113214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:39.113214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:39.113214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:39.113214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:39.113214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:39.113214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 263/541] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:39.119717 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d015d-0207-4961-930a-dd5a200c7897 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:39.154238 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766a93f-6c1b-4cd4-b6a4-244b89b9210c None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:39.201259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65627c4-e5e9-41f6-8a30-a614f025d311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:39.202111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65627c4-e5e9-41f6-8a30-a614f025d311 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.202396 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65627c4-e5e9-41f6-8a30-a614f025d311 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.202681 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65627c4-e5e9-41f6-8a30-a614f025d311 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.224922 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65627c4-e5e9-41f6-8a30-a614f025d311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:39.233566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-c65627c4-e5e9-41f6-8a30-a614f025d311 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:39.233566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:39.233566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:39.233566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:39.233566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:39.233566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:39.233566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:39.233566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:39.233566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:39.233566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:39.233566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:39.233566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:39.233566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:39.233566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:39.233566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:39.233566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:39.234510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:39.234510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:39.234510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:39.234510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:39.234510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:39.234510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:39.234510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:39.234510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:39.234510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:39.234510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:39.234510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:39.234510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:39.234510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:39.234510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:39.234510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:39.234510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:39.235335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:39.235335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:39.235335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:39.235335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:39.235335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:39.235335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:39.235335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:39.235335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:39.235335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:39.235335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:39.235335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:39.235335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:39.235335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 279/542] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:39.258142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65627c4-e5e9-41f6-8a30-a614f025d311 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:39.275577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d015d-0207-4961-930a-dd5a200c7897 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:39.278467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:39.343436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff75991-83cc-489f-8391-941a1aa21be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:39.344530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff75991-83cc-489f-8391-941a1aa21be5 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.345009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff75991-83cc-489f-8391-941a1aa21be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.345478 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff75991-83cc-489f-8391-941a1aa21be5 None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.346511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff75991-83cc-489f-8391-941a1aa21be5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:39.347016 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff75991-83cc-489f-8391-941a1aa21be5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:39.348687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff75991-83cc-489f-8391-941a1aa21be5 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:39.365982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 264/543] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:39.367801 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6bb85-2267-4526-ac4f-c51398e0caea None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.368314 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6bb85-2267-4526-ac4f-c51398e0caea None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.368855 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6bb85-2267-4526-ac4f-c51398e0caea None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.370860 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 265/544] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:39.373271 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6bb85-2267-4526-ac4f-c51398e0caea None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:39.422252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:39.440155 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65627c4-e5e9-41f6-8a30-a614f025d311 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:39.491395 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bded4-1626-4609-98f2-75732b0c04e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:39.492723 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bded4-1626-4609-98f2-75732b0c04e2 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.493007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bded4-1626-4609-98f2-75732b0c04e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.493285 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bded4-1626-4609-98f2-75732b0c04e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.494038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8bded4-1626-4609-98f2-75732b0c04e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:39.494343 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8bded4-1626-4609-98f2-75732b0c04e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:39.496149 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8bded4-1626-4609-98f2-75732b0c04e2 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:39.509375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 280/545] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:21:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:39.509375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39180ce3-cab4-4c86-a6d9-00c08d4e70ae None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.509375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39180ce3-cab4-4c86-a6d9-00c08d4e70ae None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.509375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39180ce3-cab4-4c86-a6d9-00c08d4e70ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.522197 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6bb85-2267-4526-ac4f-c51398e0caea None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:39.526057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-39180ce3-cab4-4c86-a6d9-00c08d4e70ae None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:39.527149 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-39180ce3-cab4-4c86-a6d9-00c08d4e70ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:39.574003 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45d7d3-216d-4632-a33f-8d38ff97978a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:39.575081 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45d7d3-216d-4632-a33f-8d38ff97978a None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.575597 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45d7d3-216d-4632-a33f-8d38ff97978a None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.576701 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45d7d3-216d-4632-a33f-8d38ff97978a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.577747 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45d7d3-216d-4632-a33f-8d38ff97978a None admin] RBAC: Adding query filter params (role.id=c6f0b65d6ea5449ca79744ac52243ba2, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=2af2d348fc984ed897fd58196b433b58) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:39.578304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45d7d3-216d-4632-a33f-8d38ff97978a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:39.580797 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45d7d3-216d-4632-a33f-8d38ff97978a None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:39.590164 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 266/546] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:39 2022] GET /identity/v3/role_assignments?user.id=2af2d348fc984ed897fd58196b433b58&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=c6f0b65d6ea5449ca79744ac52243ba2 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:39.591757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45d7d3-216d-4632-a33f-8d38ff97978a None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:39.631507 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:39.657422 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 281/547] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:39.709815 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39180ce3-cab4-4c86-a6d9-00c08d4e70ae None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:39.723870 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45d7d3-216d-4632-a33f-8d38ff97978a None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:39.769466 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f2cd0-25d5-4508-bbd7-5c7fbdf09663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:39.770955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f2cd0-25d5-4508-bbd7-5c7fbdf09663 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.771486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f2cd0-25d5-4508-bbd7-5c7fbdf09663 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.771986 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f2cd0-25d5-4508-bbd7-5c7fbdf09663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.786947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f2cd0-25d5-4508-bbd7-5c7fbdf09663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:39.788891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f2cd0-25d5-4508-bbd7-5c7fbdf09663 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:39.810940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-c52f2cd0-25d5-4508-bbd7-5c7fbdf09663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:39.810940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:39.810940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:39.810940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:39.810940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:39.810940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:39.810940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:39.810940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:39.810940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:39.810940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:39.810940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:39.810940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:39.810940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:39.810940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:39.810940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:39.811947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:39.811947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:39.811947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:39.811947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:39.811947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:39.811947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:39.811947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:39.811947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:39.811947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:39.811947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:39.811947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:39.811947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:39.811947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:39.811947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:39.811947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:39.811947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:39.811947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:39.812760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:39.812760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:39.812760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:39.812760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:39.820622 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 267/548] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:39.821596 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f2cd0-25d5-4508-bbd7-5c7fbdf09663 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:39.919972 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:39.943806 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f2cd0-25d5-4508-bbd7-5c7fbdf09663 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:39.975655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:39.987744 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9dde5-ccae-4b87-90e2-1e484e90a40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:39.988425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9dde5-ccae-4b87-90e2-1e484e90a40f None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:39.988707 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9dde5-ccae-4b87-90e2-1e484e90a40f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:39.988983 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9dde5-ccae-4b87-90e2-1e484e90a40f None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:39.989709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9dde5-ccae-4b87-90e2-1e484e90a40f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:39.990016 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9dde5-ccae-4b87-90e2-1e484e90a40f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:39.991432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9dde5-ccae-4b87-90e2-1e484e90a40f None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:40.007595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 268/549] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:40.013848 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9dde5-ccae-4b87-90e2-1e484e90a40f None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:40.041647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39180ce3-cab4-4c86-a6d9-00c08d4e70ae None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:40.136578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9dde5-ccae-4b87-90e2-1e484e90a40f None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:40.147921 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fc4fa-5387-464b-a3b3-b185f76914a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:40.149667 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fc4fa-5387-464b-a3b3-b185f76914a6 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:40.150194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fc4fa-5387-464b-a3b3-b185f76914a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:40.150669 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fc4fa-5387-464b-a3b3-b185f76914a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:40.162115 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fc4fa-5387-464b-a3b3-b185f76914a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:40.175655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-444fc4fa-5387-464b-a3b3-b185f76914a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:40.175655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:40.175655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:40.175655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:40.175655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:40.175655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:40.175655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:40.175655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:40.175655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:40.175655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:40.175655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:40.175655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:40.175655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:40.175655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:40.175655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:40.175655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:40.176571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:40.176571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:40.176571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:40.176571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:40.176571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:40.176571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:40.176571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:40.176571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:40.176571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:40.176571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:40.176571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:40.176571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:40.176571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:40.176571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:40.176571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:40.176571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:40.177348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:40.177348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:40.177348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:40.177348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:40.177348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:40.177348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:40.177348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:40.177348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:40.177348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:40.177348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:40.177348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:40.177348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:40.185312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 282/550] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 475 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:40.186063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240b785-d600-4b7c-9693-ea14c7571ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:40.187196 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b785-d600-4b7c-9693-ea14c7571ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:40.187527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b785-d600-4b7c-9693-ea14c7571ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:40.187807 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b785-d600-4b7c-9693-ea14c7571ff5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:40.195578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fc4fa-5387-464b-a3b3-b185f76914a6 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:40.202712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240b785-d600-4b7c-9693-ea14c7571ff5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:40.205635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240b785-d600-4b7c-9693-ea14c7571ff5 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:40.212976 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:40.231037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-e240b785-d600-4b7c-9693-ea14c7571ff5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:21:40.231037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:40.231037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:40.231037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:40.231037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:40.231037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:40.231037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:40.231037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:40.231037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:40.231037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:40.231037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:40.231037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:40.231037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:40.231037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:40.231037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:40.231037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:40.233219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:40.233219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:40.233219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:40.233219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:40.233219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:40.233219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:40.233219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:40.233219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:40.233219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:40.233219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:40.233219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:40.233219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:40.233219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:40.233219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:40.233219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:40.233219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:40.233219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:40.233219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:40.234121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:40.234121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:40.234121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:40.234121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:40.234121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:40.234121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:40.234121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:40.234121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:40.234121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:21:40.234121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:40.234121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 269/551] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:21:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:40.234121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd7f4c-9225-4447-993a-a06d6b08e758 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:40.234741 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd7f4c-9225-4447-993a-a06d6b08e758 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:40.234741 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd7f4c-9225-4447-993a-a06d6b08e758 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:40.243309 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 270/552] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:40.246431 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd506e-9721-4752-bab0-bf28ec8c1f6a None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:40.246431 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd506e-9721-4752-bab0-bf28ec8c1f6a None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:40.246606 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd506e-9721-4752-bab0-bf28ec8c1f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:40.268097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-08fd506e-9721-4752-bab0-bf28ec8c1f6a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:40.269300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-08fd506e-9721-4752-bab0-bf28ec8c1f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:40.346192 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 271/553] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:40.347114 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd506e-9721-4752-bab0-bf28ec8c1f6a None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:40.357129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fc4fa-5387-464b-a3b3-b185f76914a6 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:40.404989 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87af040-0dbb-4713-a462-f80fe2c718f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:40.406475 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87af040-0dbb-4713-a462-f80fe2c718f2 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:40.406975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87af040-0dbb-4713-a462-f80fe2c718f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:40.407639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87af040-0dbb-4713-a462-f80fe2c718f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:40.408602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87af040-0dbb-4713-a462-f80fe2c718f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:40.409566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87af040-0dbb-4713-a462-f80fe2c718f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:40.412091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87af040-0dbb-4713-a462-f80fe2c718f2 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:40.426671 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 283/554] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:21:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:40.428315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87af040-0dbb-4713-a462-f80fe2c718f2 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:40.435555 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:40.477887 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd506e-9721-4752-bab0-bf28ec8c1f6a None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:40.516522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:40.526933 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03132263-5401-4122-8c0c-f0b4eb810b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:40.528094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03132263-5401-4122-8c0c-f0b4eb810b5d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:40.528523 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03132263-5401-4122-8c0c-f0b4eb810b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:40.528874 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03132263-5401-4122-8c0c-f0b4eb810b5d None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:40.531068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03132263-5401-4122-8c0c-f0b4eb810b5d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:40.531608 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03132263-5401-4122-8c0c-f0b4eb810b5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:40.534379 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03132263-5401-4122-8c0c-f0b4eb810b5d None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:40.556440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 272/555] 10.222.0.40 () {56 vars in 1135 bytes} [Tue Jul 12 14:21:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:40.557530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03132263-5401-4122-8c0c-f0b4eb810b5d None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:40.574010 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87af040-0dbb-4713-a462-f80fe2c718f2 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:40.617875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2c1d3-ff5e-4c98-a5cf-562d302d701f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:40.618990 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2c1d3-ff5e-4c98-a5cf-562d302d701f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:40.619442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2c1d3-ff5e-4c98-a5cf-562d302d701f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:40.619905 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2c1d3-ff5e-4c98-a5cf-562d302d701f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:40.635255 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2c1d3-ff5e-4c98-a5cf-562d302d701f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:40.645651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-a1c2c1d3-ff5e-4c98-a5cf-562d302d701f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:40.645651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:40.645651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:40.645651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:40.645651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:40.645651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:40.645651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:40.645651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:40.645651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:40.645651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:40.645651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:40.645651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:40.645651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:40.645651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:40.645651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:40.645651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:40.646602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:40.646602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:40.646602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:40.646602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:40.646602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:40.646602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:40.646602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:40.646602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:40.646602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:40.646602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:40.646602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:40.646602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:40.646602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:40.646602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:40.646602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:40.646602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:40.647552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:40.647552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:40.647552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:40.647552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:40.647552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:40.647552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:40.647552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:40.647552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:40.647552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:40.647552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:40.647552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:40.647552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:40.650117 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 284/556] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:40.650768 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2c1d3-ff5e-4c98-a5cf-562d302d701f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:40.721197 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03132263-5401-4122-8c0c-f0b4eb810b5d None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:40.765306 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37610e61-3d8b-4648-81e7-23b2cf8724f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:40.767210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37610e61-3d8b-4648-81e7-23b2cf8724f0 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:40.767542 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37610e61-3d8b-4648-81e7-23b2cf8724f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:40.767818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37610e61-3d8b-4648-81e7-23b2cf8724f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:40.768719 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:40.785834 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37610e61-3d8b-4648-81e7-23b2cf8724f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:40.787390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37610e61-3d8b-4648-81e7-23b2cf8724f0 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:40.810371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-37610e61-3d8b-4648-81e7-23b2cf8724f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:40.810371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:40.810371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:40.810371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:40.810371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:40.810371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:40.810371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:40.810371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:40.810371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:40.810371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:40.810371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:40.810371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:40.810371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:40.810371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:40.810371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:40.811712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:40.811712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:40.811712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:40.811712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:40.811712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:40.811712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:40.811712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:40.811712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:40.811712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:40.811712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:40.811712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:40.811712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:40.811712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:40.811712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:40.811712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:40.811712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:40.811712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:40.812655 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:40.812655 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:40.812655 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:40.812655 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:40.815726 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 273/557] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:40.816634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37610e61-3d8b-4648-81e7-23b2cf8724f0 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:40.824474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2c1d3-ff5e-4c98-a5cf-562d302d701f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:40.869657 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c8981-9c4b-4141-9834-4d6a40b27613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:40.870920 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c8981-9c4b-4141-9834-4d6a40b27613 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:40.871420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c8981-9c4b-4141-9834-4d6a40b27613 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:40.871755 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c8981-9c4b-4141-9834-4d6a40b27613 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:40.879334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:40.956584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c8981-9c4b-4141-9834-4d6a40b27613 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:40.956790 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37610e61-3d8b-4648-81e7-23b2cf8724f0 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:40.958083 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c8981-9c4b-4141-9834-4d6a40b27613 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:40.994195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad150d2-bd65-43a6-9bf9-cbf35a3d8b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:40.994785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad150d2-bd65-43a6-9bf9-cbf35a3d8b3e None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:40.995066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad150d2-bd65-43a6-9bf9-cbf35a3d8b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:40.995382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad150d2-bd65-43a6-9bf9-cbf35a3d8b3e None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:40.996392 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad150d2-bd65-43a6-9bf9-cbf35a3d8b3e None admin] RBAC: Adding query filter params (name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:40.996696 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad150d2-bd65-43a6-9bf9-cbf35a3d8b3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:40.998140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad150d2-bd65-43a6-9bf9-cbf35a3d8b3e None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:41.007877 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 274/558] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:21:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:41.008557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad150d2-bd65-43a6-9bf9-cbf35a3d8b3e None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:41.034848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:41.084487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 285/559] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:41.089322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12629129-2dcb-4d6a-b0f2-ec6dcbbd2728 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:41.089322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12629129-2dcb-4d6a-b0f2-ec6dcbbd2728 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:41.089322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12629129-2dcb-4d6a-b0f2-ec6dcbbd2728 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:41.089322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 286/560] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:41.089322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12629129-2dcb-4d6a-b0f2-ec6dcbbd2728 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:41.141219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad150d2-bd65-43a6-9bf9-cbf35a3d8b3e None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:41.142993 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:41.178786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c05bc9-4fc4-4d2f-a48b-35b1743471c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:41.180150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c05bc9-4fc4-4d2f-a48b-35b1743471c6 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:41.180732 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c05bc9-4fc4-4d2f-a48b-35b1743471c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:41.180732 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c05bc9-4fc4-4d2f-a48b-35b1743471c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:41.181481 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c05bc9-4fc4-4d2f-a48b-35b1743471c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:41.181779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c05bc9-4fc4-4d2f-a48b-35b1743471c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:41.183496 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c05bc9-4fc4-4d2f-a48b-35b1743471c6 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:41.203953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 275/561] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:41.203953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c05bc9-4fc4-4d2f-a48b-35b1743471c6 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:41.219723 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12629129-2dcb-4d6a-b0f2-ec6dcbbd2728 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:41.274969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dbc50-9b86-4717-ae9e-0e22b03e1516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:41.275766 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dbc50-9b86-4717-ae9e-0e22b03e1516 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:41.276048 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dbc50-9b86-4717-ae9e-0e22b03e1516 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:41.276325 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dbc50-9b86-4717-ae9e-0e22b03e1516 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:41.287625 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6dbc50-9b86-4717-ae9e-0e22b03e1516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:41.289879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6dbc50-9b86-4717-ae9e-0e22b03e1516 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:41.309464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-8b6dbc50-9b86-4717-ae9e-0e22b03e1516 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:41.309464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:41.309464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:41.309464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:41.309464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:41.309464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:41.309464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:41.309464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:41.309464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:41.309464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:41.309464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:41.309464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:41.309464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:41.309464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:41.309464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:41.315780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:41.315780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:41.315780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:41.315780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:41.315780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:41.315780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:41.315780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:41.315780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:41.315780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:41.315780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:41.315780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:41.315780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:41.315780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:41.315780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:41.315780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:41.315780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:41.315780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:41.316680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:41.316680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:41.316680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:41.316680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:41.316680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 287/562] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:41.316680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac3229-f990-45c5-bd7e-31290eb71e10 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:41.316680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac3229-f990-45c5-bd7e-31290eb71e10 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:41.316680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac3229-f990-45c5-bd7e-31290eb71e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:41.331927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c05bc9-4fc4-4d2f-a48b-35b1743471c6 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:41.339381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-4aac3229-f990-45c5-bd7e-31290eb71e10 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:41.342188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-4aac3229-f990-45c5-bd7e-31290eb71e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:41.352994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:41.382559 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006831b-2afd-4b25-a685-986c9971a3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:41.383496 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006831b-2afd-4b25-a685-986c9971a3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:41.383785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006831b-2afd-4b25-a685-986c9971a3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:41.384062 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006831b-2afd-4b25-a685-986c9971a3b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:41.396445 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006831b-2afd-4b25-a685-986c9971a3b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:41.398623 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006831b-2afd-4b25-a685-986c9971a3b3 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:41.417333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-7006831b-2afd-4b25-a685-986c9971a3b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:41.417333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:41.417333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:41.417333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:41.417333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:41.417333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:41.417333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:41.417333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:41.417333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:41.417333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:41.417333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:41.417333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:41.417333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:41.417333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:41.417333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:41.418237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:41.418237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:41.418237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:41.418237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:41.418237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:41.418237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:41.418237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:41.418237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:41.418237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:41.418237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:41.418237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:41.418237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:41.418237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:41.418237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:41.418237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:41.418237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:41.418237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:41.419105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:41.419105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:41.419105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:41.419105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:41.419105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 276/563] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:41.419418 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006831b-2afd-4b25-a685-986c9971a3b3 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:41.428213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 288/564] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:41.429404 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac3229-f990-45c5-bd7e-31290eb71e10 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:41.439670 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:41.537605 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006831b-2afd-4b25-a685-986c9971a3b3 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:41.553641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac3229-f990-45c5-bd7e-31290eb71e10 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:41.576166 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1f97d-2d4a-4762-be01-5a4c11e5a0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:41.576968 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1f97d-2d4a-4762-be01-5a4c11e5a0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:41.577256 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1f97d-2d4a-4762-be01-5a4c11e5a0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:41.577535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1f97d-2d4a-4762-be01-5a4c11e5a0f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:41.584963 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1f97d-2d4a-4762-be01-5a4c11e5a0f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:41.587054 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1f97d-2d4a-4762-be01-5a4c11e5a0f3 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:41.590347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5127b5-f072-4d49-b355-7d5620b8f12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:41.591015 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5127b5-f072-4d49-b355-7d5620b8f12d None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:41.591307 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5127b5-f072-4d49-b355-7d5620b8f12d None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:41.591590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5127b5-f072-4d49-b355-7d5620b8f12d None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:41.592315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5127b5-f072-4d49-b355-7d5620b8f12d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:41.592624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5127b5-f072-4d49-b355-7d5620b8f12d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:41.593998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5127b5-f072-4d49-b355-7d5620b8f12d None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:41.602837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-91e1f97d-2d4a-4762-be01-5a4c11e5a0f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:21:41.602837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:41.602837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:41.602837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:41.602837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:41.602837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:41.602837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:41.602837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:41.602837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:41.602837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:41.602837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:41.602837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:41.602837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:41.602837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:41.602837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:41.602837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:41.604228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:41.604228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:41.604228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:41.604228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:41.604228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:41.604228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:41.604228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:41.604228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:41.604228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:41.604228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:41.604228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:41.604228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:41.604228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:41.604228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:41.604228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:41.604228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:41.604228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:41.604228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:41.605464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:41.605464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:41.605464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:41.605464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:41.605464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:41.605464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:41.605464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:41.605464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:41.605464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:21:41.605464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:41.605464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 277/565] 10.222.0.40 () {56 vars in 1093 bytes} [Tue Jul 12 14:21:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:41.605464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1f97d-2d4a-4762-be01-5a4c11e5a0f3 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:41.611744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 289/566] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:41.611744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5127b5-f072-4d49-b355-7d5620b8f12d None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:41.629907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:41.703710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:41.727074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5127b5-f072-4d49-b355-7d5620b8f12d None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:41.738893 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1f97d-2d4a-4762-be01-5a4c11e5a0f3 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:41.764984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f8c2b-a759-4ae0-92e9-91f5f984968f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:41.765822 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f8c2b-a759-4ae0-92e9-91f5f984968f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:41.766106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f8c2b-a759-4ae0-92e9-91f5f984968f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:41.766385 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f8c2b-a759-4ae0-92e9-91f5f984968f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:41.780553 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ef05d-d5dc-4101-bc9e-c475a323d0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:41.781225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ef05d-d5dc-4101-bc9e-c475a323d0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:41.781414 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f8c2b-a759-4ae0-92e9-91f5f984968f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:41.781518 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ef05d-d5dc-4101-bc9e-c475a323d0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:41.781775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ef05d-d5dc-4101-bc9e-c475a323d0e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:41.782499 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ef05d-d5dc-4101-bc9e-c475a323d0e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:41.782806 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ef05d-d5dc-4101-bc9e-c475a323d0e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:41.784287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ef05d-d5dc-4101-bc9e-c475a323d0e3 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:41.789468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-ba4f8c2b-a759-4ae0-92e9-91f5f984968f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:41.789468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:41.789468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:41.789468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:41.789468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:41.789468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:41.789468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:41.789468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:41.789468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:41.789468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:41.789468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:41.789468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:41.789468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:41.789468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:41.789468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:41.789468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:41.790381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:41.790381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:41.790381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:41.790381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:41.790381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:41.790381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:41.790381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:41.790381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:41.790381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:41.790381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:41.790381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:41.790381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:41.790381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:41.790381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:41.790381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:41.790381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:41.791188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:41.791188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:41.791188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:41.791188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:41.791188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:41.791188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:41.791188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:41.791188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:41.791188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:41.791188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:41.791188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:41.791188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:41.791188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 290/567] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:41.791909 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f8c2b-a759-4ae0-92e9-91f5f984968f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:41.802749 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 278/568] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:41.804893 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ef05d-d5dc-4101-bc9e-c475a323d0e3 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:41.869060 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:41.906161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f8c2b-a759-4ae0-92e9-91f5f984968f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:41.919122 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ef05d-d5dc-4101-bc9e-c475a323d0e3 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:41.941401 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31cdb8-b0d5-4d4e-bbd8-13a0f9294da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:41.942089 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31cdb8-b0d5-4d4e-bbd8-13a0f9294da9 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:41.942371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31cdb8-b0d5-4d4e-bbd8-13a0f9294da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:41.942653 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31cdb8-b0d5-4d4e-bbd8-13a0f9294da9 None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:41.943523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31cdb8-b0d5-4d4e-bbd8-13a0f9294da9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:41.943836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31cdb8-b0d5-4d4e-bbd8-13a0f9294da9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:41.946001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31cdb8-b0d5-4d4e-bbd8-13a0f9294da9 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:41.954667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f74b1-1e18-4c58-8825-41ada3c85d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:41.955504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f74b1-1e18-4c58-8825-41ada3c85d65 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:41.955795 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f74b1-1e18-4c58-8825-41ada3c85d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:41.956075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f74b1-1e18-4c58-8825-41ada3c85d65 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:41.958082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:41.964752 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 291/569] 10.222.0.40 () {56 vars in 1133 bytes} [Tue Jul 12 14:21:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:41.965603 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31cdb8-b0d5-4d4e-bbd8-13a0f9294da9 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:41.965897 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f74b1-1e18-4c58-8825-41ada3c85d65 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:41.967590 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f74b1-1e18-4c58-8825-41ada3c85d65 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:41.982938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-136f74b1-1e18-4c58-8825-41ada3c85d65 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 14:21:41.982938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:41.982938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:41.982938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:41.982938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:41.982938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:41.982938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:41.982938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:41.982938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:41.982938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:41.982938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:41.982938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:41.982938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:41.982938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:41.982938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:41.982938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:41.984143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:41.984143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:41.984143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:41.984143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:41.984143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:41.984143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:41.984143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:41.984143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:41.984143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:41.984143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:41.984143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:41.984143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:41.984143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:41.984143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:41.984143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:41.984143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:41.984143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:41.984143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:41.985341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:41.985341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:41.985341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:41.985341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:41.985341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:41.985341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:41.985341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:41.985341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:41.985341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 14:21:41.985341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:41.985341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 279/570] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:41.985341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f74b1-1e18-4c58-8825-41ada3c85d65 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:42.077515 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31cdb8-b0d5-4d4e-bbd8-13a0f9294da9 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:42.092575 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f74b1-1e18-4c58-8825-41ada3c85d65 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:42.101621 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:42.114144 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298729d1-4615-4e36-84c5-a94108f54d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:42.114944 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298729d1-4615-4e36-84c5-a94108f54d5c None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:42.115351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298729d1-4615-4e36-84c5-a94108f54d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:42.115561 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298729d1-4615-4e36-84c5-a94108f54d5c None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:42.116292 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298729d1-4615-4e36-84c5-a94108f54d5c None admin] RBAC: Adding query filter params (name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:42.117281 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298729d1-4615-4e36-84c5-a94108f54d5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:42.118890 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298729d1-4615-4e36-84c5-a94108f54d5c None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:42.127946 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 292/571] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:21:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:42.129222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20ca5c-8ce4-41ac-b8eb-f24fae3e4abe None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:42.129511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20ca5c-8ce4-41ac-b8eb-f24fae3e4abe None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:42.129790 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20ca5c-8ce4-41ac-b8eb-f24fae3e4abe None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:42.131025 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 293/572] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:42.131767 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20ca5c-8ce4-41ac-b8eb-f24fae3e4abe None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:42.138252 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1cbb0-21c8-47fd-a785-335930aebbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:42.139126 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1cbb0-21c8-47fd-a785-335930aebbae None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:42.139446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1cbb0-21c8-47fd-a785-335930aebbae None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:42.139721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1cbb0-21c8-47fd-a785-335930aebbae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:42.146710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1cbb0-21c8-47fd-a785-335930aebbae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:42.148246 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1cbb0-21c8-47fd-a785-335930aebbae None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:42.162400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-1fb1cbb0-21c8-47fd-a785-335930aebbae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:42.162400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:42.162400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:42.162400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:42.162400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:42.162400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:42.162400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:42.162400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:42.162400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:42.162400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:42.162400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:42.162400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:42.162400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:42.162400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:42.162400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:42.163526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:42.163526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:42.163526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:42.163526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:42.163526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:42.163526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:42.163526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:42.163526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:42.163526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:42.163526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:42.163526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:42.163526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:42.163526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:42.163526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:42.163526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:42.163526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:42.163526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:42.164506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:42.164506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:42.164506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:42.164506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:42.164506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:42.164506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:42.164506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:42.164506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:42.164506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 280/573] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:42.165081 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1cbb0-21c8-47fd-a785-335930aebbae None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:42.224322 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:42.258375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20ca5c-8ce4-41ac-b8eb-f24fae3e4abe None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:42.272785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1cbb0-21c8-47fd-a785-335930aebbae None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:42.292999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efca2c-005d-4744-8155-fb87ef9951e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:42.293800 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efca2c-005d-4744-8155-fb87ef9951e2 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:42.294092 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efca2c-005d-4744-8155-fb87ef9951e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:42.294356 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efca2c-005d-4744-8155-fb87ef9951e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:42.306391 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efca2c-005d-4744-8155-fb87ef9951e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:42.307910 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efca2c-005d-4744-8155-fb87ef9951e2 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:42.309081 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a659a9-cfe7-4f47-9b16-5c168c4e010a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:42.309776 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a659a9-cfe7-4f47-9b16-5c168c4e010a None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:42.310065 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a659a9-cfe7-4f47-9b16-5c168c4e010a None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:42.310347 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a659a9-cfe7-4f47-9b16-5c168c4e010a None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:42.311210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a659a9-cfe7-4f47-9b16-5c168c4e010a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:42.311557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a659a9-cfe7-4f47-9b16-5c168c4e010a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:42.312982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a659a9-cfe7-4f47-9b16-5c168c4e010a None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:42.326303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-66efca2c-005d-4744-8155-fb87ef9951e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:42.326303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:42.326303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:42.326303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:42.326303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:42.326303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:42.326303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:42.326303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:42.326303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:42.326303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:42.326303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:42.326303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:42.326303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:42.326303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:42.326303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:42.327210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:42.327210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:42.327210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:42.327210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:42.327210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:42.327210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:42.327210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:42.327210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:42.327210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:42.327210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:42.327210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:42.327210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:42.327210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:42.327210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:42.327210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:42.327210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:42.327210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:42.328190 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:42.328190 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:42.328190 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:42.328190 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:42.331576 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 294/574] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:42.332346 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efca2c-005d-4744-8155-fb87ef9951e2 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:42.332507 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 281/575] 10.222.0.40 () {56 vars in 1137 bytes} [Tue Jul 12 14:21:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:42.333807 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a407f-e120-4f38-9289-23e3e79bf685 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:42.334098 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a407f-e120-4f38-9289-23e3e79bf685 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:42.334378 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a407f-e120-4f38-9289-23e3e79bf685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:42.352991 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-246a407f-e120-4f38-9289-23e3e79bf685 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:42.354222 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-246a407f-e120-4f38-9289-23e3e79bf685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:42.374908 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:42.439313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 282/576] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:42.439313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a407f-e120-4f38-9289-23e3e79bf685 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:42.442589 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efca2c-005d-4744-8155-fb87ef9951e2 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:42.471797 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:42.478603 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96919e48-df17-432c-865b-1758f90d6d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:42.479443 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96919e48-df17-432c-865b-1758f90d6d98 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:42.479749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96919e48-df17-432c-865b-1758f90d6d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:42.483753 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96919e48-df17-432c-865b-1758f90d6d98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:42.490671 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96919e48-df17-432c-865b-1758f90d6d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:42.492298 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96919e48-df17-432c-865b-1758f90d6d98 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:42.511535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-96919e48-df17-432c-865b-1758f90d6d98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:42.511535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:42.511535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:42.511535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:42.511535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:42.511535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:42.511535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:42.511535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:42.511535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:42.511535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:42.511535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:42.511535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:42.511535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:42.511535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:42.511535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:42.512469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:42.512469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:42.512469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:42.512469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:42.512469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:42.512469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:42.512469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:42.512469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:42.512469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:42.512469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:42.512469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:42.512469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:42.512469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:42.512469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:42.512469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:42.512469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:42.512469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:42.513418 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:42.513418 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:42.513418 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:42.513418 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:42.513418 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 295/577] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:42.514259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96919e48-df17-432c-865b-1758f90d6d98 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:42.541201 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a407f-e120-4f38-9289-23e3e79bf685 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:42.578994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc2dd2-50d7-4245-b6f2-9b519a2ffbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:42.579611 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc2dd2-50d7-4245-b6f2-9b519a2ffbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:42.579896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc2dd2-50d7-4245-b6f2-9b519a2ffbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:42.580171 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc2dd2-50d7-4245-b6f2-9b519a2ffbd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:42.580963 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc2dd2-50d7-4245-b6f2-9b519a2ffbd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:42.581273 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc2dd2-50d7-4245-b6f2-9b519a2ffbd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:42.582714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc2dd2-50d7-4245-b6f2-9b519a2ffbd5 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:42.600325 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 283/578] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:42.600325 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc2dd2-50d7-4245-b6f2-9b519a2ffbd5 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:42.610779 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:42.620403 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96919e48-df17-432c-865b-1758f90d6d98 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:42.655506 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57a232-dbf1-455b-a597-e94054fd801d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:42.656305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57a232-dbf1-455b-a597-e94054fd801d None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:42.656585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57a232-dbf1-455b-a597-e94054fd801d None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:42.656867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57a232-dbf1-455b-a597-e94054fd801d None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:42.657582 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57a232-dbf1-455b-a597-e94054fd801d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:42.657888 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57a232-dbf1-455b-a597-e94054fd801d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:42.659252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57a232-dbf1-455b-a597-e94054fd801d None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:42.671243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 296/579] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:42.672052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57a232-dbf1-455b-a597-e94054fd801d None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:42.715053 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc2dd2-50d7-4245-b6f2-9b519a2ffbd5 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:42.716653 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:42.749152 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f5066-dbb7-4885-93fc-66cc94adc752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:42.749969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f5066-dbb7-4885-93fc-66cc94adc752 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:42.750556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f5066-dbb7-4885-93fc-66cc94adc752 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:42.750829 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f5066-dbb7-4885-93fc-66cc94adc752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:42.762064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f5066-dbb7-4885-93fc-66cc94adc752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:42.763536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f5066-dbb7-4885-93fc-66cc94adc752 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:42.779030 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57a232-dbf1-455b-a597-e94054fd801d None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:42.780953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-f93f5066-dbb7-4885-93fc-66cc94adc752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:42.780953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:42.780953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:42.780953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:42.780953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:42.780953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:42.780953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:42.780953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:42.780953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:42.780953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:42.780953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:42.780953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:42.780953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:42.780953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:42.780953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:42.781819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:42.781819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:42.781819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:42.781819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:42.781819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:42.781819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:42.781819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:42.781819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:42.781819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:42.781819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:42.781819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:42.781819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:42.781819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:42.781819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:42.781819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:42.781819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:42.781819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:42.782700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:42.782700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:42.782700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:42.782700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:42.782700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 284/580] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:42.782965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f5066-dbb7-4885-93fc-66cc94adc752 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:42.815750 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538497f-ffc7-4d69-90e1-fc529dc7156b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:42.816539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538497f-ffc7-4d69-90e1-fc529dc7156b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:42.816820 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538497f-ffc7-4d69-90e1-fc529dc7156b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:42.817100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538497f-ffc7-4d69-90e1-fc529dc7156b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:42.828426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538497f-ffc7-4d69-90e1-fc529dc7156b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:42.837044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-c538497f-ffc7-4d69-90e1-fc529dc7156b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:42.837044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:42.837044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:42.837044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:42.837044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:42.837044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:42.837044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:42.837044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:42.837044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:42.837044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:42.837044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:42.837044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:42.837044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:42.837044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:42.837044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:42.837044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:42.837942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:42.837942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:42.837942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:42.837942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:42.837942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:42.837942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:42.837942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:42.837942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:42.837942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:42.837942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:42.837942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:42.837942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:42.837942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:42.837942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:42.837942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:42.837942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:42.839002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:42.839002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:42.839002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:42.839002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:42.839002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:42.839002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:42.839002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:42.839002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:42.839002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:42.839002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:42.839002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:42.839002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:42.839002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 297/581] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:42.839002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538497f-ffc7-4d69-90e1-fc529dc7156b None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:42.852604 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:42.885248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f5066-dbb7-4885-93fc-66cc94adc752 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:42.920618 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a866a35-a91e-456a-8146-6eb0fddbff57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:42.921297 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a866a35-a91e-456a-8146-6eb0fddbff57 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:42.921583 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a866a35-a91e-456a-8146-6eb0fddbff57 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:42.921860 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a866a35-a91e-456a-8146-6eb0fddbff57 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:42.922596 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a866a35-a91e-456a-8146-6eb0fddbff57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:42.922907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a866a35-a91e-456a-8146-6eb0fddbff57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:42.924373 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a866a35-a91e-456a-8146-6eb0fddbff57 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:42.938831 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 285/582] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:42.939702 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a866a35-a91e-456a-8146-6eb0fddbff57 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:42.947813 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538497f-ffc7-4d69-90e1-fc529dc7156b None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:42.958555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:42.983796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb73a7-54ce-43e5-beb2-b0fba0b91b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:42.985820 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb73a7-54ce-43e5-beb2-b0fba0b91b7c None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:42.985820 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb73a7-54ce-43e5-beb2-b0fba0b91b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:42.985820 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb73a7-54ce-43e5-beb2-b0fba0b91b7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:42.986080 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb73a7-54ce-43e5-beb2-b0fba0b91b7c None admin] RBAC: Adding query filter params (role.id=c6f0b65d6ea5449ca79744ac52243ba2, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=ad12085f356a4f0682bb70ad231a10b6) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:42.986286 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb73a7-54ce-43e5-beb2-b0fba0b91b7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:42.987751 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb73a7-54ce-43e5-beb2-b0fba0b91b7c None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:42.994447 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 298/583] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:42 2022] GET /identity/v3/role_assignments?user.id=ad12085f356a4f0682bb70ad231a10b6&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=c6f0b65d6ea5449ca79744ac52243ba2 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:42.995245 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb73a7-54ce-43e5-beb2-b0fba0b91b7c None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:43.068600 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a866a35-a91e-456a-8146-6eb0fddbff57 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:43.093705 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:43.119085 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccad278-7a34-4c87-9b56-0a68fb94487f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:43.119939 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccad278-7a34-4c87-9b56-0a68fb94487f None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:43.120222 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccad278-7a34-4c87-9b56-0a68fb94487f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:43.120499 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccad278-7a34-4c87-9b56-0a68fb94487f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:43.123184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb73a7-54ce-43e5-beb2-b0fba0b91b7c None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:43.128451 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccad278-7a34-4c87-9b56-0a68fb94487f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:43.129974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccad278-7a34-4c87-9b56-0a68fb94487f None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:43.146158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-7ccad278-7a34-4c87-9b56-0a68fb94487f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:43.146158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:43.146158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:43.146158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:43.146158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:43.146158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:43.146158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:43.146158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:43.146158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:43.146158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:43.146158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:43.146158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:43.146158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:43.146158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:43.146158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:43.148527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:43.148527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:43.148527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:43.148527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:43.148527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:43.148527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:43.148527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:43.148527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:43.148527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:43.148527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:43.148527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:43.148527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:43.148527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:43.148527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:43.148527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:43.148527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:43.148527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:43.151030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:43.151030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:43.151030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:43.151030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:43.151030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:43.151030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:43.151030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:43.151030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:43.151030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 286/584] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:43.153271 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccad278-7a34-4c87-9b56-0a68fb94487f None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:43.170191 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713057a-5abe-4a19-9674-2daff2e0f32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:43.170911 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713057a-5abe-4a19-9674-2daff2e0f32c None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:43.171196 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713057a-5abe-4a19-9674-2daff2e0f32c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:43.171552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713057a-5abe-4a19-9674-2daff2e0f32c None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:43.172282 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713057a-5abe-4a19-9674-2daff2e0f32c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:43.172588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713057a-5abe-4a19-9674-2daff2e0f32c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:43.174014 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713057a-5abe-4a19-9674-2daff2e0f32c None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:43.199675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 299/585] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:43.199675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713057a-5abe-4a19-9674-2daff2e0f32c None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:43.264021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:43.282179 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccad278-7a34-4c87-9b56-0a68fb94487f None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:43.321006 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a6cd-d7a1-4b4e-9ce0-5480fdc11aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:43.321690 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a6cd-d7a1-4b4e-9ce0-5480fdc11aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:43.321974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a6cd-d7a1-4b4e-9ce0-5480fdc11aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:43.322236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a6cd-d7a1-4b4e-9ce0-5480fdc11aa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:43.322646 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713057a-5abe-4a19-9674-2daff2e0f32c None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:43.322996 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30a6cd-d7a1-4b4e-9ce0-5480fdc11aa5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:43.323324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30a6cd-d7a1-4b4e-9ce0-5480fdc11aa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:43.324709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30a6cd-d7a1-4b4e-9ce0-5480fdc11aa5 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:43.338220 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 287/586] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:21:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:43.338220 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a6cd-d7a1-4b4e-9ce0-5480fdc11aa5 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:43.365573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f3074-4dea-4e55-9fc4-271224508aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:43.366287 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f3074-4dea-4e55-9fc4-271224508aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:43.366638 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f3074-4dea-4e55-9fc4-271224508aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:43.367489 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f3074-4dea-4e55-9fc4-271224508aa4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:43.369701 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:43.375955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f3074-4dea-4e55-9fc4-271224508aa4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:43.377400 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f3074-4dea-4e55-9fc4-271224508aa4 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:43.392933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-928f3074-4dea-4e55-9fc4-271224508aa4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 14:21:43.392933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:43.392933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:43.392933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:43.392933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:43.392933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:43.392933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:43.392933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:43.392933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:43.392933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:43.392933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:43.392933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:43.392933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:43.392933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:43.392933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:43.392933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:43.394018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:43.394018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:43.394018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:43.394018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:43.394018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:43.394018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:43.394018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:43.394018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:43.394018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:43.394018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:43.394018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:43.394018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:43.394018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:43.394018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:43.394018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:43.394018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:43.394018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:43.394018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:43.394929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:43.394929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:43.394929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:43.394929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:43.394929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:43.394929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:43.394929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:43.394929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:43.394929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 14:21:43.394929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:43.394929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 300/587] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:43.396054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f3074-4dea-4e55-9fc4-271224508aa4 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:43.458176 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a6cd-d7a1-4b4e-9ce0-5480fdc11aa5 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:43.498548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e34a37-8b6b-4d09-9616-b1cc4b6f5fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:43.499222 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e34a37-8b6b-4d09-9616-b1cc4b6f5fbe None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:43.499542 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e34a37-8b6b-4d09-9616-b1cc4b6f5fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:43.499828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e34a37-8b6b-4d09-9616-b1cc4b6f5fbe None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:43.500630 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e34a37-8b6b-4d09-9616-b1cc4b6f5fbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:43.500950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e34a37-8b6b-4d09-9616-b1cc4b6f5fbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:43.502428 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e34a37-8b6b-4d09-9616-b1cc4b6f5fbe None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:43.505291 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:43.523309 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 288/588] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:43.523628 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f3074-4dea-4e55-9fc4-271224508aa4 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:43.523734 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e34a37-8b6b-4d09-9616-b1cc4b6f5fbe None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:43.565232 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6196d-6ab9-4446-8c3a-43aecc42c6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:43.566033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6196d-6ab9-4446-8c3a-43aecc42c6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:43.566316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6196d-6ab9-4446-8c3a-43aecc42c6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:43.566591 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6196d-6ab9-4446-8c3a-43aecc42c6a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:43.574330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6196d-6ab9-4446-8c3a-43aecc42c6a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:43.575824 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6196d-6ab9-4446-8c3a-43aecc42c6a3 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:43.591339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-7fe6196d-6ab9-4446-8c3a-43aecc42c6a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:43.591339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:43.591339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:43.591339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:43.591339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:43.591339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:43.591339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:43.591339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:43.591339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:43.591339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:43.591339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:43.591339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:43.591339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:43.591339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:43.591339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:43.592328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:43.592328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:43.592328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:43.592328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:43.592328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:43.592328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:43.592328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:43.592328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:43.592328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:43.592328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:43.592328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:43.592328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:43.592328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:43.592328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:43.592328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:43.592328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:43.592328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:43.593213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:43.593213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:43.593213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:43.593213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:43.593213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:43.593213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:43.593213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:43.593213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:43.593213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 301/589] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:43.593976 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6196d-6ab9-4446-8c3a-43aecc42c6a3 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:43.651385 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e34a37-8b6b-4d09-9616-b1cc4b6f5fbe None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:43.665476 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:43.691413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de53ff2-5b0d-44ac-a101-8e865e279682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:43.692581 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de53ff2-5b0d-44ac-a101-8e865e279682 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:43.693088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de53ff2-5b0d-44ac-a101-8e865e279682 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:43.693568 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de53ff2-5b0d-44ac-a101-8e865e279682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:43.709944 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de53ff2-5b0d-44ac-a101-8e865e279682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:43.712382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de53ff2-5b0d-44ac-a101-8e865e279682 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:43.718871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6196d-6ab9-4446-8c3a-43aecc42c6a3 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:43.733932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-1de53ff2-5b0d-44ac-a101-8e865e279682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:43.733932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:43.733932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:43.733932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:43.733932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:43.733932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:43.733932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:43.733932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:43.733932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:43.733932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:43.733932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:43.733932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:43.733932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:43.733932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:43.733932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:43.734916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:43.734916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:43.734916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:43.734916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:43.734916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:43.734916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:43.734916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:43.734916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:43.734916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:43.734916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:43.734916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:43.734916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:43.734916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:43.734916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:43.734916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:43.734916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:43.734916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:43.735827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:43.735827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:43.735827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:43.735827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:43.739611 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 289/590] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:43.740739 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de53ff2-5b0d-44ac-a101-8e865e279682 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:43.762700 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86089df-4152-409a-beda-7a33269dd452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:43.763413 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86089df-4152-409a-beda-7a33269dd452 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:43.763690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86089df-4152-409a-beda-7a33269dd452 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:43.763962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86089df-4152-409a-beda-7a33269dd452 None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:43.764807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86089df-4152-409a-beda-7a33269dd452 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:43.765119 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86089df-4152-409a-beda-7a33269dd452 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:43.766592 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86089df-4152-409a-beda-7a33269dd452 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:43.791312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 302/591] 10.222.0.40 () {56 vars in 1137 bytes} [Tue Jul 12 14:21:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:43.791312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86089df-4152-409a-beda-7a33269dd452 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:43.797469 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:43.856659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de53ff2-5b0d-44ac-a101-8e865e279682 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:43.909340 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64f97b-efb7-437a-b0cc-51b7c2f6cac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:43.910413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64f97b-efb7-437a-b0cc-51b7c2f6cac7 None admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:43.910695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64f97b-efb7-437a-b0cc-51b7c2f6cac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:43.910980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64f97b-efb7-437a-b0cc-51b7c2f6cac7 None admin] PATH_INFO: `/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/122fc227de9d4f87a66e4a0d86ff0b16/roles/c6f0b65d6ea5449ca79744ac52243ba2` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:43.915009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86089df-4152-409a-beda-7a33269dd452 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:43.929766 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:43.932144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64f97b-efb7-437a-b0cc-51b7c2f6cac7 None admin] RBAC: Authorizing `identity:create_grant(project_id=00424b6950d14cd4854e4add3e3d7705, user_id=122fc227de9d4f87a66e4a0d86ff0b16, role_id=c6f0b65d6ea5449ca79744ac52243ba2)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:43.934030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64f97b-efb7-437a-b0cc-51b7c2f6cac7 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:43.951620 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20004613-1be6-435b-a0d6-c3b3865b74ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:43.952393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20004613-1be6-435b-a0d6-c3b3865b74ad None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:43.952738 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20004613-1be6-435b-a0d6-c3b3865b74ad None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:43.953077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20004613-1be6-435b-a0d6-c3b3865b74ad None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:43.953881 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20004613-1be6-435b-a0d6-c3b3865b74ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:43.954408 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20004613-1be6-435b-a0d6-c3b3865b74ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:43.956180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20004613-1be6-435b-a0d6-c3b3865b74ad None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:43.968821 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 303/592] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:43.969746 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20004613-1be6-435b-a0d6-c3b3865b74ad None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:43.991687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 290/593] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:21:43 2022] PUT /identity/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/122fc227de9d4f87a66e4a0d86ff0b16/roles/c6f0b65d6ea5449ca79744ac52243ba2 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:21:43.993449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64f97b-efb7-437a-b0cc-51b7c2f6cac7 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:44.094853 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20004613-1be6-435b-a0d6-c3b3865b74ad None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:44.149345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a39d9-5bed-4ff7-87dd-721ca1414023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:44.151203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a39d9-5bed-4ff7-87dd-721ca1414023 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:44.151737 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a39d9-5bed-4ff7-87dd-721ca1414023 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:44.152199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a39d9-5bed-4ff7-87dd-721ca1414023 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:44.152899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:44.155609 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a39d9-5bed-4ff7-87dd-721ca1414023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:44.156206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a39d9-5bed-4ff7-87dd-721ca1414023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:44.157846 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64f97b-efb7-437a-b0cc-51b7c2f6cac7 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:44.158055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a39d9-5bed-4ff7-87dd-721ca1414023 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:44.177264 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 304/594] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:44.178529 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a39d9-5bed-4ff7-87dd-721ca1414023 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:44.203191 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f331a7-cac0-491b-91a9-4fc89b5768db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:44.204197 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f331a7-cac0-491b-91a9-4fc89b5768db None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:44.204669 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f331a7-cac0-491b-91a9-4fc89b5768db None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:44.205248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f331a7-cac0-491b-91a9-4fc89b5768db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:44.220220 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f331a7-cac0-491b-91a9-4fc89b5768db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:44.220895 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:44.223103 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f331a7-cac0-491b-91a9-4fc89b5768db None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:44.244562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-14f331a7-cac0-491b-91a9-4fc89b5768db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:44.244562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:44.244562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:44.244562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:44.244562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:44.244562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:44.244562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:44.244562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:44.244562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:44.244562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:44.244562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:44.244562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:44.244562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:44.244562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:44.244562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:44.245485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:44.245485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:44.245485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:44.245485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:44.245485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:44.245485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:44.245485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:44.245485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:44.245485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:44.245485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:44.245485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:44.245485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:44.245485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:44.245485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:44.245485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:44.245485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:44.245485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:44.246747 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:44.246747 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:44.246747 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:44.246747 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:44.246747 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 291/595] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:44.248104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f331a7-cac0-491b-91a9-4fc89b5768db None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:44.322745 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a39d9-5bed-4ff7-87dd-721ca1414023 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:44.380599 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81150351-4e98-48f9-a9d9-dee079876631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:44.380948 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f331a7-cac0-491b-91a9-4fc89b5768db None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:44.382077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81150351-4e98-48f9-a9d9-dee079876631 None admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:44.383845 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81150351-4e98-48f9-a9d9-dee079876631 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:44.384342 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81150351-4e98-48f9-a9d9-dee079876631 None admin] PATH_INFO: `/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/37932500740c4ccb96358bd751d01598/roles/c6f0b65d6ea5449ca79744ac52243ba2` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:44.405783 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81150351-4e98-48f9-a9d9-dee079876631 None admin] RBAC: Authorizing `identity:create_grant(project_id=00424b6950d14cd4854e4add3e3d7705, user_id=37932500740c4ccb96358bd751d01598, role_id=c6f0b65d6ea5449ca79744ac52243ba2)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:44.408018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81150351-4e98-48f9-a9d9-dee079876631 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:44.427142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7417b4-3e22-4d29-89ab-7f55e7e3dfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:44.428310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7417b4-3e22-4d29-89ab-7f55e7e3dfdc None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:44.428460 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7417b4-3e22-4d29-89ab-7f55e7e3dfdc None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:44.428870 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7417b4-3e22-4d29-89ab-7f55e7e3dfdc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:44.437465 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7417b4-3e22-4d29-89ab-7f55e7e3dfdc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:44.439060 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7417b4-3e22-4d29-89ab-7f55e7e3dfdc None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:44.455973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-8e7417b4-3e22-4d29-89ab-7f55e7e3dfdc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 14:21:44.455973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:44.455973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:44.455973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:44.455973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:44.455973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:44.455973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:44.455973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:44.455973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:44.455973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:44.455973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:44.455973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:44.455973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:44.455973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:44.455973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:44.455973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:44.456953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:44.456953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:44.456953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:44.456953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:44.456953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:44.456953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:44.456953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:44.456953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:44.456953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:44.456953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:44.456953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:44.456953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:44.456953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:44.456953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:44.456953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:44.456953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:44.456953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:44.456953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:44.457949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:44.457949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:44.457949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:44.457949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:44.457949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:44.457949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:44.457949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:44.457949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:44.457949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 14:21:44.457949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:44.457949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 292/596] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:44.458669 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7417b4-3e22-4d29-89ab-7f55e7e3dfdc None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:44.473981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:44.537598 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 305/597] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:21:44 2022] PUT /identity/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/37932500740c4ccb96358bd751d01598/roles/c6f0b65d6ea5449ca79744ac52243ba2 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:21:44.539016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81150351-4e98-48f9-a9d9-dee079876631 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:44.636184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7417b4-3e22-4d29-89ab-7f55e7e3dfdc None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:44.699186 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:44.715733 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac21d1-1f4a-49d3-8961-1eb5fcccce2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:44.729632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac21d1-1f4a-49d3-8961-1eb5fcccce2d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:44.729632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac21d1-1f4a-49d3-8961-1eb5fcccce2d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:44.729632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac21d1-1f4a-49d3-8961-1eb5fcccce2d None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:44.729632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac21d1-1f4a-49d3-8961-1eb5fcccce2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:44.729632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac21d1-1f4a-49d3-8961-1eb5fcccce2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:44.729632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac21d1-1f4a-49d3-8961-1eb5fcccce2d None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:44.730225 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81150351-4e98-48f9-a9d9-dee079876631 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:44.744534 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 293/598] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:44.751736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac21d1-1f4a-49d3-8961-1eb5fcccce2d None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:44.764366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c71b6-0d59-4680-96e7-bea11b44862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:44.765431 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c71b6-0d59-4680-96e7-bea11b44862a None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:44.765866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c71b6-0d59-4680-96e7-bea11b44862a None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:44.766310 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c71b6-0d59-4680-96e7-bea11b44862a None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:44.767422 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c71b6-0d59-4680-96e7-bea11b44862a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:44.767879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c71b6-0d59-4680-96e7-bea11b44862a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:44.769600 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c71b6-0d59-4680-96e7-bea11b44862a None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:44.792507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 306/599] 10.222.0.40 () {56 vars in 1139 bytes} [Tue Jul 12 14:21:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:44.798316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c71b6-0d59-4680-96e7-bea11b44862a None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:44.857046 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:44.891958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac21d1-1f4a-49d3-8961-1eb5fcccce2d None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:44.911435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c71b6-0d59-4680-96e7-bea11b44862a None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:44.932837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b188438-1e1d-4a32-94e4-e2051978e073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:44.933765 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b188438-1e1d-4a32-94e4-e2051978e073 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:44.934069 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b188438-1e1d-4a32-94e4-e2051978e073 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:44.934713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b188438-1e1d-4a32-94e4-e2051978e073 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:44.942102 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b188438-1e1d-4a32-94e4-e2051978e073 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:44.943869 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b188438-1e1d-4a32-94e4-e2051978e073 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:44.951551 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813f634-f54f-4808-84e8-f9d4a7b29745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:44.952643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813f634-f54f-4808-84e8-f9d4a7b29745 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:44.953089 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813f634-f54f-4808-84e8-f9d4a7b29745 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:44.953517 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813f634-f54f-4808-84e8-f9d4a7b29745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:44.960360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-3b188438-1e1d-4a32-94e4-e2051978e073 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:44.960360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:44.960360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:44.960360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:44.960360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:44.960360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:44.960360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:44.960360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:44.960360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:44.960360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:44.960360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:44.960360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:44.960360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:44.960360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:44.960360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:44.962208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:44.962208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:44.962208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:44.962208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:44.962208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:44.962208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:44.962208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:44.962208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:44.962208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:44.962208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:44.962208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:44.962208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:44.962208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:44.962208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:44.962208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:44.962208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:44.962208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:44.963289 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:44.963289 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:44.963289 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:44.963289 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:44.963289 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:44.963289 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:44.963289 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:44.963289 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:44.963289 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 294/600] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:44.967713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:44.968209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b188438-1e1d-4a32-94e4-e2051978e073 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:44.970942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813f634-f54f-4808-84e8-f9d4a7b29745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:44.972645 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813f634-f54f-4808-84e8-f9d4a7b29745 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:44.991854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-c813f634-f54f-4808-84e8-f9d4a7b29745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:44.991854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:44.991854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:44.991854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:44.991854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:44.991854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:44.991854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:44.991854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:44.991854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:44.991854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:44.991854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:44.991854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:44.991854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:44.991854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:44.991854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:44.992956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:44.992956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:44.992956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:44.992956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:44.992956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:44.992956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:44.992956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:44.992956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:44.992956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:44.992956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:44.992956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:44.992956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:44.992956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:44.992956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:44.992956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:44.992956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:44.992956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:44.993959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:44.993959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:44.993959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:44.993959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:44.996080 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 307/601] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:45.002599 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813f634-f54f-4808-84e8-f9d4a7b29745 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:45.086244 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b188438-1e1d-4a32-94e4-e2051978e073 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:45.115828 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813f634-f54f-4808-84e8-f9d4a7b29745 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:45.120449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:45.127607 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c263d5-2efd-4f0a-95b1-8ac1ff541a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:45.128353 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c263d5-2efd-4f0a-95b1-8ac1ff541a59 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:45.135893 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c263d5-2efd-4f0a-95b1-8ac1ff541a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:45.135893 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c263d5-2efd-4f0a-95b1-8ac1ff541a59 None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:45.135893 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c263d5-2efd-4f0a-95b1-8ac1ff541a59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:45.135893 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c263d5-2efd-4f0a-95b1-8ac1ff541a59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:45.135893 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c263d5-2efd-4f0a-95b1-8ac1ff541a59 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:45.145985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 295/602] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:45.152752 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eee45-36b5-44bc-b831-2f763aba017e None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:45.153140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eee45-36b5-44bc-b831-2f763aba017e None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:45.153683 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eee45-36b5-44bc-b831-2f763aba017e None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:45.155134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 296/603] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:45.156046 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42eee45-36b5-44bc-b831-2f763aba017e None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:45.161018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55675c11-59c7-46f2-95e5-637dce974d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:45.162059 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55675c11-59c7-46f2-95e5-637dce974d0c None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:45.162552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55675c11-59c7-46f2-95e5-637dce974d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:45.163024 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55675c11-59c7-46f2-95e5-637dce974d0c None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:45.164823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55675c11-59c7-46f2-95e5-637dce974d0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:45.165379 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55675c11-59c7-46f2-95e5-637dce974d0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:45.167020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55675c11-59c7-46f2-95e5-637dce974d0c None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:45.180858 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 308/604] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:45.186998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81352b53-805b-457f-95d0-72d414be3bf1 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:45.187874 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81352b53-805b-457f-95d0-72d414be3bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:45.188383 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81352b53-805b-457f-95d0-72d414be3bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:45.212277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-81352b53-805b-457f-95d0-72d414be3bf1 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:45.214035 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-81352b53-805b-457f-95d0-72d414be3bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:45.287581 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42eee45-36b5-44bc-b831-2f763aba017e None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:45.292842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:45.317534 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 309/605] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:45.318215 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81352b53-805b-457f-95d0-72d414be3bf1 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:45.344022 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071f564-1cc8-4feb-9f43-a7e0d2d0bf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:45.345463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071f564-1cc8-4feb-9f43-a7e0d2d0bf20 None admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:45.346000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071f564-1cc8-4feb-9f43-a7e0d2d0bf20 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:45.346478 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071f564-1cc8-4feb-9f43-a7e0d2d0bf20 None admin] PATH_INFO: `/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/aeb6850303f54a16bb23f05165844dda/roles/c6f0b65d6ea5449ca79744ac52243ba2` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:45.372504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071f564-1cc8-4feb-9f43-a7e0d2d0bf20 None admin] RBAC: Authorizing `identity:create_grant(project_id=00424b6950d14cd4854e4add3e3d7705, user_id=aeb6850303f54a16bb23f05165844dda, role_id=c6f0b65d6ea5449ca79744ac52243ba2)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:45.374878 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071f564-1cc8-4feb-9f43-a7e0d2d0bf20 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:45.447191 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81352b53-805b-457f-95d0-72d414be3bf1 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:45.491394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151f86b-90c1-467e-9762-4b116f8102b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:45.491394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151f86b-90c1-467e-9762-4b116f8102b2 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:45.491394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151f86b-90c1-467e-9762-4b116f8102b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:45.491394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151f86b-90c1-467e-9762-4b116f8102b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:45.492084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 297/606] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:21:45 2022] PUT /identity/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/aeb6850303f54a16bb23f05165844dda/roles/c6f0b65d6ea5449ca79744ac52243ba2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:21:45.494237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071f564-1cc8-4feb-9f43-a7e0d2d0bf20 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:45.498686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151f86b-90c1-467e-9762-4b116f8102b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:45.500254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151f86b-90c1-467e-9762-4b116f8102b2 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:45.517033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-0151f86b-90c1-467e-9762-4b116f8102b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:45.517033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:45.517033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:45.517033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:45.517033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:45.517033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:45.517033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:45.517033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:45.517033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:45.517033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:45.517033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:45.517033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:45.517033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:45.517033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:45.517033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:45.518038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:45.518038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:45.518038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:45.518038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:45.518038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:45.518038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:45.518038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:45.518038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:45.518038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:45.518038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:45.518038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:45.518038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:45.518038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:45.518038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:45.518038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:45.518038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:45.518038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:45.518927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:45.518927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:45.518927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:45.518927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:45.518927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:45.518927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:45.518927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:45.518927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:45.518927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 310/607] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:45.527883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151f86b-90c1-467e-9762-4b116f8102b2 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:45.587726 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:45.639534 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071f564-1cc8-4feb-9f43-a7e0d2d0bf20 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:45.657309 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:45.687068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce5eb1-5ae3-4ae3-85cc-95c0f1a40b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:45.688367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce5eb1-5ae3-4ae3-85cc-95c0f1a40b66 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:45.689016 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce5eb1-5ae3-4ae3-85cc-95c0f1a40b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:45.689529 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce5eb1-5ae3-4ae3-85cc-95c0f1a40b66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:45.707397 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce5eb1-5ae3-4ae3-85cc-95c0f1a40b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:45.717194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-56ce5eb1-5ae3-4ae3-85cc-95c0f1a40b66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:45.717194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:45.717194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:45.717194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:45.717194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:45.717194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:45.717194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:45.717194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:45.717194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:45.717194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:45.717194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:45.717194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:45.717194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:45.717194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:45.717194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:45.717194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:45.718245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:45.718245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:45.718245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:45.718245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:45.718245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:45.718245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:45.718245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:45.718245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:45.718245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:45.718245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:45.718245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:45.718245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:45.718245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:45.718245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:45.718245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:45.718245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:45.719131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:45.719131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:45.719131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:45.719131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:45.719131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:45.719131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:45.719131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:45.719131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:45.719131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:45.719131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:45.719131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:45.719131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:45.722792 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 298/608] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:45.729911 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce5eb1-5ae3-4ae3-85cc-95c0f1a40b66 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:45.804123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151f86b-90c1-467e-9762-4b116f8102b2 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:45.842834 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:45.845847 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce5eb1-5ae3-4ae3-85cc-95c0f1a40b66 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:45.846750 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d8560-edb0-423e-8d28-92b6167e6541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:45.847513 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d8560-edb0-423e-8d28-92b6167e6541 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:45.847804 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d8560-edb0-423e-8d28-92b6167e6541 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:45.848089 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d8560-edb0-423e-8d28-92b6167e6541 None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:45.848935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d8560-edb0-423e-8d28-92b6167e6541 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:45.849256 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d8560-edb0-423e-8d28-92b6167e6541 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:45.850853 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d8560-edb0-423e-8d28-92b6167e6541 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:45.865302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 311/609] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:45.872325 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d8560-edb0-423e-8d28-92b6167e6541 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:45.887528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4f8ac-73cc-4c32-8d4b-cd3506f86ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:45.888557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4f8ac-73cc-4c32-8d4b-cd3506f86ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:45.889098 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4f8ac-73cc-4c32-8d4b-cd3506f86ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:45.889629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4f8ac-73cc-4c32-8d4b-cd3506f86ce2 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:45.890690 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4f8ac-73cc-4c32-8d4b-cd3506f86ce2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:45.891209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4f8ac-73cc-4c32-8d4b-cd3506f86ce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:45.892945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4f8ac-73cc-4c32-8d4b-cd3506f86ce2 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:45.908178 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 299/610] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:21:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:45.914528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4f8ac-73cc-4c32-8d4b-cd3506f86ce2 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:46.025124 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4f8ac-73cc-4c32-8d4b-cd3506f86ce2 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:46.041440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d8560-edb0-423e-8d28-92b6167e6541 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:46.042877 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:46.065459 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c692f31-aefb-42f1-8d3e-468b9786348e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:46.066696 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c692f31-aefb-42f1-8d3e-468b9786348e None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:46.067308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c692f31-aefb-42f1-8d3e-468b9786348e None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:46.067835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c692f31-aefb-42f1-8d3e-468b9786348e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:46.081824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c692f31-aefb-42f1-8d3e-468b9786348e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:46.083850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c692f31-aefb-42f1-8d3e-468b9786348e None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:46.094434 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d3277-cc5a-4637-a432-8bae4ef1b64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:46.095753 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d3277-cc5a-4637-a432-8bae4ef1b64f None admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:46.095753 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d3277-cc5a-4637-a432-8bae4ef1b64f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:46.096037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d3277-cc5a-4637-a432-8bae4ef1b64f None admin] PATH_INFO: `/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/2af2d348fc984ed897fd58196b433b58/roles/c6f0b65d6ea5449ca79744ac52243ba2` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:46.106554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-3c692f31-aefb-42f1-8d3e-468b9786348e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:46.106554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:46.106554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:46.106554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:46.106554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:46.106554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:46.106554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:46.106554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:46.106554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:46.106554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:46.106554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:46.106554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:46.106554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:46.106554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:46.106554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:46.107488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:46.107488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:46.107488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:46.107488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:46.107488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:46.107488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:46.107488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:46.107488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:46.107488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:46.107488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:46.107488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:46.107488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:46.107488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:46.107488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:46.107488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:46.107488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:46.107488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:46.108355 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:46.108355 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:46.108355 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:46.108355 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:46.110902 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 300/611] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:46.115359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d3277-cc5a-4637-a432-8bae4ef1b64f None admin] RBAC: Authorizing `identity:create_grant(project_id=00424b6950d14cd4854e4add3e3d7705, user_id=2af2d348fc984ed897fd58196b433b58, role_id=c6f0b65d6ea5449ca79744ac52243ba2)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:46.115359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d3277-cc5a-4637-a432-8bae4ef1b64f None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:46.117488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c692f31-aefb-42f1-8d3e-468b9786348e None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:46.136350 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:46.193459 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 312/612] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:21:45 2022] PUT /identity/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/2af2d348fc984ed897fd58196b433b58/roles/c6f0b65d6ea5449ca79744ac52243ba2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:21:46.237662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c692f31-aefb-42f1-8d3e-468b9786348e None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:46.288962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553f6f1-5a85-40ca-a2a0-824b0abe2e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:46.289720 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553f6f1-5a85-40ca-a2a0-824b0abe2e4c None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:46.290005 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553f6f1-5a85-40ca-a2a0-824b0abe2e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:46.290283 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553f6f1-5a85-40ca-a2a0-824b0abe2e4c None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:46.291030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553f6f1-5a85-40ca-a2a0-824b0abe2e4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:46.291356 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553f6f1-5a85-40ca-a2a0-824b0abe2e4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:46.292765 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553f6f1-5a85-40ca-a2a0-824b0abe2e4c None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:46.311197 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 301/613] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:46.316927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d3277-cc5a-4637-a432-8bae4ef1b64f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:46.327820 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd3d13-1e9d-433d-9ecd-204896a6300c None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:46.328139 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd3d13-1e9d-433d-9ecd-204896a6300c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:46.328381 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd3d13-1e9d-433d-9ecd-204896a6300c None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:46.330191 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 302/614] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:46.343877 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd236289-7bd1-4d55-8ef5-fa1c9fdadc61 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:46.344195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd236289-7bd1-4d55-8ef5-fa1c9fdadc61 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:46.344442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd236289-7bd1-4d55-8ef5-fa1c9fdadc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:46.373509 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-fd236289-7bd1-4d55-8ef5-fa1c9fdadc61 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:46.374784 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fd236289-7bd1-4d55-8ef5-fa1c9fdadc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:46.490467 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d3277-cc5a-4637-a432-8bae4ef1b64f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:46.503422 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 303/615] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:21:46.520981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd236289-7bd1-4d55-8ef5-fa1c9fdadc61 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:46.524692 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:46.530438 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f730b-befc-44aa-8580-161c24bc069b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:46.531311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f730b-befc-44aa-8580-161c24bc069b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:46.531548 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f730b-befc-44aa-8580-161c24bc069b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:46.531823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f730b-befc-44aa-8580-161c24bc069b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:46.540788 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f730b-befc-44aa-8580-161c24bc069b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:46.542281 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f730b-befc-44aa-8580-161c24bc069b None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:46.564977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-610f730b-befc-44aa-8580-161c24bc069b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:21:46.564977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:46.564977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:46.564977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:46.564977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:46.564977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:46.564977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:46.564977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:46.564977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:46.564977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:46.564977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:46.564977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:46.564977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:46.564977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:46.564977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:46.564977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:46.565965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:46.565965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:46.565965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:46.565965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:46.565965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:46.565965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:46.565965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:46.565965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:46.565965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:46.565965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:46.565965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:46.565965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:46.565965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:46.565965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:46.565965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:46.565965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:46.565965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:46.565965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:46.567647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:46.567647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:46.567647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:46.567647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:46.567647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:46.567647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:46.567647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:46.567647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:46.567647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:21:46.567647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:46.567647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 313/616] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:21:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:46.572691 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f730b-befc-44aa-8580-161c24bc069b None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:46.607597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:46.635079 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd236289-7bd1-4d55-8ef5-fa1c9fdadc61 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:46.680375 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae8527-333c-43d5-94aa-9ba6db002ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:46.681571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae8527-333c-43d5-94aa-9ba6db002ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:46.682082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae8527-333c-43d5-94aa-9ba6db002ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:46.682558 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae8527-333c-43d5-94aa-9ba6db002ae9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:46.701315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae8527-333c-43d5-94aa-9ba6db002ae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:46.715302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f730b-befc-44aa-8580-161c24bc069b None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:46.718965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-3bae8527-333c-43d5-94aa-9ba6db002ae9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:46.718965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:46.718965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:46.718965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:46.718965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:46.718965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:46.718965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:46.718965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:46.718965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:46.718965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:46.718965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:46.718965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:46.718965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:46.718965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:46.718965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:46.718965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:46.719941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:46.719941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:46.719941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:46.719941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:46.719941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:46.719941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:46.719941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:46.719941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:46.719941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:46.719941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:46.719941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:46.719941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:46.719941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:46.719941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:46.719941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:46.719941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:46.720779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:46.720779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:46.720779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:46.720779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:46.720779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:46.720779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:46.720779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:46.720779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:46.720779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:46.720779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:46.720779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:46.720779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:46.724513 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 304/617] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:46.730291 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae8527-333c-43d5-94aa-9ba6db002ae9 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:46.753195 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b2352-05e4-497c-9fdc-95e4337bcc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:46.753863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b2352-05e4-497c-9fdc-95e4337bcc6b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:46.754145 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b2352-05e4-497c-9fdc-95e4337bcc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:46.754409 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b2352-05e4-497c-9fdc-95e4337bcc6b None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:46.755256 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b2352-05e4-497c-9fdc-95e4337bcc6b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:46.755583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b2352-05e4-497c-9fdc-95e4337bcc6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:46.757015 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b2352-05e4-497c-9fdc-95e4337bcc6b None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:46.775964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 314/618] 10.222.0.40 () {56 vars in 1135 bytes} [Tue Jul 12 14:21:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:46.784273 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b2352-05e4-497c-9fdc-95e4337bcc6b None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:46.803375 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:46.845744 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae8527-333c-43d5-94aa-9ba6db002ae9 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:46.890528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d8538-c0da-4d81-93e1-20e5b61262c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:46.891627 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d8538-c0da-4d81-93e1-20e5b61262c1 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:46.892117 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d8538-c0da-4d81-93e1-20e5b61262c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:46.892595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d8538-c0da-4d81-93e1-20e5b61262c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:46.893547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d8538-c0da-4d81-93e1-20e5b61262c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:46.894055 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d8538-c0da-4d81-93e1-20e5b61262c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:46.895696 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d8538-c0da-4d81-93e1-20e5b61262c1 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:46.909286 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 305/619] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:21:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:46.913053 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d8538-c0da-4d81-93e1-20e5b61262c1 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:46.927601 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:46.986507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b2352-05e4-497c-9fdc-95e4337bcc6b None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:47.042373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33a83a-8d63-4627-91c6-dcf7091c4507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:47.043230 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33a83a-8d63-4627-91c6-dcf7091c4507 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:47.043546 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33a83a-8d63-4627-91c6-dcf7091c4507 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:47.043821 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33a83a-8d63-4627-91c6-dcf7091c4507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:47.060804 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33a83a-8d63-4627-91c6-dcf7091c4507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:47.062265 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33a83a-8d63-4627-91c6-dcf7091c4507 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:47.102380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-8e33a83a-8d63-4627-91c6-dcf7091c4507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:47.102380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:47.102380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:47.102380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:47.102380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:47.102380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:47.102380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:47.102380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:47.102380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:47.102380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:47.102380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:47.102380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:47.102380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:47.102380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:47.102380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:47.103308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:47.103308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:47.103308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:47.103308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:47.103308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:47.103308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:47.103308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:47.103308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:47.103308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:47.103308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:47.103308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:47.103308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:47.103308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:47.103308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:47.103308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:47.103308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:47.103308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:47.104228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:47.104228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:47.104228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:47.104228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:47.111115 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 315/620] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:47.113160 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33a83a-8d63-4627-91c6-dcf7091c4507 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:47.130748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d8538-c0da-4d81-93e1-20e5b61262c1 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:47.183695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:47.191942 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db1731-a995-40ef-90a2-5a275f3c8a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:47.192756 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db1731-a995-40ef-90a2-5a275f3c8a16 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:47.193042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db1731-a995-40ef-90a2-5a275f3c8a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:47.193319 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db1731-a995-40ef-90a2-5a275f3c8a16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:47.206483 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db1731-a995-40ef-90a2-5a275f3c8a16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:47.212004 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db1731-a995-40ef-90a2-5a275f3c8a16 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:47.230456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-97db1731-a995-40ef-90a2-5a275f3c8a16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:47.230456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:47.230456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:47.230456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:47.230456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:47.230456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:47.230456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:47.230456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:47.230456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:47.230456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:47.230456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:47.230456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:47.230456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:47.230456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:47.230456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:47.231447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:47.231447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:47.231447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:47.231447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:47.231447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:47.231447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:47.231447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:47.231447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:47.231447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:47.231447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:47.231447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:47.231447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:47.231447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:47.231447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:47.231447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:47.231447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:47.231447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:47.232322 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:47.232322 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:47.232322 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:47.232322 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:47.232681 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 306/621] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:47.240946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db1731-a995-40ef-90a2-5a275f3c8a16 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:47.314951 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33a83a-8d63-4627-91c6-dcf7091c4507 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:47.344805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:47.360597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f4aa1-f28e-40cb-821f-0b57145406dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:47.360597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f4aa1-f28e-40cb-821f-0b57145406dc None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:47.360597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f4aa1-f28e-40cb-821f-0b57145406dc None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:47.360597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f4aa1-f28e-40cb-821f-0b57145406dc None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:47.361574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f4aa1-f28e-40cb-821f-0b57145406dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:47.361957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f4aa1-f28e-40cb-821f-0b57145406dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:47.363630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f4aa1-f28e-40cb-821f-0b57145406dc None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:47.381327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 316/622] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:47.384020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940c062-aa53-4479-81ac-4e1d7e524c8e None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:47.384442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940c062-aa53-4479-81ac-4e1d7e524c8e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:47.384830 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940c062-aa53-4479-81ac-4e1d7e524c8e None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:47.390794 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 317/623] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:47.390794 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940c062-aa53-4479-81ac-4e1d7e524c8e None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:47.426455 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db1731-a995-40ef-90a2-5a275f3c8a16 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:47.474581 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87752f42-c16c-4e22-b900-d82e315b25f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:47.475393 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87752f42-c16c-4e22-b900-d82e315b25f3 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:47.475755 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87752f42-c16c-4e22-b900-d82e315b25f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:47.477698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87752f42-c16c-4e22-b900-d82e315b25f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:47.478745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87752f42-c16c-4e22-b900-d82e315b25f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:47.479138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87752f42-c16c-4e22-b900-d82e315b25f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:47.481544 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87752f42-c16c-4e22-b900-d82e315b25f3 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:47.499741 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 307/624] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:47.502129 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d87af-a6e2-4c3e-a7b5-0b392fefd18a None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:47.502651 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d87af-a6e2-4c3e-a7b5-0b392fefd18a None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:47.503088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d87af-a6e2-4c3e-a7b5-0b392fefd18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:47.520504 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940c062-aa53-4479-81ac-4e1d7e524c8e None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:47.527006 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-837d87af-a6e2-4c3e-a7b5-0b392fefd18a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:47.528580 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-837d87af-a6e2-4c3e-a7b5-0b392fefd18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:47.572227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad38cb7-480b-415f-8405-e7e87e354450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:47.573702 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad38cb7-480b-415f-8405-e7e87e354450 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:47.574093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad38cb7-480b-415f-8405-e7e87e354450 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:47.574446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad38cb7-480b-415f-8405-e7e87e354450 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:47.579776 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:47.584274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad38cb7-480b-415f-8405-e7e87e354450 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:47.587546 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad38cb7-480b-415f-8405-e7e87e354450 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:47.610007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-5ad38cb7-480b-415f-8405-e7e87e354450 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:47.610007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:47.610007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:47.610007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:47.610007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:47.610007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:47.610007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:47.610007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:47.610007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:47.610007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:47.610007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:47.610007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:47.610007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:47.610007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:47.610007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:47.611001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:47.611001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:47.611001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:47.611001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:47.611001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:47.611001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:47.611001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:47.611001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:47.611001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:47.611001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:47.611001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:47.611001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:47.611001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:47.611001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:47.611001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:47.611001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:47.611001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:47.611973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:47.611973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:47.611973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:47.611973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:47.611973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:47.611973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:47.611973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:47.611973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:47.611973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 318/626] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:47.611973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad38cb7-480b-415f-8405-e7e87e354450 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:47.612512 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 308/626] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:47.615835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d87af-a6e2-4c3e-a7b5-0b392fefd18a None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:47.681237 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:47.733590 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d87af-a6e2-4c3e-a7b5-0b392fefd18a None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:47.755245 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad38cb7-480b-415f-8405-e7e87e354450 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:47.772178 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428a046-63f1-4704-86c1-fc8c5c60940a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:47.773390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428a046-63f1-4704-86c1-fc8c5c60940a None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:47.773871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428a046-63f1-4704-86c1-fc8c5c60940a None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:47.774402 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428a046-63f1-4704-86c1-fc8c5c60940a None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:47.775471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428a046-63f1-4704-86c1-fc8c5c60940a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:47.775975 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428a046-63f1-4704-86c1-fc8c5c60940a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:47.777804 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428a046-63f1-4704-86c1-fc8c5c60940a None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:47.797210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 309/627] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:47.797210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428a046-63f1-4704-86c1-fc8c5c60940a None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:47.803028 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb7a9f-46b9-4061-958c-f9b9fd3c0e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:47.804763 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb7a9f-46b9-4061-958c-f9b9fd3c0e9c None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:47.805254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb7a9f-46b9-4061-958c-f9b9fd3c0e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:47.805997 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb7a9f-46b9-4061-958c-f9b9fd3c0e9c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:47.816252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb7a9f-46b9-4061-958c-f9b9fd3c0e9c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:47.818120 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb7a9f-46b9-4061-958c-f9b9fd3c0e9c None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:47.834952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-e3bb7a9f-46b9-4061-958c-f9b9fd3c0e9c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:21:47.834952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:47.834952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:47.834952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:47.834952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:47.834952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:47.834952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:47.834952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:47.834952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:47.834952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:47.834952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:47.834952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:47.834952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:47.834952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:47.834952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:47.834952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:47.836968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:47.836968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:47.836968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:47.836968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:47.836968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:47.836968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:47.836968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:47.836968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:47.836968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:47.836968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:47.836968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:47.836968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:47.836968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:47.836968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:47.836968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:47.836968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:47.836968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:47.836968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:47.837987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:47.837987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:47.837987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:47.837987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:47.837987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:47.837987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:47.837987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:47.837987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:47.837987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:21:47.837987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:47.839738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:47.841086 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 319/628] 10.222.0.40 () {56 vars in 1093 bytes} [Tue Jul 12 14:21:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:47.842120 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb7a9f-46b9-4061-958c-f9b9fd3c0e9c None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:47.932345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428a046-63f1-4704-86c1-fc8c5c60940a None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:47.950911 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb7a9f-46b9-4061-958c-f9b9fd3c0e9c None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:47.952983 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:47.978464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cafb9-2ce1-43aa-978b-25a7ffa2c27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:47.979271 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cafb9-2ce1-43aa-978b-25a7ffa2c27b None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:47.979591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cafb9-2ce1-43aa-978b-25a7ffa2c27b None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:47.979867 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cafb9-2ce1-43aa-978b-25a7ffa2c27b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:47.988732 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faac621-5587-4d8e-b7e7-823b4c903d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:47.989868 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faac621-5587-4d8e-b7e7-823b4c903d09 None admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:47.990365 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faac621-5587-4d8e-b7e7-823b4c903d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:47.990832 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faac621-5587-4d8e-b7e7-823b4c903d09 None admin] PATH_INFO: `/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/ad12085f356a4f0682bb70ad231a10b6/roles/c6f0b65d6ea5449ca79744ac52243ba2` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:47.992943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cafb9-2ce1-43aa-978b-25a7ffa2c27b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:48.003561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-b71cafb9-2ce1-43aa-978b-25a7ffa2c27b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:48.003561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:48.003561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:48.003561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:48.003561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:48.003561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:48.003561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:48.003561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:48.003561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:48.003561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:48.003561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:48.003561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:48.003561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:48.003561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:48.003561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:48.003561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:48.004511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:48.004511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:48.004511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:48.004511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:48.004511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:48.004511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:48.004511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:48.004511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:48.004511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:48.004511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:48.004511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:48.004511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:48.004511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:48.004511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:48.004511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:48.004511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:48.005315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:48.005315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:48.005315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:48.005315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:48.005315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:48.005315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:48.005315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:48.005315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:48.005315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:48.005315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:48.005315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:48.005315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:48.007682 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 310/629] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:48.008707 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cafb9-2ce1-43aa-978b-25a7ffa2c27b None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:48.020046 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faac621-5587-4d8e-b7e7-823b4c903d09 None admin] RBAC: Authorizing `identity:create_grant(project_id=00424b6950d14cd4854e4add3e3d7705, user_id=ad12085f356a4f0682bb70ad231a10b6, role_id=c6f0b65d6ea5449ca79744ac52243ba2)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:48.022161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faac621-5587-4d8e-b7e7-823b4c903d09 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:48.105164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 320/630] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:21:47 2022] PUT /identity/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/ad12085f356a4f0682bb70ad231a10b6/roles/c6f0b65d6ea5449ca79744ac52243ba2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:21:48.105164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faac621-5587-4d8e-b7e7-823b4c903d09 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:48.118616 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:48.139583 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cafb9-2ce1-43aa-978b-25a7ffa2c27b None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:48.200482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a906b44-d0f2-43df-b410-e7af8ec5d339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:48.201553 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a906b44-d0f2-43df-b410-e7af8ec5d339 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:48.202048 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a906b44-d0f2-43df-b410-e7af8ec5d339 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:48.202546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a906b44-d0f2-43df-b410-e7af8ec5d339 None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:48.203686 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a906b44-d0f2-43df-b410-e7af8ec5d339 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:48.204293 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a906b44-d0f2-43df-b410-e7af8ec5d339 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:48.205994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a906b44-d0f2-43df-b410-e7af8ec5d339 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:48.226818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 311/631] 10.222.0.40 () {56 vars in 1133 bytes} [Tue Jul 12 14:21:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:48.228931 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6c213-4bb8-4c4b-9660-279f2b0c8fc6 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:48.229452 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6c213-4bb8-4c4b-9660-279f2b0c8fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:48.229930 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6c213-4bb8-4c4b-9660-279f2b0c8fc6 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:48.232205 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 312/632] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:48.233321 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6c213-4bb8-4c4b-9660-279f2b0c8fc6 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:48.241128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faac621-5587-4d8e-b7e7-823b4c903d09 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:48.283066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32dfbba-bcaf-494d-9731-214bfcb81d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:48.283838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dfbba-bcaf-494d-9731-214bfcb81d21 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:48.284168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dfbba-bcaf-494d-9731-214bfcb81d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:48.284447 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32dfbba-bcaf-494d-9731-214bfcb81d21 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:48.285219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32dfbba-bcaf-494d-9731-214bfcb81d21 None admin] RBAC: Adding query filter params (name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:48.285528 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32dfbba-bcaf-494d-9731-214bfcb81d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:48.287047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32dfbba-bcaf-494d-9731-214bfcb81d21 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:48.297641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 321/633] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:21:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:48.298582 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ba2c2-5432-4770-9e7e-34fd8d917e28 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:48.298869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ba2c2-5432-4770-9e7e-34fd8d917e28 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:48.299225 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ba2c2-5432-4770-9e7e-34fd8d917e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:48.322932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-453ba2c2-5432-4770-9e7e-34fd8d917e28 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:48.324250 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-453ba2c2-5432-4770-9e7e-34fd8d917e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:48.334529 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:48.373157 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6c213-4bb8-4c4b-9660-279f2b0c8fc6 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:48.409841 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33116f-e270-4aa4-b9e9-011c5ae073bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:48.410454 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 322/634] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:48.410568 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33116f-e270-4aa4-b9e9-011c5ae073bc None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:48.411323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ba2c2-5432-4770-9e7e-34fd8d917e28 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:48.415178 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33116f-e270-4aa4-b9e9-011c5ae073bc None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:48.415503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33116f-e270-4aa4-b9e9-011c5ae073bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:48.450132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:48.525236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33116f-e270-4aa4-b9e9-011c5ae073bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:48.526604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33116f-e270-4aa4-b9e9-011c5ae073bc None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:48.560216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ba2c2-5432-4770-9e7e-34fd8d917e28 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:48.601601 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e8a90-0a85-4032-98ff-9a8b910cc9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:48.602622 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e8a90-0a85-4032-98ff-9a8b910cc9ab None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:48.602908 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e8a90-0a85-4032-98ff-9a8b910cc9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:48.603186 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e8a90-0a85-4032-98ff-9a8b910cc9ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:48.615956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e8a90-0a85-4032-98ff-9a8b910cc9ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:48.617517 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e8a90-0a85-4032-98ff-9a8b910cc9ab None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:48.621081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:48.637796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-ce0e8a90-0a85-4032-98ff-9a8b910cc9ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:48.637796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:48.637796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:48.637796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:48.637796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:48.637796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:48.637796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:48.637796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:48.637796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:48.637796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:48.637796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:48.637796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:48.637796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:48.637796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:48.637796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:48.638912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:48.638912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:48.638912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:48.638912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:48.638912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:48.638912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:48.638912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:48.638912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:48.638912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:48.638912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:48.638912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:48.638912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:48.638912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:48.638912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:48.638912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:48.638912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:48.638912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:48.640020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:48.640020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:48.640020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:48.640020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:48.643649 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 323/635] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:48.644549 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e8a90-0a85-4032-98ff-9a8b910cc9ab None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:48.655234 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 313/636] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:48.656587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33116f-e270-4aa4-b9e9-011c5ae073bc None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:48.716916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:48.756646 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e8a90-0a85-4032-98ff-9a8b910cc9ab None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:48.776377 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33116f-e270-4aa4-b9e9-011c5ae073bc None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:48.800765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348203ce-6599-4d41-b7df-bcd654c33d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:48.801565 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348203ce-6599-4d41-b7df-bcd654c33d89 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:48.801844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348203ce-6599-4d41-b7df-bcd654c33d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:48.802116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348203ce-6599-4d41-b7df-bcd654c33d89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:48.815543 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348203ce-6599-4d41-b7df-bcd654c33d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:48.819261 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e3671-4579-453a-9755-6b1cca97177f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:48.822435 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e3671-4579-453a-9755-6b1cca97177f None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:48.822929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e3671-4579-453a-9755-6b1cca97177f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:48.823409 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e3671-4579-453a-9755-6b1cca97177f None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:48.824327 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e3671-4579-453a-9755-6b1cca97177f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:48.824814 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e3671-4579-453a-9755-6b1cca97177f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:48.825940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-348203ce-6599-4d41-b7df-bcd654c33d89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:48.825940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:48.825940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:48.825940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:48.825940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:48.825940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:48.825940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:48.825940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:48.825940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:48.825940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:48.825940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:48.825940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:48.825940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:48.825940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:48.825940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:48.825940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:48.826924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:48.826924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:48.826924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:48.826924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:48.826924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:48.826924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:48.826924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:48.826924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:48.826924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:48.826924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:48.826924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:48.826924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:48.826924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:48.826924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:48.826924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:48.826924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:48.827957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:48.827957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:48.827957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:48.827957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:48.827957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:48.827957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:48.827957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:48.827957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:48.827957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:48.827957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:48.827957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:48.827957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:48.827957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 324/637] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:48.828639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348203ce-6599-4d41-b7df-bcd654c33d89 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:48.829973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e3671-4579-453a-9755-6b1cca97177f None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:48.847888 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 314/638] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:48.849614 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4bcd7-0556-48bd-98b3-afb31f5d2365 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:48.849903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4bcd7-0556-48bd-98b3-afb31f5d2365 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:48.850180 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4bcd7-0556-48bd-98b3-afb31f5d2365 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:48.855470 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 315/639] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:48.855470 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4bcd7-0556-48bd-98b3-afb31f5d2365 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:48.899958 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:48.949260 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348203ce-6599-4d41-b7df-bcd654c33d89 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:48.975665 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4bcd7-0556-48bd-98b3-afb31f5d2365 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:48.982841 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:48.985143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdc204-b474-40e6-bb29-469b0a3829de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:48.985943 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdc204-b474-40e6-bb29-469b0a3829de None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:48.986228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdc204-b474-40e6-bb29-469b0a3829de None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:48.986505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdc204-b474-40e6-bb29-469b0a3829de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:48.998616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cdc204-b474-40e6-bb29-469b0a3829de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:49.000124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cdc204-b474-40e6-bb29-469b0a3829de None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:49.012311 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee5ea1-24e2-4e40-9cd1-59ea03049c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:49.012981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee5ea1-24e2-4e40-9cd1-59ea03049c77 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:49.013267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee5ea1-24e2-4e40-9cd1-59ea03049c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:49.013546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee5ea1-24e2-4e40-9cd1-59ea03049c77 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:49.014368 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee5ea1-24e2-4e40-9cd1-59ea03049c77 None admin] RBAC: Adding query filter params (name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:49.014603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee5ea1-24e2-4e40-9cd1-59ea03049c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:49.015998 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee5ea1-24e2-4e40-9cd1-59ea03049c77 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:49.018959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-80cdc204-b474-40e6-bb29-469b0a3829de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:49.018959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:49.018959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:49.018959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:49.018959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:49.018959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:49.018959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:49.018959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:49.018959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:49.018959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:49.018959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:49.018959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:49.018959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:49.018959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:49.018959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:49.019867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:49.019867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:49.019867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:49.019867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:49.019867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:49.019867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:49.019867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:49.019867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:49.019867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:49.019867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:49.019867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:49.019867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:49.019867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:49.019867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:49.019867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:49.019867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:49.019867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:49.020722 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:49.020722 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:49.020722 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:49.020722 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:49.029698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 316/640] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:21:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:49.029833 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 325/641] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:49.029910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee5ea1-24e2-4e40-9cd1-59ea03049c77 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:49.029981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c2b4f-6783-4202-81bb-67a196df20c5 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:49.029981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c2b4f-6783-4202-81bb-67a196df20c5 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:49.029981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c2b4f-6783-4202-81bb-67a196df20c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:49.046063 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-dc6c2b4f-6783-4202-81bb-67a196df20c5 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:49.047261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-dc6c2b4f-6783-4202-81bb-67a196df20c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:49.125947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 326/642] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:49.125947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c2b4f-6783-4202-81bb-67a196df20c5 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:49.151342 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee5ea1-24e2-4e40-9cd1-59ea03049c77 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:49.171348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:49.192714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fdd12-7d2a-4cb9-94f4-62197f6d13f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:49.193659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fdd12-7d2a-4cb9-94f4-62197f6d13f6 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:49.193948 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fdd12-7d2a-4cb9-94f4-62197f6d13f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:49.206276 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fdd12-7d2a-4cb9-94f4-62197f6d13f6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:49.206276 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8fdd12-7d2a-4cb9-94f4-62197f6d13f6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:49.206276 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8fdd12-7d2a-4cb9-94f4-62197f6d13f6 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:49.220206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-2b8fdd12-7d2a-4cb9-94f4-62197f6d13f6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 14:21:49.220206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:49.220206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:49.220206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:49.220206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:49.220206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:49.220206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:49.220206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:49.220206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:49.220206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:49.220206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:49.220206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:49.220206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:49.220206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:49.220206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:49.220206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:49.221386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:49.221386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:49.221386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:49.221386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:49.221386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:49.221386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:49.221386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:49.221386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:49.221386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:49.221386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:49.221386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:49.221386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:49.221386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:49.221386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:49.221386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:49.221386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:49.221386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:49.221386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:49.222304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:49.222304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:49.222304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:49.222304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:49.222304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:49.222304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:49.222304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:49.222304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:49.222304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 14:21:49.222304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:49.222304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 317/643] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:49.222304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fdd12-7d2a-4cb9-94f4-62197f6d13f6 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:49.253359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c2b4f-6783-4202-81bb-67a196df20c5 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:49.271756 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:49.305112 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3594b-bfc4-4aba-97f8-9d7634a409e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:49.305708 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3594b-bfc4-4aba-97f8-9d7634a409e1 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:49.306015 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3594b-bfc4-4aba-97f8-9d7634a409e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:49.306272 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3594b-bfc4-4aba-97f8-9d7634a409e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:49.307040 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3594b-bfc4-4aba-97f8-9d7634a409e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:49.307400 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3594b-bfc4-4aba-97f8-9d7634a409e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:49.308820 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3594b-bfc4-4aba-97f8-9d7634a409e1 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:49.324633 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 327/644] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:49.325419 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3594b-bfc4-4aba-97f8-9d7634a409e1 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:49.372363 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fdd12-7d2a-4cb9-94f4-62197f6d13f6 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:49.414295 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6009d-c018-4184-99b8-24b158596d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:49.415814 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6009d-c018-4184-99b8-24b158596d64 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:49.416156 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6009d-c018-4184-99b8-24b158596d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:49.416443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6009d-c018-4184-99b8-24b158596d64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:49.427415 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6009d-c018-4184-99b8-24b158596d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:49.428885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6009d-c018-4184-99b8-24b158596d64 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:49.431007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:49.434853 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3594b-bfc4-4aba-97f8-9d7634a409e1 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:49.447927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-9ca6009d-c018-4184-99b8-24b158596d64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:49.447927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:49.447927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:49.447927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:49.447927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:49.447927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:49.447927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:49.447927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:49.447927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:49.447927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:49.447927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:49.447927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:49.447927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:49.447927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:49.447927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:49.448825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:49.448825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:49.448825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:49.448825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:49.448825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:49.448825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:49.448825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:49.448825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:49.448825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:49.448825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:49.448825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:49.448825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:49.448825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:49.448825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:49.448825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:49.448825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:49.448825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:49.449876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:49.449876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:49.449876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:49.449876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:49.449876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 318/645] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:49.450156 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6009d-c018-4184-99b8-24b158596d64 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:49.475971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e72a67-cc4c-405c-aec2-d3274a471256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:49.476770 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e72a67-cc4c-405c-aec2-d3274a471256 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:49.477052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e72a67-cc4c-405c-aec2-d3274a471256 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:49.477329 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e72a67-cc4c-405c-aec2-d3274a471256 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:49.488050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e72a67-cc4c-405c-aec2-d3274a471256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:49.496252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-a6e72a67-cc4c-405c-aec2-d3274a471256 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:49.496252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:49.496252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:49.496252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:49.496252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:49.496252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:49.496252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:49.496252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:49.496252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:49.496252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:49.496252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:49.496252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:49.496252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:49.496252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:49.496252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:49.496252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:49.497219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:49.497219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:49.497219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:49.497219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:49.497219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:49.497219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:49.497219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:49.497219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:49.497219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:49.497219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:49.497219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:49.497219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:49.497219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:49.497219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:49.497219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:49.497219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:49.498037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:49.498037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:49.498037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:49.498037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:49.498037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:49.498037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:49.498037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:49.498037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:49.498037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:49.498037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:49.498037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:49.498037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:49.498037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 328/646] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:49.498706 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e72a67-cc4c-405c-aec2-d3274a471256 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:49.546332 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:49.566105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6009d-c018-4184-99b8-24b158596d64 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:49.605865 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e72a67-cc4c-405c-aec2-d3274a471256 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:49.606244 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb98fa-8672-4273-9dc8-c7d599454274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:49.606954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb98fa-8672-4273-9dc8-c7d599454274 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:49.607246 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb98fa-8672-4273-9dc8-c7d599454274 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:49.607679 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb98fa-8672-4273-9dc8-c7d599454274 None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:49.608680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb98fa-8672-4273-9dc8-c7d599454274 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:49.609005 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb98fa-8672-4273-9dc8-c7d599454274 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:49.610524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb98fa-8672-4273-9dc8-c7d599454274 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:49.634088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 319/647] 10.222.0.40 () {56 vars in 1137 bytes} [Tue Jul 12 14:21:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:49.639736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb98fa-8672-4273-9dc8-c7d599454274 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:49.647266 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dbdf6-7115-4fc8-ac95-6e2b282c9187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:49.648413 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dbdf6-7115-4fc8-ac95-6e2b282c9187 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:49.648813 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dbdf6-7115-4fc8-ac95-6e2b282c9187 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:49.648989 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dbdf6-7115-4fc8-ac95-6e2b282c9187 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:49.658321 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dbdf6-7115-4fc8-ac95-6e2b282c9187 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:49.659862 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dbdf6-7115-4fc8-ac95-6e2b282c9187 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:49.676088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-c81dbdf6-7115-4fc8-ac95-6e2b282c9187 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:49.676088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:49.676088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:49.676088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:49.676088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:49.676088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:49.676088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:49.676088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:49.676088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:49.676088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:49.676088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:49.676088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:49.676088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:49.676088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:49.676088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:49.677038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:49.677038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:49.677038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:49.677038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:49.677038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:49.677038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:49.677038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:49.677038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:49.677038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:49.677038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:49.677038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:49.677038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:49.677038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:49.677038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:49.677038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:49.677038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:49.677038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:49.677949 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:49.677949 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:49.677949 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:49.677949 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:49.677949 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:49.677949 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:49.677949 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:49.677949 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:49.677949 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 329/648] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:49.679621 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dbdf6-7115-4fc8-ac95-6e2b282c9187 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:49.700214 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:49.760306 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb98fa-8672-4273-9dc8-c7d599454274 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:49.797395 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dbdf6-7115-4fc8-ac95-6e2b282c9187 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:49.801942 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ba3a0-4153-438a-9bfe-191b67ae0829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:49.802622 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ba3a0-4153-438a-9bfe-191b67ae0829 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:49.802928 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ba3a0-4153-438a-9bfe-191b67ae0829 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:49.803208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ba3a0-4153-438a-9bfe-191b67ae0829 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:49.804500 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ba3a0-4153-438a-9bfe-191b67ae0829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:49.804814 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ba3a0-4153-438a-9bfe-191b67ae0829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:49.806199 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ba3a0-4153-438a-9bfe-191b67ae0829 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:49.813927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:49.824423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 320/649] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:49.824423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ba3a0-4153-438a-9bfe-191b67ae0829 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:49.836499 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22054c0f-f8ce-419a-ac79-70c92007ae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:49.837177 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22054c0f-f8ce-419a-ac79-70c92007ae6e None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:49.837518 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22054c0f-f8ce-419a-ac79-70c92007ae6e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:49.837800 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22054c0f-f8ce-419a-ac79-70c92007ae6e None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:49.838566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22054c0f-f8ce-419a-ac79-70c92007ae6e None admin] RBAC: Adding query filter params (name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:49.841492 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22054c0f-f8ce-419a-ac79-70c92007ae6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:49.841492 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22054c0f-f8ce-419a-ac79-70c92007ae6e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:49.848972 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 330/650] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:21:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:49.849890 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22054c0f-f8ce-419a-ac79-70c92007ae6e None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:49.936668 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:49.939233 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ba3a0-4153-438a-9bfe-191b67ae0829 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:49.958867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22054c0f-f8ce-419a-ac79-70c92007ae6e None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:49.982750 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce036788-c79a-4809-a915-b0ba2c7673f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:49.983441 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce036788-c79a-4809-a915-b0ba2c7673f2 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:49.983733 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce036788-c79a-4809-a915-b0ba2c7673f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:49.984018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce036788-c79a-4809-a915-b0ba2c7673f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:49.995298 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3ff5e-e6d2-4b3b-9769-2633c9ad8c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:49.996636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3ff5e-e6d2-4b3b-9769-2633c9ad8c75 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:49.996923 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3ff5e-e6d2-4b3b-9769-2633c9ad8c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:49.997251 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3ff5e-e6d2-4b3b-9769-2633c9ad8c75 None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:49.997991 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3ff5e-e6d2-4b3b-9769-2633c9ad8c75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:49.998303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3ff5e-e6d2-4b3b-9769-2633c9ad8c75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:49.999904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3ff5e-e6d2-4b3b-9769-2633c9ad8c75 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:50.013608 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 331/651] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:50.013608 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3ff5e-e6d2-4b3b-9769-2633c9ad8c75 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:50.058267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:50.061489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce036788-c79a-4809-a915-b0ba2c7673f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:50.062960 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce036788-c79a-4809-a915-b0ba2c7673f2 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:50.128301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3ff5e-e6d2-4b3b-9769-2633c9ad8c75 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:50.167644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb810681-a7b7-4ae4-aa12-563fe0df3e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:50.168884 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb810681-a7b7-4ae4-aa12-563fe0df3e10 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:50.169347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb810681-a7b7-4ae4-aa12-563fe0df3e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:50.169798 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb810681-a7b7-4ae4-aa12-563fe0df3e10 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:50.169942 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 321/652] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:50.170783 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce036788-c79a-4809-a915-b0ba2c7673f2 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:50.182974 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb810681-a7b7-4ae4-aa12-563fe0df3e10 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:50.184463 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb810681-a7b7-4ae4-aa12-563fe0df3e10 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:50.187904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:50.201402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-eb810681-a7b7-4ae4-aa12-563fe0df3e10 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 14:21:50.201402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:50.201402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:50.201402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:50.201402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:50.201402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:50.201402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:50.201402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:50.201402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:50.201402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:50.201402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:50.201402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:50.201402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:50.201402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:50.201402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:50.201402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:50.215720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:50.215720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:50.215720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:50.215720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:50.215720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:50.215720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:50.215720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:50.215720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:50.215720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:50.215720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:50.215720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:50.215720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:50.215720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:50.215720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:50.215720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:50.215720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:50.215720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:50.215720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:50.216624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:50.216624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:50.216624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:50.216624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:50.216624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:50.216624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:50.216624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:50.216624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:50.216624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 14:21:50.216624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:50.216624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 332/653] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:50.216624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb810681-a7b7-4ae4-aa12-563fe0df3e10 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:50.291165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:50.295041 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce036788-c79a-4809-a915-b0ba2c7673f2 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:50.314754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb810681-a7b7-4ae4-aa12-563fe0df3e10 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:50.330593 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a675a4-5928-46bd-9a78-06c5b2213ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:50.331415 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a675a4-5928-46bd-9a78-06c5b2213ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:50.331702 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a675a4-5928-46bd-9a78-06c5b2213ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:50.331978 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a675a4-5928-46bd-9a78-06c5b2213ac9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:50.343149 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a675a4-5928-46bd-9a78-06c5b2213ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:50.344638 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a675a4-5928-46bd-9a78-06c5b2213ac9 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:50.349532 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0b918-111e-427d-9327-813332dbad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:50.350193 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0b918-111e-427d-9327-813332dbad4d None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:50.350474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0b918-111e-427d-9327-813332dbad4d None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:50.350779 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0b918-111e-427d-9327-813332dbad4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:50.351653 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0b918-111e-427d-9327-813332dbad4d None admin] RBAC: Adding query filter params (role.id=c6f0b65d6ea5449ca79744ac52243ba2, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=122fc227de9d4f87a66e4a0d86ff0b16) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:50.351965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0b918-111e-427d-9327-813332dbad4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:50.353416 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0b918-111e-427d-9327-813332dbad4d None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:50.369539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 333/654] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:50 2022] GET /identity/v3/role_assignments?user.id=122fc227de9d4f87a66e4a0d86ff0b16&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=c6f0b65d6ea5449ca79744ac52243ba2 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:50.369539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0b918-111e-427d-9327-813332dbad4d None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:50.369840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-71a675a4-5928-46bd-9a78-06c5b2213ac9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:50.369840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:50.369840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:50.369840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:50.369840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:50.369840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:50.369840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:50.369840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:50.369840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:50.369840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:50.369840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:50.369840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:50.369840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:50.369840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:50.369840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:50.370907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:50.370907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:50.370907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:50.370907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:50.370907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:50.370907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:50.370907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:50.370907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:50.370907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:50.370907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:50.370907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:50.370907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:50.370907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:50.370907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:50.370907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:50.370907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:50.370907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:50.371817 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:50.371817 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:50.371817 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:50.371817 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:50.371817 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 322/655] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:50.371817 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a675a4-5928-46bd-9a78-06c5b2213ac9 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:50.441435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:50.484700 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0b918-111e-427d-9327-813332dbad4d None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:50.492984 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a675a4-5928-46bd-9a78-06c5b2213ac9 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:50.526128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a6b2a-12dd-412b-8fce-1653c5f4d0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:50.526701 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a6b2a-12dd-412b-8fce-1653c5f4d0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:50.527445 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a6b2a-12dd-412b-8fce-1653c5f4d0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:50.527445 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a6b2a-12dd-412b-8fce-1653c5f4d0f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:50.533300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234fb85-f989-40f5-9816-d6e450b82b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:50.533980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234fb85-f989-40f5-9816-d6e450b82b3d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:50.535551 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234fb85-f989-40f5-9816-d6e450b82b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:50.535551 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234fb85-f989-40f5-9816-d6e450b82b3d None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:50.535551 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234fb85-f989-40f5-9816-d6e450b82b3d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:50.535796 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234fb85-f989-40f5-9816-d6e450b82b3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:50.537147 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234fb85-f989-40f5-9816-d6e450b82b3d None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:50.539814 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a6b2a-12dd-412b-8fce-1653c5f4d0f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:50.542162 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a6b2a-12dd-412b-8fce-1653c5f4d0f2 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:50.558952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 323/656] 10.222.0.40 () {56 vars in 1137 bytes} [Tue Jul 12 14:21:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:50.560332 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463d1c6-14ac-4e4d-acb7-f08ffa8a36f3 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:50.560620 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463d1c6-14ac-4e4d-acb7-f08ffa8a36f3 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:50.560895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463d1c6-14ac-4e4d-acb7-f08ffa8a36f3 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:50.562266 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 324/657] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:50.563243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-384a6b2a-12dd-412b-8fce-1653c5f4d0f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:50.563243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:50.563243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:50.563243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:50.563243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:50.563243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:50.563243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:50.563243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:50.563243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:50.563243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:50.563243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:50.563243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:50.563243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:50.563243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:50.563243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:50.564127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:50.564127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:50.564127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:50.564127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:50.564127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:50.564127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:50.564127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:50.564127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:50.564127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:50.564127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:50.564127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:50.564127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:50.564127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:50.564127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:50.564127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:50.564127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:50.564127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:50.565016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:50.565016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:50.565016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:50.565016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:50.565016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 334/658] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:50.566548 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a6b2a-12dd-412b-8fce-1653c5f4d0f2 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:50.566865 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463d1c6-14ac-4e4d-acb7-f08ffa8a36f3 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:50.579200 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:50.691873 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463d1c6-14ac-4e4d-acb7-f08ffa8a36f3 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:50.692180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a6b2a-12dd-412b-8fce-1653c5f4d0f2 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:50.710198 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:50.731904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0772ef-21c2-4513-a727-86f406f8b590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:50.732576 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0772ef-21c2-4513-a727-86f406f8b590 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:50.732864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0772ef-21c2-4513-a727-86f406f8b590 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:50.733140 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0772ef-21c2-4513-a727-86f406f8b590 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:50.737790 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428aa08b-edcd-4a4e-b9c2-24b82ebb4e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:50.737997 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428aa08b-edcd-4a4e-b9c2-24b82ebb4e8c None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:50.738265 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428aa08b-edcd-4a4e-b9c2-24b82ebb4e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:50.738547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428aa08b-edcd-4a4e-b9c2-24b82ebb4e8c None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:50.739322 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428aa08b-edcd-4a4e-b9c2-24b82ebb4e8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:50.739640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428aa08b-edcd-4a4e-b9c2-24b82ebb4e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:50.741034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428aa08b-edcd-4a4e-b9c2-24b82ebb4e8c None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:50.754988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 325/659] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:50.761071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108d9a5-4375-47c4-9a81-22ac4227122c None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:50.761372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108d9a5-4375-47c4-9a81-22ac4227122c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:50.761640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108d9a5-4375-47c4-9a81-22ac4227122c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:50.780030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-d108d9a5-4375-47c4-9a81-22ac4227122c None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:50.781234 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-d108d9a5-4375-47c4-9a81-22ac4227122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:50.815509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0772ef-21c2-4513-a727-86f406f8b590 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:50.817077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0772ef-21c2-4513-a727-86f406f8b590 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:50.849833 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:50.855658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 326/660] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:50.856675 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108d9a5-4375-47c4-9a81-22ac4227122c None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:50.936984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 335/661] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:50.938102 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0772ef-21c2-4513-a727-86f406f8b590 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:50.956879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:50.985893 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108d9a5-4375-47c4-9a81-22ac4227122c None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:51.026633 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1000d-1d89-437f-84e1-5029781ce9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:51.027337 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1000d-1d89-437f-84e1-5029781ce9ae None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:51.027628 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1000d-1d89-437f-84e1-5029781ce9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:51.027909 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1000d-1d89-437f-84e1-5029781ce9ae None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:51.028651 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1000d-1d89-437f-84e1-5029781ce9ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:51.028964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1000d-1d89-437f-84e1-5029781ce9ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:51.030615 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1000d-1d89-437f-84e1-5029781ce9ae None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:51.049345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 327/662] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:51.049345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1000d-1d89-437f-84e1-5029781ce9ae None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:51.052439 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0772ef-21c2-4513-a727-86f406f8b590 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:51.089807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb60fa-0438-4c50-8994-f27d391caa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:51.090617 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb60fa-0438-4c50-8994-f27d391caa06 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:51.090956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb60fa-0438-4c50-8994-f27d391caa06 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:51.091237 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb60fa-0438-4c50-8994-f27d391caa06 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:51.099085 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb60fa-0438-4c50-8994-f27d391caa06 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:51.100574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb60fa-0438-4c50-8994-f27d391caa06 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:51.114467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:51.117066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-f9fb60fa-0438-4c50-8994-f27d391caa06 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 14:21:51.117066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:51.117066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:51.117066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:51.117066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:51.117066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:51.117066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:51.117066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:51.117066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:51.117066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:51.117066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:51.117066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:51.117066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:51.117066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:51.117066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:51.117066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:51.117981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:51.117981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:51.117981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:51.117981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:51.117981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:51.117981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:51.117981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:51.117981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:51.117981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:51.117981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:51.117981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:51.117981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:51.117981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:51.117981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:51.117981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:51.117981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:51.117981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:51.117981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:51.118878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:51.118878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:51.118878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:51.118878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:51.118878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:51.118878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:51.118878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:51.118878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:51.118878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 14:21:51.118878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:51.118878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 336/663] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:51.120043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb60fa-0438-4c50-8994-f27d391caa06 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:51.164065 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1000d-1d89-437f-84e1-5029781ce9ae None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:51.202809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b563c-bd6a-4fd5-9eb8-ce6bb596358d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:51.203748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b563c-bd6a-4fd5-9eb8-ce6bb596358d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:51.204036 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b563c-bd6a-4fd5-9eb8-ce6bb596358d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:51.204314 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b563c-bd6a-4fd5-9eb8-ce6bb596358d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:51.208660 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:51.218537 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b563c-bd6a-4fd5-9eb8-ce6bb596358d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:51.227161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-7e0b563c-bd6a-4fd5-9eb8-ce6bb596358d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:51.227161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:51.227161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:51.227161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:51.227161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:51.227161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:51.227161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:51.227161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:51.227161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:51.227161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:51.227161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:51.227161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:51.227161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:51.227161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:51.227161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:51.227161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:51.228305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:51.228305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:51.228305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:51.228305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:51.228305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:51.228305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:51.228305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:51.228305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:51.228305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:51.228305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:51.228305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:51.228305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:51.228305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:51.228305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:51.228305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:51.228305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:51.229169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:51.229169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:51.229169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:51.229169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:51.229169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:51.229169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:51.229169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:51.229169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:51.229169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:51.229169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:51.229169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:51.229169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:51.229169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 328/664] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:51.229876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b563c-bd6a-4fd5-9eb8-ce6bb596358d None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:51.243900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb60fa-0438-4c50-8994-f27d391caa06 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:51.280610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803976af-b1df-49ae-b626-0855c8f23624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:51.281541 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803976af-b1df-49ae-b626-0855c8f23624 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:51.281746 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803976af-b1df-49ae-b626-0855c8f23624 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:51.282022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803976af-b1df-49ae-b626-0855c8f23624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:51.293361 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803976af-b1df-49ae-b626-0855c8f23624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:51.294813 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803976af-b1df-49ae-b626-0855c8f23624 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:51.313994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-803976af-b1df-49ae-b626-0855c8f23624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:51.313994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:51.313994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:51.313994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:51.313994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:51.313994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:51.313994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:51.313994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:51.313994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:51.313994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:51.313994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:51.313994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:51.313994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:51.313994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:51.313994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:51.314941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:51.314941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:51.314941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:51.314941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:51.314941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:51.314941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:51.314941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:51.314941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:51.314941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:51.314941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:51.314941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:51.314941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:51.314941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:51.314941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:51.314941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:51.314941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:51.314941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:51.316632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:51.316632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:51.316632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:51.316632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:51.316632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 337/665] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:51.316632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803976af-b1df-49ae-b626-0855c8f23624 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:51.344921 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b563c-bd6a-4fd5-9eb8-ce6bb596358d None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:51.363777 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:51.381476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8b77b-0d7c-4e2d-a34e-6657fb8baf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:51.382558 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8b77b-0d7c-4e2d-a34e-6657fb8baf7e None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:51.389223 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8b77b-0d7c-4e2d-a34e-6657fb8baf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:51.389223 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8b77b-0d7c-4e2d-a34e-6657fb8baf7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:51.390278 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8b77b-0d7c-4e2d-a34e-6657fb8baf7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:51.391768 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8b77b-0d7c-4e2d-a34e-6657fb8baf7e None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:51.410364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-d9d8b77b-0d7c-4e2d-a34e-6657fb8baf7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:51.410364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:51.410364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:51.410364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:51.410364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:51.410364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:51.410364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:51.410364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:51.410364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:51.410364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:51.410364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:51.410364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:51.410364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:51.410364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:51.410364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:51.411357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:51.411357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:51.411357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:51.411357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:51.411357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:51.411357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:51.411357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:51.411357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:51.411357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:51.411357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:51.411357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:51.411357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:51.411357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:51.411357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:51.411357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:51.411357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:51.411357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:51.412329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:51.412329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:51.412329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:51.412329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:51.412329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:51.412329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:51.412329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:51.412329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:51.412329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 329/666] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:51.412861 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8b77b-0d7c-4e2d-a34e-6657fb8baf7e None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:51.429447 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803976af-b1df-49ae-b626-0855c8f23624 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:51.458158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:51.469233 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0be188-14fc-484d-8eb3-904fcdb062af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:51.469233 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0be188-14fc-484d-8eb3-904fcdb062af None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:51.469233 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0be188-14fc-484d-8eb3-904fcdb062af None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:51.469233 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0be188-14fc-484d-8eb3-904fcdb062af None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:51.469891 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0be188-14fc-484d-8eb3-904fcdb062af None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:51.470206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0be188-14fc-484d-8eb3-904fcdb062af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:51.471659 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0be188-14fc-484d-8eb3-904fcdb062af None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:51.491100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 338/667] 10.222.0.40 () {56 vars in 1139 bytes} [Tue Jul 12 14:21:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:51.492443 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0be188-14fc-484d-8eb3-904fcdb062af None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:51.533930 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8b77b-0d7c-4e2d-a34e-6657fb8baf7e None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:51.572470 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59132e39-ae2a-4fa4-88be-b6e96969d876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:51.573173 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59132e39-ae2a-4fa4-88be-b6e96969d876 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:51.573460 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59132e39-ae2a-4fa4-88be-b6e96969d876 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:51.573737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59132e39-ae2a-4fa4-88be-b6e96969d876 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:51.574523 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59132e39-ae2a-4fa4-88be-b6e96969d876 None admin] RBAC: Adding query filter params (name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:51.574867 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59132e39-ae2a-4fa4-88be-b6e96969d876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:51.576337 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59132e39-ae2a-4fa4-88be-b6e96969d876 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:51.587365 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 330/668] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:21:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:51.592757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59132e39-ae2a-4fa4-88be-b6e96969d876 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:51.605763 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0be188-14fc-484d-8eb3-904fcdb062af None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:51.637581 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:51.646027 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2cdc0-ed11-4953-a4f9-730a630a58ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:51.646754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2cdc0-ed11-4953-a4f9-730a630a58ff None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:51.647041 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2cdc0-ed11-4953-a4f9-730a630a58ff None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:51.647344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2cdc0-ed11-4953-a4f9-730a630a58ff None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:51.648625 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2cdc0-ed11-4953-a4f9-730a630a58ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:51.648931 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2cdc0-ed11-4953-a4f9-730a630a58ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:51.650301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2cdc0-ed11-4953-a4f9-730a630a58ff None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:51.668914 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 339/669] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:51.668914 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2cdc0-ed11-4953-a4f9-730a630a58ff None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:51.703859 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59132e39-ae2a-4fa4-88be-b6e96969d876 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:51.726551 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:51.742303 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c951a58-b684-4f6e-b0ed-b17c7325ff6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:51.742984 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c951a58-b684-4f6e-b0ed-b17c7325ff6d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:51.743271 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c951a58-b684-4f6e-b0ed-b17c7325ff6d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:51.743571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c951a58-b684-4f6e-b0ed-b17c7325ff6d None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:51.744371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c951a58-b684-4f6e-b0ed-b17c7325ff6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:51.744683 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c951a58-b684-4f6e-b0ed-b17c7325ff6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:51.746445 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c951a58-b684-4f6e-b0ed-b17c7325ff6d None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:51.760396 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 331/670] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:51.761150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c951a58-b684-4f6e-b0ed-b17c7325ff6d None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:51.792246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2cdc0-ed11-4953-a4f9-730a630a58ff None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:51.830986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fe5e2-3137-49be-a3d2-b838daaa2269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:51.832009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fe5e2-3137-49be-a3d2-b838daaa2269 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:51.832477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fe5e2-3137-49be-a3d2-b838daaa2269 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:51.832936 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fe5e2-3137-49be-a3d2-b838daaa2269 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:51.864203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:51.868195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c951a58-b684-4f6e-b0ed-b17c7325ff6d None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:51.909484 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e5171-659b-4881-b347-eb44f089ecae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:51.910392 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e5171-659b-4881-b347-eb44f089ecae None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:51.910745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e5171-659b-4881-b347-eb44f089ecae None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:51.911028 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e5171-659b-4881-b347-eb44f089ecae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:51.912710 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fe5e2-3137-49be-a3d2-b838daaa2269 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:51.915184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fe5e2-3137-49be-a3d2-b838daaa2269 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:51.922473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e5171-659b-4881-b347-eb44f089ecae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:51.923957 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e5171-659b-4881-b347-eb44f089ecae None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:51.942514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-9b4e5171-659b-4881-b347-eb44f089ecae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:51.942514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:51.942514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:51.942514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:51.942514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:51.942514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:51.942514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:51.942514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:51.942514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:51.942514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:51.942514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:51.942514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:51.942514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:51.942514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:51.942514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:51.943522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:51.943522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:51.943522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:51.943522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:51.943522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:51.943522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:51.943522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:51.943522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:51.943522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:51.943522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:51.943522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:51.943522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:51.943522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:51.943522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:51.943522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:51.943522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:51.943522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:51.944399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:51.944399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:51.944399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:51.944399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:51.944399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 332/671] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:51.945633 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e5171-659b-4881-b347-eb44f089ecae None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:51.973709 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:52.033736 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 340/672] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:52.039564 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fe5e2-3137-49be-a3d2-b838daaa2269 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:52.057811 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e5171-659b-4881-b347-eb44f089ecae None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:52.096600 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6c1c1-4104-4dc8-9c06-626dbd75f90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:52.097529 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6c1c1-4104-4dc8-9c06-626dbd75f90b None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:52.097812 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6c1c1-4104-4dc8-9c06-626dbd75f90b None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:52.098086 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6c1c1-4104-4dc8-9c06-626dbd75f90b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:52.106400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6c1c1-4104-4dc8-9c06-626dbd75f90b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:52.108023 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6c1c1-4104-4dc8-9c06-626dbd75f90b None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:52.123563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-70f6c1c1-4104-4dc8-9c06-626dbd75f90b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:52.123563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:52.123563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:52.123563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:52.123563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:52.123563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:52.123563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:52.123563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:52.123563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:52.123563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:52.123563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:52.123563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:52.123563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:52.123563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:52.123563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:52.124510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:52.124510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:52.124510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:52.124510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:52.124510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:52.124510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:52.124510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:52.124510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:52.124510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:52.124510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:52.124510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:52.124510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:52.124510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:52.124510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:52.124510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:52.124510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:52.124510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:52.125390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:52.125390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:52.125390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:52.125390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:52.125390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:52.125390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:52.125390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:52.125390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:52.125390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 333/673] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:52.126340 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6c1c1-4104-4dc8-9c06-626dbd75f90b None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:52.143252 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:52.153177 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fe5e2-3137-49be-a3d2-b838daaa2269 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:52.194016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083d8f8-4855-40ba-9c48-76c8fd87520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:52.195240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083d8f8-4855-40ba-9c48-76c8fd87520b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:52.195633 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083d8f8-4855-40ba-9c48-76c8fd87520b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:52.195918 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083d8f8-4855-40ba-9c48-76c8fd87520b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:52.196743 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083d8f8-4855-40ba-9c48-76c8fd87520b None admin] RBAC: Adding query filter params (role.id=c6f0b65d6ea5449ca79744ac52243ba2, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=37932500740c4ccb96358bd751d01598) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:52.197057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083d8f8-4855-40ba-9c48-76c8fd87520b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:52.198516 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083d8f8-4855-40ba-9c48-76c8fd87520b None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:52.204986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 341/674] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:52 2022] GET /identity/v3/role_assignments?user.id=37932500740c4ccb96358bd751d01598&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=c6f0b65d6ea5449ca79744ac52243ba2 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:52.205823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083d8f8-4855-40ba-9c48-76c8fd87520b None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:52.225783 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:52.255920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6c1c1-4104-4dc8-9c06-626dbd75f90b None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:52.316085 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad8bd6-ce49-4c27-875e-1552a1876783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:52.317045 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad8bd6-ce49-4c27-875e-1552a1876783 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:52.317474 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad8bd6-ce49-4c27-875e-1552a1876783 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:52.317918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad8bd6-ce49-4c27-875e-1552a1876783 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:52.318801 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad8bd6-ce49-4c27-875e-1552a1876783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:52.320557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad8bd6-ce49-4c27-875e-1552a1876783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:52.322142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad8bd6-ce49-4c27-875e-1552a1876783 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:52.344509 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 334/675] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:52.344509 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad8bd6-ce49-4c27-875e-1552a1876783 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:52.356001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083d8f8-4855-40ba-9c48-76c8fd87520b None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:52.408184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b51bf7-beb2-4ca3-85f6-4c5d7b9255f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:52.409153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b51bf7-beb2-4ca3-85f6-4c5d7b9255f8 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:52.409508 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b51bf7-beb2-4ca3-85f6-4c5d7b9255f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:52.409888 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b51bf7-beb2-4ca3-85f6-4c5d7b9255f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:52.422620 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b51bf7-beb2-4ca3-85f6-4c5d7b9255f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:52.424244 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b51bf7-beb2-4ca3-85f6-4c5d7b9255f8 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:52.434444 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:52.446148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-c7b51bf7-beb2-4ca3-85f6-4c5d7b9255f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:52.446148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:52.446148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:52.446148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:52.446148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:52.446148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:52.446148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:52.446148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:52.446148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:52.446148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:52.446148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:52.446148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:52.446148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:52.446148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:52.446148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:52.447450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:52.447450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:52.447450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:52.447450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:52.447450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:52.447450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:52.447450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:52.447450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:52.447450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:52.447450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:52.447450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:52.447450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:52.447450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:52.447450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:52.447450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:52.447450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:52.447450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:52.448348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:52.448348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:52.448348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:52.448348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:52.448348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 342/676] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:52.448616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b51bf7-beb2-4ca3-85f6-4c5d7b9255f8 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:52.470074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad8bd6-ce49-4c27-875e-1552a1876783 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:52.515205 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bd262-3600-48b6-9d02-42b5f6abfec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:52.515912 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bd262-3600-48b6-9d02-42b5f6abfec9 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:52.516203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bd262-3600-48b6-9d02-42b5f6abfec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:52.516484 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bd262-3600-48b6-9d02-42b5f6abfec9 None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:52.517294 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16bd262-3600-48b6-9d02-42b5f6abfec9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:52.517613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16bd262-3600-48b6-9d02-42b5f6abfec9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:52.520174 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16bd262-3600-48b6-9d02-42b5f6abfec9 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:52.529220 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:52.537286 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 335/677] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:52.538671 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bd262-3600-48b6-9d02-42b5f6abfec9 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:52.579095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b51bf7-beb2-4ca3-85f6-4c5d7b9255f8 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:52.624917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75e3c6-3bca-4ab8-ad46-c77a70ca4794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:52.625858 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75e3c6-3bca-4ab8-ad46-c77a70ca4794 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:52.626132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75e3c6-3bca-4ab8-ad46-c77a70ca4794 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:52.626410 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75e3c6-3bca-4ab8-ad46-c77a70ca4794 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:52.635480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75e3c6-3bca-4ab8-ad46-c77a70ca4794 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:52.636938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75e3c6-3bca-4ab8-ad46-c77a70ca4794 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:52.650268 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bd262-3600-48b6-9d02-42b5f6abfec9 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:52.652964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-8b75e3c6-3bca-4ab8-ad46-c77a70ca4794 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:21:52.652964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:52.652964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:52.652964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:52.652964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:52.652964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:52.652964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:52.652964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:52.652964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:52.652964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:52.652964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:52.652964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:52.652964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:52.652964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:52.652964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:52.652964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:52.654076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:52.654076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:52.654076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:52.654076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:52.654076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:52.654076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:52.654076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:52.654076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:52.654076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:52.654076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:52.654076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:52.654076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:52.654076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:52.654076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:52.654076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:52.654076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:52.654076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:52.654076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:52.655033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:52.655033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:52.655033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:52.655033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:52.655033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:52.655033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:52.655033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:52.655033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:52.655033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:21:52.655033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:52.655033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 343/678] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:21:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:52.655670 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853630f-9255-4df1-a984-9b8bfd34ea83 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:52.656170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853630f-9255-4df1-a984-9b8bfd34ea83 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:52.656170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853630f-9255-4df1-a984-9b8bfd34ea83 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:52.657605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 344/679] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:52.658240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853630f-9255-4df1-a984-9b8bfd34ea83 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:52.693756 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:52.702440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3cb6d-a049-46b6-96cd-bd0d58f06883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:52.703607 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3cb6d-a049-46b6-96cd-bd0d58f06883 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:52.704105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3cb6d-a049-46b6-96cd-bd0d58f06883 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:52.704587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3cb6d-a049-46b6-96cd-bd0d58f06883 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:52.705949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3cb6d-a049-46b6-96cd-bd0d58f06883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:52.706480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3cb6d-a049-46b6-96cd-bd0d58f06883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:52.709001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3cb6d-a049-46b6-96cd-bd0d58f06883 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:52.731458 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 336/680] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:52.732408 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3cb6d-a049-46b6-96cd-bd0d58f06883 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:52.772565 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853630f-9255-4df1-a984-9b8bfd34ea83 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:52.797474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:52.810569 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc11326-5f82-495e-8f67-df41144612f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:52.811236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc11326-5f82-495e-8f67-df41144612f0 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:52.811559 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc11326-5f82-495e-8f67-df41144612f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:52.811836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc11326-5f82-495e-8f67-df41144612f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:52.821158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc11326-5f82-495e-8f67-df41144612f0 None admin] RBAC: Adding query filter params (role.id=c6f0b65d6ea5449ca79744ac52243ba2, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=aeb6850303f54a16bb23f05165844dda) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:52.821158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc11326-5f82-495e-8f67-df41144612f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:52.821158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc11326-5f82-495e-8f67-df41144612f0 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:52.821710 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 345/681] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:52 2022] GET /identity/v3/role_assignments?user.id=aeb6850303f54a16bb23f05165844dda&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=c6f0b65d6ea5449ca79744ac52243ba2 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:52.823013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a21495-9ea0-46f9-902c-526077861a58 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:52.823318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a21495-9ea0-46f9-902c-526077861a58 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:52.823605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a21495-9ea0-46f9-902c-526077861a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:52.842017 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-31a21495-9ea0-46f9-902c-526077861a58 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:52.843173 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-31a21495-9ea0-46f9-902c-526077861a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:52.862859 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3cb6d-a049-46b6-96cd-bd0d58f06883 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:52.915326 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3e890-3c00-4ca3-821d-03acf0e800a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:52.916233 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3e890-3c00-4ca3-821d-03acf0e800a0 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:52.916592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3e890-3c00-4ca3-821d-03acf0e800a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:52.916945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3e890-3c00-4ca3-821d-03acf0e800a0 None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:52.917911 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3e890-3c00-4ca3-821d-03acf0e800a0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:52.918361 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3e890-3c00-4ca3-821d-03acf0e800a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:52.919895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3e890-3c00-4ca3-821d-03acf0e800a0 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:52.942230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 337/682] 10.222.0.40 () {56 vars in 1135 bytes} [Tue Jul 12 14:21:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:52.943199 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3e890-3c00-4ca3-821d-03acf0e800a0 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:52.950236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 346/683] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:52.951861 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a21495-9ea0-46f9-902c-526077861a58 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:53.033788 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:53.091446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a21495-9ea0-46f9-902c-526077861a58 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:53.095767 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3e890-3c00-4ca3-821d-03acf0e800a0 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:53.118848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:53.137182 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e3731-c691-4bbb-a9e6-a365c00dfb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:53.137988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e3731-c691-4bbb-a9e6-a365c00dfb11 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:53.138271 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e3731-c691-4bbb-a9e6-a365c00dfb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:53.138546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e3731-c691-4bbb-a9e6-a365c00dfb11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:53.145828 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790e860-4ba6-4ba1-bbb3-add713b0fd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:53.146155 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e3731-c691-4bbb-a9e6-a365c00dfb11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:53.147019 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790e860-4ba6-4ba1-bbb3-add713b0fd71 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:53.147583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790e860-4ba6-4ba1-bbb3-add713b0fd71 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:53.147707 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e3731-c691-4bbb-a9e6-a365c00dfb11 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:53.149006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790e860-4ba6-4ba1-bbb3-add713b0fd71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:53.166106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-bb2e3731-c691-4bbb-a9e6-a365c00dfb11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:53.166106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:53.166106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:53.166106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:53.166106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:53.166106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:53.166106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:53.166106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:53.166106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:53.166106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:53.166106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:53.166106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:53.166106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:53.166106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:53.166106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:53.167049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:53.167049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:53.167049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:53.167049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:53.167049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:53.167049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:53.167049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:53.167049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:53.167049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:53.167049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:53.167049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:53.167049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:53.167049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:53.167049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:53.167049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:53.167049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:53.167049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:53.167972 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:53.167972 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:53.167972 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:53.167972 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:53.167972 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:53.167972 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:53.167972 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:53.167972 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:53.171915 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 338/684] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:53.172964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e3731-c691-4bbb-a9e6-a365c00dfb11 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:53.254391 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790e860-4ba6-4ba1-bbb3-add713b0fd71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:53.257501 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790e860-4ba6-4ba1-bbb3-add713b0fd71 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:53.300148 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e3731-c691-4bbb-a9e6-a365c00dfb11 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:53.316478 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:53.352730 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6873718-d85d-4017-aaa1-5381cbad7fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:53.353969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6873718-d85d-4017-aaa1-5381cbad7fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:53.354719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6873718-d85d-4017-aaa1-5381cbad7fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:53.355001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6873718-d85d-4017-aaa1-5381cbad7fa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:53.367868 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6873718-d85d-4017-aaa1-5381cbad7fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:53.375934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-c6873718-d85d-4017-aaa1-5381cbad7fa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:53.375934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:53.375934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:53.375934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:53.375934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:53.375934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:53.375934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:53.375934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:53.375934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:53.375934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:53.375934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:53.375934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:53.375934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:53.375934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:53.375934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:53.375934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:53.376899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:53.376899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:53.376899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:53.376899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:53.376899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:53.376899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:53.376899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:53.376899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:53.376899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:53.376899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:53.376899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:53.376899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:53.376899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:53.376899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:53.376899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:53.376899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:53.377761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:53.377761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:53.377761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:53.377761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:53.377761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:53.377761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:53.377761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:53.377761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:53.377761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:53.377761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:53.377761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:53.377761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:53.377761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 339/685] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:21:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:53.378471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6873718-d85d-4017-aaa1-5381cbad7fa2 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:53.390560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 347/686] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:53.391816 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790e860-4ba6-4ba1-bbb3-add713b0fd71 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:53.419562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:53.511000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6873718-d85d-4017-aaa1-5381cbad7fa2 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:53.518016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790e860-4ba6-4ba1-bbb3-add713b0fd71 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:53.550086 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fd79c-5246-4574-8efa-15019065e1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:53.551561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fd79c-5246-4574-8efa-15019065e1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:53.552097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fd79c-5246-4574-8efa-15019065e1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:53.552633 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fd79c-5246-4574-8efa-15019065e1f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:53.554429 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fd79c-5246-4574-8efa-15019065e1f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:53.555412 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bce51-4328-4b7b-80ca-d3da7e1363f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:53.555822 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fd79c-5246-4574-8efa-15019065e1f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:53.556089 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bce51-4328-4b7b-80ca-d3da7e1363f8 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:53.556470 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bce51-4328-4b7b-80ca-d3da7e1363f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:53.556846 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bce51-4328-4b7b-80ca-d3da7e1363f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:53.557714 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bce51-4328-4b7b-80ca-d3da7e1363f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:53.558104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fd79c-5246-4574-8efa-15019065e1f0 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:53.558232 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bce51-4328-4b7b-80ca-d3da7e1363f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:53.559741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bce51-4328-4b7b-80ca-d3da7e1363f8 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:53.569562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 348/687] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:53.571133 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bce51-4328-4b7b-80ca-d3da7e1363f8 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:53.574202 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 340/688] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:53.584309 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fd79c-5246-4574-8efa-15019065e1f0 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:53.627248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:53.676096 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:53.678376 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bce51-4328-4b7b-80ca-d3da7e1363f8 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:53.701322 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fd79c-5246-4574-8efa-15019065e1f0 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:53.715222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e014f-b6b4-4502-ae7c-9c7d1f87d33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:53.716269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e014f-b6b4-4502-ae7c-9c7d1f87d33f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:53.716703 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e014f-b6b4-4502-ae7c-9c7d1f87d33f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:53.717134 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e014f-b6b4-4502-ae7c-9c7d1f87d33f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:53.729168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e014f-b6b4-4502-ae7c-9c7d1f87d33f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:53.730770 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e014f-b6b4-4502-ae7c-9c7d1f87d33f None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:53.743495 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bb005-aa15-49bc-8c92-a47c7b00e0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:53.744378 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bb005-aa15-49bc-8c92-a47c7b00e0be None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:53.744839 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bb005-aa15-49bc-8c92-a47c7b00e0be None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:53.745266 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bb005-aa15-49bc-8c92-a47c7b00e0be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:53.746509 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bb005-aa15-49bc-8c92-a47c7b00e0be None admin] RBAC: Adding query filter params (role.id=c6f0b65d6ea5449ca79744ac52243ba2, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=2af2d348fc984ed897fd58196b433b58) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:53.746994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bb005-aa15-49bc-8c92-a47c7b00e0be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:53.748612 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bb005-aa15-49bc-8c92-a47c7b00e0be None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:53.750269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-f73e014f-b6b4-4502-ae7c-9c7d1f87d33f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:53.750269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:53.750269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:53.750269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:53.750269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:53.750269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:53.750269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:53.750269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:53.750269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:53.750269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:53.750269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:53.750269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:53.750269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:53.750269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:53.750269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:53.751252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:53.751252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:53.751252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:53.751252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:53.751252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:53.751252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:53.751252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:53.751252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:53.751252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:53.751252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:53.751252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:53.751252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:53.751252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:53.751252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:53.751252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:53.751252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:53.751252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:53.752143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:53.752143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:53.752143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:53.752143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:53.752774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 349/689] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:53.753711 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e014f-b6b4-4502-ae7c-9c7d1f87d33f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:53.759871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 341/690] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:53 2022] GET /identity/v3/role_assignments?user.id=2af2d348fc984ed897fd58196b433b58&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=c6f0b65d6ea5449ca79744ac52243ba2 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:53.761033 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bb005-aa15-49bc-8c92-a47c7b00e0be None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:53.864703 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e014f-b6b4-4502-ae7c-9c7d1f87d33f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:53.873599 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:53.886846 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bb005-aa15-49bc-8c92-a47c7b00e0be None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:53.904495 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d4905-1a6b-4b30-9dff-0fa7461a2824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:53.905535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d4905-1a6b-4b30-9dff-0fa7461a2824 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:53.905811 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d4905-1a6b-4b30-9dff-0fa7461a2824 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:53.906145 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d4905-1a6b-4b30-9dff-0fa7461a2824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:53.917936 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d4905-1a6b-4b30-9dff-0fa7461a2824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:53.919574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d4905-1a6b-4b30-9dff-0fa7461a2824 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:53.926658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10412cd7-db78-474d-8d15-82f13535e12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:53.927750 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10412cd7-db78-474d-8d15-82f13535e12f None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:53.928271 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10412cd7-db78-474d-8d15-82f13535e12f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:53.928802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10412cd7-db78-474d-8d15-82f13535e12f None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:53.930459 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10412cd7-db78-474d-8d15-82f13535e12f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:53.930988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10412cd7-db78-474d-8d15-82f13535e12f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:53.932632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10412cd7-db78-474d-8d15-82f13535e12f None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:53.938509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-221d4905-1a6b-4b30-9dff-0fa7461a2824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:53.938509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:53.938509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:53.938509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:53.938509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:53.938509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:53.938509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:53.938509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:53.938509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:53.938509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:53.938509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:53.938509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:53.938509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:53.938509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:53.938509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:53.939615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:53.939615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:53.939615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:53.939615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:53.939615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:53.939615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:53.939615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:53.939615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:53.939615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:53.939615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:53.939615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:53.939615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:53.939615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:53.939615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:53.939615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:53.939615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:53.939615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:53.940492 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:53.940492 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:53.940492 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:53.940492 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:53.940492 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 350/691] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:53.941198 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:53.946399 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d4905-1a6b-4b30-9dff-0fa7461a2824 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:53.951524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 342/692] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:53.961707 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10412cd7-db78-474d-8d15-82f13535e12f None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:54.086812 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10412cd7-db78-474d-8d15-82f13535e12f None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:54.111952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d4905-1a6b-4b30-9dff-0fa7461a2824 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:54.139350 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2c5fc-c042-4527-941e-fb7a5247f759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:54.140822 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2c5fc-c042-4527-941e-fb7a5247f759 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:54.141308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2c5fc-c042-4527-941e-fb7a5247f759 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:54.142006 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2c5fc-c042-4527-941e-fb7a5247f759 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:54.153152 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2c5fc-c042-4527-941e-fb7a5247f759 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:54.155327 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2c5fc-c042-4527-941e-fb7a5247f759 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:54.157129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd84bb0-26c2-41f1-81b5-5db226e1b065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:54.157805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd84bb0-26c2-41f1-81b5-5db226e1b065 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:54.158090 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd84bb0-26c2-41f1-81b5-5db226e1b065 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:54.158366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd84bb0-26c2-41f1-81b5-5db226e1b065 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:54.159096 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd84bb0-26c2-41f1-81b5-5db226e1b065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:54.159453 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd84bb0-26c2-41f1-81b5-5db226e1b065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:54.160800 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd84bb0-26c2-41f1-81b5-5db226e1b065 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:54.174688 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 351/693] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:54.175677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-ede2c5fc-c042-4527-941e-fb7a5247f759 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:54.175677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:54.175677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:54.175677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:54.175677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:54.175677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:54.175677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:54.175677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:54.175677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:54.175677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:54.175677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:54.175677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:54.175677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:54.175677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:54.175677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:54.176555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:54.176555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:54.176555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:54.176555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:54.176555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:54.176555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:54.176555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:54.176555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:54.176555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:54.176555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:54.176555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:54.176555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:54.176555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:54.176555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:54.176555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:54.176555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:54.176555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:54.177440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:54.177440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:54.177440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:54.177440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:54.177440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:54.177440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:54.177440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:54.177440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:54.180316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 343/694] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:54.180479 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd84bb0-26c2-41f1-81b5-5db226e1b065 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:54.187257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2c5fc-c042-4527-941e-fb7a5247f759 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:54.208345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:54.237149 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:54.313992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd84bb0-26c2-41f1-81b5-5db226e1b065 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:54.336273 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2c5fc-c042-4527-941e-fb7a5247f759 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:54.351840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d940a-5f68-4f57-9d45-4624ca1f9fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:54.352646 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d940a-5f68-4f57-9d45-4624ca1f9fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:54.353520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d940a-5f68-4f57-9d45-4624ca1f9fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:54.353723 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d940a-5f68-4f57-9d45-4624ca1f9fb0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:54.361566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d940a-5f68-4f57-9d45-4624ca1f9fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:54.363208 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d940a-5f68-4f57-9d45-4624ca1f9fb0 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:54.378679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-0d9d940a-5f68-4f57-9d45-4624ca1f9fb0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:21:54.378679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:54.378679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:54.378679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:54.378679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:54.378679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:54.378679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:54.378679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:54.378679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:54.378679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:54.378679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:54.378679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:54.378679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:54.378679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:54.378679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:54.378679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:54.379699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:54.379699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:54.379699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:54.379699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:54.379699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:54.379699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:54.379699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:54.379699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:54.379699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:54.379699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:54.379699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:54.379699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:54.379699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:54.379699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:54.379699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:54.379699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:54.379699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:54.379699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:54.380610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:54.380610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:54.380610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:54.380610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:54.380610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:54.380610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:54.380610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:54.380610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:54.380610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:21:54.380610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:54.380610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 352/695] 10.222.0.40 () {56 vars in 1093 bytes} [Tue Jul 12 14:21:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:54.388966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d940a-5f68-4f57-9d45-4624ca1f9fb0 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:54.401909 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77901805-17d1-4ba3-95b3-47a24b8c2bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:54.402523 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77901805-17d1-4ba3-95b3-47a24b8c2bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:54.402807 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77901805-17d1-4ba3-95b3-47a24b8c2bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:54.403082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77901805-17d1-4ba3-95b3-47a24b8c2bf1 None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:54.404004 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77901805-17d1-4ba3-95b3-47a24b8c2bf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:54.404209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77901805-17d1-4ba3-95b3-47a24b8c2bf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:54.405659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77901805-17d1-4ba3-95b3-47a24b8c2bf1 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:54.441358 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 344/696] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:54.445891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77901805-17d1-4ba3-95b3-47a24b8c2bf1 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:54.551552 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:54.582635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77901805-17d1-4ba3-95b3-47a24b8c2bf1 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:54.613614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d940a-5f68-4f57-9d45-4624ca1f9fb0 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:54.615675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:54.635944 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36601d40-442b-413b-afd5-9c084ce7b17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:54.636622 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36601d40-442b-413b-afd5-9c084ce7b17d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:54.636908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36601d40-442b-413b-afd5-9c084ce7b17d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:54.637185 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36601d40-442b-413b-afd5-9c084ce7b17d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:54.638038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36601d40-442b-413b-afd5-9c084ce7b17d None admin] RBAC: Adding query filter params (role.id=c6f0b65d6ea5449ca79744ac52243ba2, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=ad12085f356a4f0682bb70ad231a10b6) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:54.638447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36601d40-442b-413b-afd5-9c084ce7b17d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:54.639836 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36601d40-442b-413b-afd5-9c084ce7b17d None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:54.650111 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 345/697] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:54 2022] GET /identity/v3/role_assignments?user.id=ad12085f356a4f0682bb70ad231a10b6&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=c6f0b65d6ea5449ca79744ac52243ba2 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:54.657335 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e62a9-1774-432a-9682-9e8f77b3f835 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:54.657545 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e62a9-1774-432a-9682-9e8f77b3f835 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:54.657831 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e62a9-1774-432a-9682-9e8f77b3f835 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:54.661602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 346/698] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:54.667128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135026fb-a081-4c99-991e-2a544bc199ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:54.668154 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135026fb-a081-4c99-991e-2a544bc199ee None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:54.668586 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135026fb-a081-4c99-991e-2a544bc199ee None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:54.669025 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135026fb-a081-4c99-991e-2a544bc199ee None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:54.669308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963acf26-a331-446b-9a01-d2170e09bb7a None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:54.669599 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963acf26-a331-446b-9a01-d2170e09bb7a None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:54.669879 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963acf26-a331-446b-9a01-d2170e09bb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:54.670661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135026fb-a081-4c99-991e-2a544bc199ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:54.671120 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135026fb-a081-4c99-991e-2a544bc199ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:54.672890 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135026fb-a081-4c99-991e-2a544bc199ee None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:54.695857 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 353/699] 10.222.0.40 () {56 vars in 1133 bytes} [Tue Jul 12 14:21:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:54.702428 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135026fb-a081-4c99-991e-2a544bc199ee None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:54.708408 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-963acf26-a331-446b-9a01-d2170e09bb7a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:54.713791 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-963acf26-a331-446b-9a01-d2170e09bb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:54.866032 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 347/700] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:21:54.877621 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135026fb-a081-4c99-991e-2a544bc199ee None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:54.891958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963acf26-a331-446b-9a01-d2170e09bb7a None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:54.917831 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0f1b2-49a4-41ae-91a7-9be56848ab83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:54.918833 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0f1b2-49a4-41ae-91a7-9be56848ab83 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:54.919322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0f1b2-49a4-41ae-91a7-9be56848ab83 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:54.919801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0f1b2-49a4-41ae-91a7-9be56848ab83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:54.952408 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:54.969445 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:54.999118 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0f1b2-49a4-41ae-91a7-9be56848ab83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:55.000919 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0f1b2-49a4-41ae-91a7-9be56848ab83 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:55.010014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963acf26-a331-446b-9a01-d2170e09bb7a None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:55.049372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647cf72d-fc2e-4495-bfa7-ca9edfa205e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:55.050150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cf72d-fc2e-4495-bfa7-ca9edfa205e9 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:55.050435 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cf72d-fc2e-4495-bfa7-ca9edfa205e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:55.050714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cf72d-fc2e-4495-bfa7-ca9edfa205e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:55.062685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647cf72d-fc2e-4495-bfa7-ca9edfa205e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:55.064401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647cf72d-fc2e-4495-bfa7-ca9edfa205e9 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:55.086407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-647cf72d-fc2e-4495-bfa7-ca9edfa205e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:55.086407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:55.086407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:55.086407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:55.086407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:55.086407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:55.086407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:55.086407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:55.086407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:55.086407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:55.086407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:55.086407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:55.086407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:55.086407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:55.086407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:55.087407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:55.087407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:55.087407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:55.087407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:55.087407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:55.087407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:55.087407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:55.087407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:55.087407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:55.087407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:55.087407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:55.087407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:55.087407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:55.087407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:55.087407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:55.087407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:55.087407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:55.088380 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:55.088380 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:55.088380 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:55.088380 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:55.088380 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 348/701] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:55.093741 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647cf72d-fc2e-4495-bfa7-ca9edfa205e9 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:55.115676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 354/702] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:55.121729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0f1b2-49a4-41ae-91a7-9be56848ab83 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:55.199492 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:55.213895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647cf72d-fc2e-4495-bfa7-ca9edfa205e9 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:55.237569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:55.255603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a22c9-4449-4547-9b80-e9e071933f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:55.256554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a22c9-4449-4547-9b80-e9e071933f29 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:55.257349 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a22c9-4449-4547-9b80-e9e071933f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:55.258367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a22c9-4449-4547-9b80-e9e071933f29 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:55.259697 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a22c9-4449-4547-9b80-e9e071933f29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:55.260143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a22c9-4449-4547-9b80-e9e071933f29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:55.261585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a22c9-4449-4547-9b80-e9e071933f29 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:55.261701 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0f1b2-49a4-41ae-91a7-9be56848ab83 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:55.278249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 349/703] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:55.280752 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce78d3-47ee-4f22-9f0e-08987d3505cd None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:55.281721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce78d3-47ee-4f22-9f0e-08987d3505cd None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:55.282015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce78d3-47ee-4f22-9f0e-08987d3505cd None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:55.283707 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 350/704] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:55.284555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce78d3-47ee-4f22-9f0e-08987d3505cd None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:55.311071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c08d9f-439b-4cbc-9f26-945d6737ce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:55.311953 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c08d9f-439b-4cbc-9f26-945d6737ce44 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:55.312278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c08d9f-439b-4cbc-9f26-945d6737ce44 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:55.312557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c08d9f-439b-4cbc-9f26-945d6737ce44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:55.328547 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c08d9f-439b-4cbc-9f26-945d6737ce44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:55.330009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c08d9f-439b-4cbc-9f26-945d6737ce44 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:55.354967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-35c08d9f-439b-4cbc-9f26-945d6737ce44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:55.354967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:55.354967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:55.354967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:55.354967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:55.354967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:55.354967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:55.354967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:55.354967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:55.354967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:55.354967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:55.354967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:55.354967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:55.354967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:55.354967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:55.355993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:55.355993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:55.355993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:55.355993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:55.355993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:55.355993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:55.355993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:55.355993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:55.355993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:55.355993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:55.355993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:55.355993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:55.355993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:55.355993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:55.355993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:55.355993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:55.355993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:55.356869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:55.356869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:55.356869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:55.356869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:55.356869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 355/705] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:55.360323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af975d-1848-4faf-ab2c-55c6bde9d7b5 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:55.360815 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af975d-1848-4faf-ab2c-55c6bde9d7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:55.361287 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af975d-1848-4faf-ab2c-55c6bde9d7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:55.382356 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-a7af975d-1848-4faf-ab2c-55c6bde9d7b5 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:55.384487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a7af975d-1848-4faf-ab2c-55c6bde9d7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:55.469426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce78d3-47ee-4f22-9f0e-08987d3505cd None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:55.469855 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 356/706] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:55.470782 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af975d-1848-4faf-ab2c-55c6bde9d7b5 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:55.534132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8911ab-d12a-48ba-8386-ec2a36e9f5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:55.534867 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8911ab-d12a-48ba-8386-ec2a36e9f5a5 None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:55.535150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8911ab-d12a-48ba-8386-ec2a36e9f5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:55.535457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8911ab-d12a-48ba-8386-ec2a36e9f5a5 None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:55.536255 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8911ab-d12a-48ba-8386-ec2a36e9f5a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:55.537814 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8911ab-d12a-48ba-8386-ec2a36e9f5a5 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:55.544000 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:55.615323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 351/707] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Jul 12 14:21:55 2022] POST /identity/v3/users => generated 254 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:21:55.615323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8911ab-d12a-48ba-8386-ec2a36e9f5a5 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:55.623839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af975d-1848-4faf-ab2c-55c6bde9d7b5 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:55.686945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:55.700221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db399bb-d590-4c9e-b004-1e61066890e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:55.700906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db399bb-d590-4c9e-b004-1e61066890e0 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:55.701187 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db399bb-d590-4c9e-b004-1e61066890e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:55.701460 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db399bb-d590-4c9e-b004-1e61066890e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:55.702200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db399bb-d590-4c9e-b004-1e61066890e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:55.702503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db399bb-d590-4c9e-b004-1e61066890e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:55.703919 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db399bb-d590-4c9e-b004-1e61066890e0 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:55.727560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 357/708] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:55.737608 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db399bb-d590-4c9e-b004-1e61066890e0 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:55.793051 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8911ab-d12a-48ba-8386-ec2a36e9f5a5 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:55.864553 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1ad60-2dfc-40fb-bec4-03c60d217b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:55.865473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1ad60-2dfc-40fb-bec4-03c60d217b54 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:55.865761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1ad60-2dfc-40fb-bec4-03c60d217b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:55.866038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1ad60-2dfc-40fb-bec4-03c60d217b54 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:55.868060 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1ad60-2dfc-40fb-bec4-03c60d217b54 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:55.869223 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1ad60-2dfc-40fb-bec4-03c60d217b54 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:55.885650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-47a1ad60-2dfc-40fb-bec4-03c60d217b54 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 14:21:55.885650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:55.885650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:55.885650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:55.885650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:55.885650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:55.885650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:55.885650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:55.885650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 14:21:55.885650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:55.885650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:55.885650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:55.885650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:55.885650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:55.885650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:55.885650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:55.886658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:55.886658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:55.886658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:55.886658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:55.886658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:55.886658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:55.886658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:55.886658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:55.886658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:55.886658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:55.886658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:55.886658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:55.886658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:55.886658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:55.886658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:55.886658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:55.892673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:55.892673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:55.892673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:55.892673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:55.892673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:55.892673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:55.892673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:55.892673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:55.892673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:55.892673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:55.892673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:55.892673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:55.892673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:55.892673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 14:21:55.892673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:55.892673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 352/709] 10.222.0.40 () {56 vars in 1129 bytes} [Tue Jul 12 14:21:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:55.895427 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1ad60-2dfc-40fb-bec4-03c60d217b54 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:55.920587 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db399bb-d590-4c9e-b004-1e61066890e0 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:55.922583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:55.958393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206d818-62da-4264-ab6e-c534af3548ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:55.959623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206d818-62da-4264-ab6e-c534af3548ff None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:55.960232 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206d818-62da-4264-ab6e-c534af3548ff None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:55.960711 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206d818-62da-4264-ab6e-c534af3548ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:55.969313 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206d818-62da-4264-ab6e-c534af3548ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:55.971050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206d818-62da-4264-ab6e-c534af3548ff None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:55.987172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-c206d818-62da-4264-ab6e-c534af3548ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:55.987172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:55.987172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:55.987172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:55.987172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:55.987172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:55.987172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:55.987172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:55.987172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:55.987172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:55.987172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:55.987172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:55.987172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:21:55.987172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:21:55.987172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:21:55.988130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:21:55.988130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:55.988130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:55.988130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:55.988130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:55.988130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:55.988130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:55.988130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:55.988130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:55.988130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:55.988130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:55.988130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:55.988130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:55.988130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:55.988130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:55.988130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:55.988130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:55.989050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:21:55.989050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:21:55.989050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:21:55.989050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:21:55.989050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:21:55.989050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:21:55.989050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:21:55.989050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:55.992274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 358/710] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:55.998619 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206d818-62da-4264-ab6e-c534af3548ff None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:56.012154 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1ad60-2dfc-40fb-bec4-03c60d217b54 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:56.027709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:56.051566 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd9a99-9272-4fd9-8eeb-ab3eee19014a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:56.052405 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd9a99-9272-4fd9-8eeb-ab3eee19014a None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:56.052696 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd9a99-9272-4fd9-8eeb-ab3eee19014a None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:56.053022 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd9a99-9272-4fd9-8eeb-ab3eee19014a None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:56.054646 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd9a99-9272-4fd9-8eeb-ab3eee19014a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:56.055099 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd9a99-9272-4fd9-8eeb-ab3eee19014a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:56.056579 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd9a99-9272-4fd9-8eeb-ab3eee19014a None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:56.062942 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 353/711] 10.222.0.40 () {56 vars in 1124 bytes} [Tue Jul 12 14:21:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:21:56.070164 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd9a99-9272-4fd9-8eeb-ab3eee19014a None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:56.128130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206d818-62da-4264-ab6e-c534af3548ff None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:56.165676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c59524-7e5f-4201-b33b-7c771d92081e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:56.166804 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c59524-7e5f-4201-b33b-7c771d92081e None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:56.167309 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c59524-7e5f-4201-b33b-7c771d92081e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:56.167789 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c59524-7e5f-4201-b33b-7c771d92081e None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:56.168786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c59524-7e5f-4201-b33b-7c771d92081e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:56.169297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c59524-7e5f-4201-b33b-7c771d92081e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:56.170936 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c59524-7e5f-4201-b33b-7c771d92081e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:56.185043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 359/712] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:21:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:56.189967 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd9a99-9272-4fd9-8eeb-ab3eee19014a None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:56.191320 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c59524-7e5f-4201-b33b-7c771d92081e None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:56.218381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:56.276055 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0782b3-0d59-4fba-8151-8809afdde0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:56.277109 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0782b3-0d59-4fba-8151-8809afdde0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:56.277598 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0782b3-0d59-4fba-8151-8809afdde0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:56.278080 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0782b3-0d59-4fba-8151-8809afdde0c0 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:56.279011 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0782b3-0d59-4fba-8151-8809afdde0c0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:56.279587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0782b3-0d59-4fba-8151-8809afdde0c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:56.281199 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0782b3-0d59-4fba-8151-8809afdde0c0 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:56.300547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 354/713] 10.222.0.40 () {56 vars in 1124 bytes} [Tue Jul 12 14:21:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:56.338153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c59524-7e5f-4201-b33b-7c771d92081e None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:56.376137 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e35490-3050-476c-8422-a7935bc8a1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:56.376807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e35490-3050-476c-8422-a7935bc8a1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:56.377085 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e35490-3050-476c-8422-a7935bc8a1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:56.377357 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e35490-3050-476c-8422-a7935bc8a1e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:56.378204 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e35490-3050-476c-8422-a7935bc8a1e7 None admin] RBAC: Adding query filter params (role.id=ae530119fc5c42358179521ce865b5d7, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=122fc227de9d4f87a66e4a0d86ff0b16) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:56.378515 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e35490-3050-476c-8422-a7935bc8a1e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:56.379999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e35490-3050-476c-8422-a7935bc8a1e7 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:56.387728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 360/714] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:21:56 2022] GET /identity/v3/role_assignments?user.id=122fc227de9d4f87a66e4a0d86ff0b16&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=ae530119fc5c42358179521ce865b5d7 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:56.594896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb4ca4-ca6c-4419-a40d-dee1b8ba1da4 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:56.595237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb4ca4-ca6c-4419-a40d-dee1b8ba1da4 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:56.595513 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb4ca4-ca6c-4419-a40d-dee1b8ba1da4 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:56.597118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 355/715] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:56.606131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c67ad-e8d3-467c-86e3-d887395564f2 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:56.606131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c67ad-e8d3-467c-86e3-d887395564f2 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:56.606131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c67ad-e8d3-467c-86e3-d887395564f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:56.625703 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-349c67ad-e8d3-467c-86e3-d887395564f2 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:56.631305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-349c67ad-e8d3-467c-86e3-d887395564f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:56.719582 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 361/716] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:56.761476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb4ca4-ca6c-4419-a40d-dee1b8ba1da4 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:56.824533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:56.961628 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb4ca4-ca6c-4419-a40d-dee1b8ba1da4 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:57.005326 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c53dff-e74d-46f8-8206-1d6156a63737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:57.006248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c53dff-e74d-46f8-8206-1d6156a63737 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:57.006532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c53dff-e74d-46f8-8206-1d6156a63737 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:57.007354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c53dff-e74d-46f8-8206-1d6156a63737 None admin] PATH_INFO: `/v3/services/network` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:57.008086 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c53dff-e74d-46f8-8206-1d6156a63737 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:57.009475 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c53dff-e74d-46f8-8206-1d6156a63737 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:57.022010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-71c53dff-e74d-46f8-8206-1d6156a63737 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 14:21:57.022010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:57.022010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:21:57.022010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:21:57.022010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:21:57.022010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:21:57.022010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:21:57.022010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:57.022010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 14:21:57.022010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:57.022010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:21:57.022010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:57.022010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:57.022010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:57.022010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:57.022010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:57.022010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:57.023905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:57.023905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:57.023905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:57.023905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:57.023905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:57.023905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:57.023905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:21:57.023905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:21:57.023905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:21:57.023905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:21:57.023905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:57.023905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:57.023905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:57.023905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:57.023905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:57.023905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:57.024736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:57.024736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:57.024736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:57.024736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:57.024736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:57.024736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:57.024736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:57.024736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:57.024736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:57.024736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:57.024736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:21:57.024736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:21:57.024736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 14:21:57.024736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:57.024736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 356/717] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:21:56 2022] GET /identity/v3/services/network => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:57.030801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c67ad-e8d3-467c-86e3-d887395564f2 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:57.075701 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:57.283202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c67ad-e8d3-467c-86e3-d887395564f2 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:57.376641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65bb72-29bb-48b0-839d-9083c7f13ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:57.377701 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65bb72-29bb-48b0-839d-9083c7f13ccb None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:57.378194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65bb72-29bb-48b0-839d-9083c7f13ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:57.378675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65bb72-29bb-48b0-839d-9083c7f13ccb None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:57.379651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65bb72-29bb-48b0-839d-9083c7f13ccb None admin] RBAC: Adding query filter params (name=network) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:57.380525 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65bb72-29bb-48b0-839d-9083c7f13ccb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:57.383807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65bb72-29bb-48b0-839d-9083c7f13ccb None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:57.395519 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 362/718] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Jul 12 14:21:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:57.402576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c53dff-e74d-46f8-8206-1d6156a63737 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:57.541786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249affcb-df67-4e43-98f4-398a5adad65d None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:57.542446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249affcb-df67-4e43-98f4-398a5adad65d None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:57.542956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249affcb-df67-4e43-98f4-398a5adad65d None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:57.544560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 363/719] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:21:57.550344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd73fe4-3b15-4ee7-967e-113360459229 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:57.550634 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd73fe4-3b15-4ee7-967e-113360459229 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:57.550914 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd73fe4-3b15-4ee7-967e-113360459229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:57.577590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-0cd73fe4-3b15-4ee7-967e-113360459229 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:57.580181 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0cd73fe4-3b15-4ee7-967e-113360459229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:57.623639 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:57.639014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c53dff-e74d-46f8-8206-1d6156a63737 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:57.705850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 364/720] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:57.707852 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523acf50-910c-4259-b39f-4baed104b730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:57.708766 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523acf50-910c-4259-b39f-4baed104b730 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:57.709251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523acf50-910c-4259-b39f-4baed104b730 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:57.709727 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523acf50-910c-4259-b39f-4baed104b730 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:57.711256 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523acf50-910c-4259-b39f-4baed104b730 None admin] RBAC: Adding query filter params (type=network) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:57.711906 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523acf50-910c-4259-b39f-4baed104b730 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:57.713499 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523acf50-910c-4259-b39f-4baed104b730 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:57.719097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 357/721] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Jul 12 14:21:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:57.739044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd73fe4-3b15-4ee7-967e-113360459229 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:57.755189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:57.894039 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd73fe4-3b15-4ee7-967e-113360459229 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:57.948102 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37efc03-1843-4342-84d6-d307091416de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:57.949299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37efc03-1843-4342-84d6-d307091416de None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:57.949783 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37efc03-1843-4342-84d6-d307091416de None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:57.950256 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37efc03-1843-4342-84d6-d307091416de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:57.968420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37efc03-1843-4342-84d6-d307091416de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:57.976597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-c37efc03-1843-4342-84d6-d307091416de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:57.976597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:57.976597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:57.976597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:57.976597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:57.976597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:57.976597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:57.976597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:57.976597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:57.976597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:57.976597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:57.976597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:57.976597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:57.976597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:57.976597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:57.976597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:57.977494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:57.977494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:57.977494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:57.977494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:57.977494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:57.977494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:57.977494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:57.977494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:57.977494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:57.977494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:57.977494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:57.977494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:57.977494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:57.977494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:57.977494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:57.977494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:57.978308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:57.978308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:57.978308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:57.978308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:57.978308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:57.978308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:57.978308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:57.978308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:57.978308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:57.978308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:57.978308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:21:57.978308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:57.980796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 365/722] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:21:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:57.986851 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523acf50-910c-4259-b39f-4baed104b730 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:58.130915 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523acf50-910c-4259-b39f-4baed104b730 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:58.167866 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140916d0-12b9-4cfd-8c90-1bfa794c9297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:58.168902 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140916d0-12b9-4cfd-8c90-1bfa794c9297 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:58.169388 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140916d0-12b9-4cfd-8c90-1bfa794c9297 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:58.169861 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140916d0-12b9-4cfd-8c90-1bfa794c9297 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:58.170831 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140916d0-12b9-4cfd-8c90-1bfa794c9297 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:58.171372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140916d0-12b9-4cfd-8c90-1bfa794c9297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:58.173077 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140916d0-12b9-4cfd-8c90-1bfa794c9297 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:58.182648 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 358/723] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:21:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:58.194847 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37efc03-1843-4342-84d6-d307091416de None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:58.323727 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:58.357779 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37efc03-1843-4342-84d6-d307091416de None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:58.410357 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32189e06-80bc-44db-867e-1052cca9bf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:58.411165 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32189e06-80bc-44db-867e-1052cca9bf0b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:58.411471 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32189e06-80bc-44db-867e-1052cca9bf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:58.411751 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32189e06-80bc-44db-867e-1052cca9bf0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:58.432545 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32189e06-80bc-44db-867e-1052cca9bf0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:58.433939 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32189e06-80bc-44db-867e-1052cca9bf0b None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:58.455178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-32189e06-80bc-44db-867e-1052cca9bf0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:58.455178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:58.455178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:58.455178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:58.455178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:58.455178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:58.455178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:58.455178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:58.455178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:58.455178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:58.455178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:58.455178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:58.455178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:58.455178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:58.455178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:58.456271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:58.456271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:58.456271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:58.456271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:58.456271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:58.456271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:58.456271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:58.456271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:58.456271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:58.456271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:58.456271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:58.456271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:58.456271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:58.456271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:58.456271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:58.456271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:58.456271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:58.457137 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:58.457137 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:58.457137 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:58.457137 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:58.457137 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 366/724] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:58.463890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140916d0-12b9-4cfd-8c90-1bfa794c9297 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:58.488637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:58.535797 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212062f-a63c-4ff3-afcf-645af3e863ca None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:58.536828 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212062f-a63c-4ff3-afcf-645af3e863ca None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:58.537508 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212062f-a63c-4ff3-afcf-645af3e863ca None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:58.540956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 367/725] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:58.552110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826425d-1054-4a6c-8d56-6b4abf5294af None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:58.552396 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826425d-1054-4a6c-8d56-6b4abf5294af None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:58.552676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826425d-1054-4a6c-8d56-6b4abf5294af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:58.582459 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-a826425d-1054-4a6c-8d56-6b4abf5294af None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:58.583696 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a826425d-1054-4a6c-8d56-6b4abf5294af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:58.653208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140916d0-12b9-4cfd-8c90-1bfa794c9297 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:58.714946 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 368/726] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 14:21:58.725028 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb784a1e-ce59-43df-9f8a-cba6f760b694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:58.725748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb784a1e-ce59-43df-9f8a-cba6f760b694 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:58.726036 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb784a1e-ce59-43df-9f8a-cba6f760b694 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:58.726314 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb784a1e-ce59-43df-9f8a-cba6f760b694 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:58.727052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb784a1e-ce59-43df-9f8a-cba6f760b694 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:58.727387 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb784a1e-ce59-43df-9f8a-cba6f760b694 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:58.728764 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb784a1e-ce59-43df-9f8a-cba6f760b694 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:58.742872 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826425d-1054-4a6c-8d56-6b4abf5294af None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:58.747847 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 359/727] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:58.754526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb784a1e-ce59-43df-9f8a-cba6f760b694 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:58.803905 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:58.859224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826425d-1054-4a6c-8d56-6b4abf5294af None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:58.910085 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964b5e6-9f43-4cc2-8a0a-74f20d13f6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:58.910906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964b5e6-9f43-4cc2-8a0a-74f20d13f6ec None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:58.911191 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964b5e6-9f43-4cc2-8a0a-74f20d13f6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:58.911504 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964b5e6-9f43-4cc2-8a0a-74f20d13f6ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:58.933133 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:58.942327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964b5e6-9f43-4cc2-8a0a-74f20d13f6ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:21:58.951055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-4964b5e6-9f43-4cc2-8a0a-74f20d13f6ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:58.951055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:58.951055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:58.951055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:58.951055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:58.951055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:58.951055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:58.951055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:58.951055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:58.951055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:58.951055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:58.951055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:58.951055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:21:58.951055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:21:58.951055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:21:58.951055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:21:58.952101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:21:58.952101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:21:58.952101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:21:58.952101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:21:58.952101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:58.952101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:58.952101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:58.952101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:58.952101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:58.952101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:58.952101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:58.952101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:58.952101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:58.952101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:58.952101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:58.952101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:58.952978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:58.952978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:58.952978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:58.952978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:58.952978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:21:58.952978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:21:58.952978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:21:58.952978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:21:58.952978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:21:58.952978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:21:58.952978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:21:58.952978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:21:58.952978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 369/728] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:21:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:58.954273 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d60e56-0159-40c3-aaf8-d3f46d4fc4be None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:58.954273 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d60e56-0159-40c3-aaf8-d3f46d4fc4be None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:58.955310 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d60e56-0159-40c3-aaf8-d3f46d4fc4be None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:58.955981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 370/729] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:58.960896 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d60e56-0159-40c3-aaf8-d3f46d4fc4be None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:58.962205 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb784a1e-ce59-43df-9f8a-cba6f760b694 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:59.001930 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c935418-7d53-4aa2-b14a-427e0bc3fda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:59.002645 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c935418-7d53-4aa2-b14a-427e0bc3fda5 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:59.002929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c935418-7d53-4aa2-b14a-427e0bc3fda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:59.003202 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c935418-7d53-4aa2-b14a-427e0bc3fda5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:59.012517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c935418-7d53-4aa2-b14a-427e0bc3fda5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:59.013990 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c935418-7d53-4aa2-b14a-427e0bc3fda5 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:59.032562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-3c935418-7d53-4aa2-b14a-427e0bc3fda5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:21:59.032562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:59.032562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:59.032562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:59.032562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:59.032562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:59.032562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:59.032562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:59.032562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:59.032562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:59.032562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:59.032562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:59.032562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:21:59.032562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:21:59.032562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:21:59.032562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:21:59.033613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:59.033613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:59.033613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:21:59.033613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:59.033613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:21:59.033613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:21:59.033613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:59.033613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:59.033613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:59.033613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:59.033613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:59.033613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:59.033613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:59.033613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:59.033613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:59.033613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:59.033613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:59.033613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:59.034543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:59.034543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:59.034543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:21:59.034543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:21:59.034543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:21:59.034543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:21:59.034543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:21:59.034543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:21:59.034543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:21:59.034543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:59.037469 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 360/730] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:21:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:21:59.040051 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea4540-3105-4c37-a88d-8728f6075500 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:59.040582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea4540-3105-4c37-a88d-8728f6075500 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:59.041059 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea4540-3105-4c37-a88d-8728f6075500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:59.060286 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-e6ea4540-3105-4c37-a88d-8728f6075500 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:59.062179 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-e6ea4540-3105-4c37-a88d-8728f6075500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:59.083162 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d60e56-0159-40c3-aaf8-d3f46d4fc4be None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:59.098820 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:59.125338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312192c-d6d1-4620-b467-4e595bad5043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:59.126018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312192c-d6d1-4620-b467-4e595bad5043 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:59.126301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312192c-d6d1-4620-b467-4e595bad5043 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:59.126578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312192c-d6d1-4620-b467-4e595bad5043 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:59.127411 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312192c-d6d1-4620-b467-4e595bad5043 None admin] RBAC: Adding query filter params (name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:59.127721 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312192c-d6d1-4620-b467-4e595bad5043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:59.129147 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312192c-d6d1-4620-b467-4e595bad5043 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:59.139413 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 371/731] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:21:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:59.140334 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312192c-d6d1-4620-b467-4e595bad5043 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:59.155234 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 361/732] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:59.156157 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea4540-3105-4c37-a88d-8728f6075500 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:59.257607 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:59.274214 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312192c-d6d1-4620-b467-4e595bad5043 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:59.300180 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea4540-3105-4c37-a88d-8728f6075500 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:59.315008 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6268e42-0ea6-43fa-bfa5-4b4c049b1f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:59.315719 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6268e42-0ea6-43fa-bfa5-4b4c049b1f85 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:59.316003 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6268e42-0ea6-43fa-bfa5-4b4c049b1f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:59.316275 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6268e42-0ea6-43fa-bfa5-4b4c049b1f85 None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:59.317120 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6268e42-0ea6-43fa-bfa5-4b4c049b1f85 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:59.317437 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6268e42-0ea6-43fa-bfa5-4b4c049b1f85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:59.318861 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6268e42-0ea6-43fa-bfa5-4b4c049b1f85 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:59.342436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 372/733] 10.222.0.40 () {56 vars in 1135 bytes} [Tue Jul 12 14:21:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:59.343745 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6268e42-0ea6-43fa-bfa5-4b4c049b1f85 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:59.348710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0333f6-fc22-459d-9023-24d1ca35ee74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:59.349624 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0333f6-fc22-459d-9023-24d1ca35ee74 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:59.349978 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0333f6-fc22-459d-9023-24d1ca35ee74 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:59.350330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0333f6-fc22-459d-9023-24d1ca35ee74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:59.365263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0333f6-fc22-459d-9023-24d1ca35ee74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:59.368488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0333f6-fc22-459d-9023-24d1ca35ee74 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:59.385518 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:59.389206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-1c0333f6-fc22-459d-9023-24d1ca35ee74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:59.389206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:21:59.389206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:21:59.389206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:21:59.389206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:21:59.389206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:21:59.389206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:21:59.389206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:21:59.389206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:21:59.389206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:21:59.389206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:21:59.389206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:21:59.389206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:21:59.389206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:21:59.389206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:21:59.390130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:21:59.390130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:21:59.390130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:21:59.390130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:21:59.390130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:21:59.390130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:21:59.390130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:21:59.390130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:21:59.390130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:21:59.390130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:21:59.390130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:21:59.390130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:21:59.390130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:21:59.390130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:21:59.390130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:21:59.390130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:21:59.390130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:21:59.391021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:21:59.391021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:21:59.391021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:21:59.391021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:21:59.391021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 362/734] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:21:59.391881 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e62128-82e0-44be-b003-bbd41a4a7a0c None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:59.392089 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e62128-82e0-44be-b003-bbd41a4a7a0c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:59.392370 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e62128-82e0-44be-b003-bbd41a4a7a0c None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:59.398047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 363/735] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:21:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:21:59.399253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e62128-82e0-44be-b003-bbd41a4a7a0c None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:59.473595 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6268e42-0ea6-43fa-bfa5-4b4c049b1f85 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:59.516752 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044341c-0f7e-49fe-afef-60ef5e345e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:59.517340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044341c-0f7e-49fe-afef-60ef5e345e5e None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:59.517627 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044341c-0f7e-49fe-afef-60ef5e345e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:59.517904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044341c-0f7e-49fe-afef-60ef5e345e5e None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:59.518636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044341c-0f7e-49fe-afef-60ef5e345e5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:59.518755 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e62128-82e0-44be-b003-bbd41a4a7a0c None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:59.520037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044341c-0f7e-49fe-afef-60ef5e345e5e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:59.540738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:59.555535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4993c3-42ad-433e-8486-7678c4dacd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:59.556192 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4993c3-42ad-433e-8486-7678c4dacd32 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:59.556478 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4993c3-42ad-433e-8486-7678c4dacd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:59.556758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4993c3-42ad-433e-8486-7678c4dacd32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:59.606164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 373/736] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Jul 12 14:21:59 2022] POST /identity/v3/services => generated 251 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:21:59.607236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044341c-0f7e-49fe-afef-60ef5e345e5e None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:59.642412 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4993c3-42ad-433e-8486-7678c4dacd32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:59.644541 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4993c3-42ad-433e-8486-7678c4dacd32 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:59.752968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:59.778638 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044341c-0f7e-49fe-afef-60ef5e345e5e None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:21:59.784403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 364/737] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:21:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:21:59.785751 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94c75e-1926-420f-a0ae-179757a67a42 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:59.786045 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94c75e-1926-420f-a0ae-179757a67a42 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:59.786329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94c75e-1926-420f-a0ae-179757a67a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:59.813769 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-2d94c75e-1926-420f-a0ae-179757a67a42 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:21:59.815148 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2d94c75e-1926-420f-a0ae-179757a67a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:21:59.831631 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bc27c-3d93-4fb1-9f88-c338710056d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:21:59.832280 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bc27c-3d93-4fb1-9f88-c338710056d0 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:21:59.832738 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bc27c-3d93-4fb1-9f88-c338710056d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:21:59.833022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bc27c-3d93-4fb1-9f88-c338710056d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:21:59.833523 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:21:59.834249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bc27c-3d93-4fb1-9f88-c338710056d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:21:59.834524 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bc27c-3d93-4fb1-9f88-c338710056d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:21:59.837022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bc27c-3d93-4fb1-9f88-c338710056d0 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:21:59.855076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 374/738] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:21:59.858585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bc27c-3d93-4fb1-9f88-c338710056d0 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:59.916462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 365/739] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:21:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:21:59.917488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94c75e-1926-420f-a0ae-179757a67a42 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:21:59.979303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bc27c-3d93-4fb1-9f88-c338710056d0 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:00.017903 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68507a-8503-44c4-92fc-cedc721f20ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:00.018950 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68507a-8503-44c4-92fc-cedc721f20ca None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:00.019460 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68507a-8503-44c4-92fc-cedc721f20ca None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:00.019882 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68507a-8503-44c4-92fc-cedc721f20ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:00.035581 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68507a-8503-44c4-92fc-cedc721f20ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:00.037274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68507a-8503-44c4-92fc-cedc721f20ca None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:00.048324 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:00.052308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94c75e-1926-420f-a0ae-179757a67a42 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:00.059539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-df68507a-8503-44c4-92fc-cedc721f20ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:00.059539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:00.059539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:00.059539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:00.059539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:00.059539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:00.059539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:00.059539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:00.059539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:00.059539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:00.059539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:00.059539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:00.059539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:00.059539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:00.059539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:00.060647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:00.060647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:00.060647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:00.060647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:00.060647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:00.060647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:00.060647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:00.060647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:00.060647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:00.060647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:00.060647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:00.060647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:00.060647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:00.060647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:00.060647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:00.060647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:00.060647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:00.061713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:00.061713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:00.061713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:00.061713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:00.063623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 375/740] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:21:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:00.064586 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68507a-8503-44c4-92fc-cedc721f20ca None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:00.108562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99019df8-9206-41b4-b86d-be7ff08af8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:00.109567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99019df8-9206-41b4-b86d-be7ff08af8de None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:00.109954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99019df8-9206-41b4-b86d-be7ff08af8de None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:00.110338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99019df8-9206-41b4-b86d-be7ff08af8de None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:00.119695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99019df8-9206-41b4-b86d-be7ff08af8de None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:00.121415 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99019df8-9206-41b4-b86d-be7ff08af8de None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:00.139253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-99019df8-9206-41b4-b86d-be7ff08af8de None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:22:00.139253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:00.139253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:00.139253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:00.139253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:00.139253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:00.139253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:00.139253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:00.139253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:00.139253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:00.139253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:00.139253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:00.139253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:22:00.139253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:22:00.139253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:22:00.139253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:22:00.140251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:00.140251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:00.140251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:22:00.140251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:00.140251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:22:00.140251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:00.140251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:00.140251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:00.140251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:00.140251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:00.140251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:00.140251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:00.140251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:00.140251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:00.140251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:00.140251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:00.140251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:00.140251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:00.141188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:00.141188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:00.141188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:22:00.141188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:22:00.141188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:22:00.141188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:22:00.141188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:22:00.141188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:22:00.141188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:22:00.141188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:00.141188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 366/741] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Jul 12 14:21:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:00.141773 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99019df8-9206-41b4-b86d-be7ff08af8de None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:00.154573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:00.209686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68507a-8503-44c4-92fc-cedc721f20ca None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:00.265453 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fc714-b657-4a5a-897a-217e859f0342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:00.266347 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99019df8-9206-41b4-b86d-be7ff08af8de None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:00.266498 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fc714-b657-4a5a-897a-217e859f0342 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:00.266883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fc714-b657-4a5a-897a-217e859f0342 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:00.267256 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fc714-b657-4a5a-897a-217e859f0342 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:00.279397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1fc714-b657-4a5a-897a-217e859f0342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:00.287336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-ce1fc714-b657-4a5a-897a-217e859f0342 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:00.287336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:00.287336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:00.287336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:00.287336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:00.287336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:00.287336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:00.287336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:00.287336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:00.287336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:00.287336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:00.287336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:00.287336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:00.287336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:00.287336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:00.287336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:00.288480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:00.288480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:00.288480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:00.288480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:00.288480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:00.288480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:00.288480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:00.288480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:00.288480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:00.288480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:00.288480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:00.288480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:00.288480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:00.288480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:00.288480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:00.288480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:00.289435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:00.289435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:00.289435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:00.289435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:00.289435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:00.289435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:00.289435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:00.289435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:00.289435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:00.289435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:00.289435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:00.289435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:00.291568 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 376/742] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:22:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:00.292566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fc714-b657-4a5a-897a-217e859f0342 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:00.313462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed436758-755d-46be-8ef5-5a16af234dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:00.314136 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed436758-755d-46be-8ef5-5a16af234dbf None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:00.314428 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed436758-755d-46be-8ef5-5a16af234dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:00.314708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed436758-755d-46be-8ef5-5a16af234dbf None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:00.315469 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed436758-755d-46be-8ef5-5a16af234dbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:00.315779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed436758-755d-46be-8ef5-5a16af234dbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:00.317159 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed436758-755d-46be-8ef5-5a16af234dbf None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:00.329546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 367/743] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:00.330404 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed436758-755d-46be-8ef5-5a16af234dbf None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:00.363267 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:00.408343 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fc714-b657-4a5a-897a-217e859f0342 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:00.409282 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:00.443802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed436758-755d-46be-8ef5-5a16af234dbf None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:00.446532 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7a353-1b76-4f51-b3dd-487feb309b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:00.447352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7a353-1b76-4f51-b3dd-487feb309b7d None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:00.447771 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7a353-1b76-4f51-b3dd-487feb309b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:00.448152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7a353-1b76-4f51-b3dd-487feb309b7d None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:00.449014 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7a353-1b76-4f51-b3dd-487feb309b7d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:00.449329 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7a353-1b76-4f51-b3dd-487feb309b7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:00.450767 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7a353-1b76-4f51-b3dd-487feb309b7d None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:00.475438 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 377/744] 10.222.0.40 () {56 vars in 1149 bytes} [Tue Jul 12 14:22:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:00.477061 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2da37-fa9a-4255-b49b-4f12c9816fda None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:00.477315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2da37-fa9a-4255-b49b-4f12c9816fda None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:00.477539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2da37-fa9a-4255-b49b-4f12c9816fda None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:00.479378 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 378/745] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:00.480004 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2da37-fa9a-4255-b49b-4f12c9816fda None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:00.485192 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f67b4b-50a8-45e4-9122-46a29b3809c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:00.485876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f67b4b-50a8-45e4-9122-46a29b3809c4 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:00.486163 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f67b4b-50a8-45e4-9122-46a29b3809c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:00.486442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f67b4b-50a8-45e4-9122-46a29b3809c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:00.487220 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f67b4b-50a8-45e4-9122-46a29b3809c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:00.487547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f67b4b-50a8-45e4-9122-46a29b3809c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:00.488960 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f67b4b-50a8-45e4-9122-46a29b3809c4 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:00.498182 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 368/746] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:22:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:00.499041 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f67b4b-50a8-45e4-9122-46a29b3809c4 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:00.600226 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2da37-fa9a-4255-b49b-4f12c9816fda None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:00.609826 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f67b4b-50a8-45e4-9122-46a29b3809c4 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:00.619728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:00.637632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b6139-9ee4-4500-a902-c69862a7e508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:00.638620 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b6139-9ee4-4500-a902-c69862a7e508 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:00.638907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b6139-9ee4-4500-a902-c69862a7e508 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:00.639187 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b6139-9ee4-4500-a902-c69862a7e508 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:00.647003 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b6139-9ee4-4500-a902-c69862a7e508 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:00.648107 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:00.649158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b6139-9ee4-4500-a902-c69862a7e508 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:00.655018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd1155-939e-4117-bc95-ca815bf01cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:00.655999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd1155-939e-4117-bc95-ca815bf01cba None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:00.656430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd1155-939e-4117-bc95-ca815bf01cba None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:00.656712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd1155-939e-4117-bc95-ca815bf01cba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:00.664488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-736b6139-9ee4-4500-a902-c69862a7e508 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:00.664488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:00.664488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:00.664488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:00.664488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:00.664488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:00.664488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:00.664488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:00.664488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:00.664488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:00.664488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:00.664488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:00.664488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:22:00.664488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:22:00.664488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:22:00.665955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:22:00.665955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:00.665955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:00.665955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:00.665955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:00.665955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:00.665955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:00.665955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:00.665955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:00.665955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:00.665955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:00.665955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:00.665955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:00.665955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:00.665955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:00.665955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:00.665955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:00.666830 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:22:00.666830 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:22:00.666830 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:22:00.666830 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:22:00.666830 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:22:00.666830 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:22:00.666830 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:00.666830 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:00.666830 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 379/747] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:00.667748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888faaff-3aff-49a5-906a-499cb138628e None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:00.667858 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888faaff-3aff-49a5-906a-499cb138628e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:00.668047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888faaff-3aff-49a5-906a-499cb138628e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:00.686098 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-888faaff-3aff-49a5-906a-499cb138628e None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:00.687324 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-888faaff-3aff-49a5-906a-499cb138628e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:00.737450 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd1155-939e-4117-bc95-ca815bf01cba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:00.738909 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd1155-939e-4117-bc95-ca815bf01cba None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:00.768873 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 380/748] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 14:22:00.769728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888faaff-3aff-49a5-906a-499cb138628e None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:00.868362 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 369/749] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:22:00 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 14:22:00.868362 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd1155-939e-4117-bc95-ca815bf01cba None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:00.879242 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888faaff-3aff-49a5-906a-499cb138628e None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:00.890108 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:00.905648 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:00.917762 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168de75-e4ab-427a-b333-b29cfd17ff32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:00.918563 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168de75-e4ab-427a-b333-b29cfd17ff32 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:00.918845 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168de75-e4ab-427a-b333-b29cfd17ff32 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:00.919118 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168de75-e4ab-427a-b333-b29cfd17ff32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:00.929988 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168de75-e4ab-427a-b333-b29cfd17ff32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:00.931457 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168de75-e4ab-427a-b333-b29cfd17ff32 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:00.949507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-e168de75-e4ab-427a-b333-b29cfd17ff32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:00.949507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:00.949507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:00.949507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:00.949507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:00.949507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:00.949507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:00.949507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:00.949507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:00.949507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:00.949507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:00.949507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:00.949507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:00.949507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:00.949507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:00.950440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:00.950440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:00.950440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:00.950440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:00.950440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:00.950440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:00.950440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:00.950440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:00.950440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:00.950440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:00.950440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:00.950440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:00.950440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:00.950440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:00.950440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:00.950440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:00.950440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:00.951338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:00.951338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:00.951338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:00.951338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:00.955342 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 381/750] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:00.956172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168de75-e4ab-427a-b333-b29cfd17ff32 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:00.980724 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd1155-939e-4117-bc95-ca815bf01cba None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:01.017997 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9cf539-c76d-4b50-9d94-a34c6fcb3717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:01.018674 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cf539-c76d-4b50-9d94-a34c6fcb3717 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:01.018960 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cf539-c76d-4b50-9d94-a34c6fcb3717 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:01.019239 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cf539-c76d-4b50-9d94-a34c6fcb3717 None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:01.020074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9cf539-c76d-4b50-9d94-a34c6fcb3717 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:01.020384 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9cf539-c76d-4b50-9d94-a34c6fcb3717 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:01.021809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9cf539-c76d-4b50-9d94-a34c6fcb3717 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:01.040268 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 370/751] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:22:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:01.040268 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9cf539-c76d-4b50-9d94-a34c6fcb3717 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:01.064587 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168de75-e4ab-427a-b333-b29cfd17ff32 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:01.099940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef919c19-a802-473c-ad8c-b24b628f8fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:01.101244 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef919c19-a802-473c-ad8c-b24b628f8fe1 None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:01.101600 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef919c19-a802-473c-ad8c-b24b628f8fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:01.101950 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef919c19-a802-473c-ad8c-b24b628f8fe1 None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:01.102746 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef919c19-a802-473c-ad8c-b24b628f8fe1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:01.104215 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef919c19-a802-473c-ad8c-b24b628f8fe1 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:01.133923 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:01.142202 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9cf539-c76d-4b50-9d94-a34c6fcb3717 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:01.175130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce14fc9-a470-479a-975e-cf10a5ce977d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:01.175982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce14fc9-a470-479a-975e-cf10a5ce977d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:01.176267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce14fc9-a470-479a-975e-cf10a5ce977d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:01.176543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce14fc9-a470-479a-975e-cf10a5ce977d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:01.187144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce14fc9-a470-479a-975e-cf10a5ce977d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:01.188642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce14fc9-a470-479a-975e-cf10a5ce977d None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:01.197568 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 382/752] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Jul 12 14:22:00 2022] POST /identity/v3/services => generated 240 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:22:01.197568 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef919c19-a802-473c-ad8c-b24b628f8fe1 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:01.217403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-0ce14fc9-a470-479a-975e-cf10a5ce977d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:01.217403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:01.217403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:01.217403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:01.217403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:01.217403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:01.217403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:01.217403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:01.217403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:01.217403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:01.217403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:01.217403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:01.217403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:01.217403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:01.217403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:01.218556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:01.218556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:01.218556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:01.218556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:01.218556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:01.218556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:01.218556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:01.218556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:01.218556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:01.218556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:01.218556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:01.218556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:01.218556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:01.218556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:01.218556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:01.218556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:01.218556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:01.219736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:01.219736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:01.219736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:01.219736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:01.223456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 371/753] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:01.224538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce14fc9-a470-479a-975e-cf10a5ce977d None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:01.226540 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:01.337102 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef919c19-a802-473c-ad8c-b24b628f8fe1 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:01.354956 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce14fc9-a470-479a-975e-cf10a5ce977d None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:01.377055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a489e-9cf7-4e8e-b78d-7bd132be98dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:01.378137 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a489e-9cf7-4e8e-b78d-7bd132be98dc None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:01.378682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a489e-9cf7-4e8e-b78d-7bd132be98dc None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:01.379162 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a489e-9cf7-4e8e-b78d-7bd132be98dc None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:01.380160 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a489e-9cf7-4e8e-b78d-7bd132be98dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:01.380682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a489e-9cf7-4e8e-b78d-7bd132be98dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:01.382877 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a489e-9cf7-4e8e-b78d-7bd132be98dc None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:01.398543 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 383/754] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:01.398716 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21452c70-40ef-42a9-91b9-d1d97ab68e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:01.398716 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21452c70-40ef-42a9-91b9-d1d97ab68e93 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:01.399032 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21452c70-40ef-42a9-91b9-d1d97ab68e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:01.399306 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21452c70-40ef-42a9-91b9-d1d97ab68e93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:01.400168 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21452c70-40ef-42a9-91b9-d1d97ab68e93 None admin] RBAC: Adding query filter params (role.id=ae530119fc5c42358179521ce865b5d7, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=ad12085f356a4f0682bb70ad231a10b6) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:01.400482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21452c70-40ef-42a9-91b9-d1d97ab68e93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:01.400919 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a489e-9cf7-4e8e-b78d-7bd132be98dc None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:01.402073 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21452c70-40ef-42a9-91b9-d1d97ab68e93 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:01.411168 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 372/755] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:22:01 2022] GET /identity/v3/role_assignments?user.id=ad12085f356a4f0682bb70ad231a10b6&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=ae530119fc5c42358179521ce865b5d7 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:01.412528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21452c70-40ef-42a9-91b9-d1d97ab68e93 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:01.443710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:01.525595 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:01.548873 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21452c70-40ef-42a9-91b9-d1d97ab68e93 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:01.559473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a489e-9cf7-4e8e-b78d-7bd132be98dc None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:01.600596 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51939386-e94e-47ca-879e-343e36688896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:01.602378 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51939386-e94e-47ca-879e-343e36688896 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:01.603095 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51939386-e94e-47ca-879e-343e36688896 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:01.603565 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51939386-e94e-47ca-879e-343e36688896 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:01.607521 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad959f-b2cc-4451-952a-e4787436d953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:01.608202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad959f-b2cc-4451-952a-e4787436d953 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:01.608489 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad959f-b2cc-4451-952a-e4787436d953 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:01.608772 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad959f-b2cc-4451-952a-e4787436d953 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:01.609506 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad959f-b2cc-4451-952a-e4787436d953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:01.609819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad959f-b2cc-4451-952a-e4787436d953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:01.611216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad959f-b2cc-4451-952a-e4787436d953 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:01.614473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51939386-e94e-47ca-879e-343e36688896 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:01.616647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51939386-e94e-47ca-879e-343e36688896 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:01.625053 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 384/756] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:01.630239 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad959f-b2cc-4451-952a-e4787436d953 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:01.636520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-51939386-e94e-47ca-879e-343e36688896 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:22:01.636520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:01.636520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:01.636520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:01.636520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:01.636520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:01.636520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:01.636520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:01.636520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:01.636520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:01.636520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:01.636520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:01.636520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:22:01.636520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:22:01.636520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:22:01.636520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:22:01.637676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:01.637676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:01.637676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:22:01.637676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:01.637676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:22:01.637676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:01.637676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:01.637676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:01.637676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:01.637676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:01.637676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:01.637676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:01.637676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:01.637676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:01.637676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:01.637676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:01.637676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:01.637676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:01.638903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:01.638903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:01.638903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:22:01.638903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:22:01.638903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:22:01.638903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:22:01.638903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:22:01.638903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:22:01.638903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:22:01.638903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:01.641700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 373/757] 10.222.0.40 () {56 vars in 1093 bytes} [Tue Jul 12 14:22:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:01.647466 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51939386-e94e-47ca-879e-343e36688896 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:01.797386 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad959f-b2cc-4451-952a-e4787436d953 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:01.822396 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:01.872069 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5333c-82d6-4c5a-8996-f12d2f009610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:01.872868 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5333c-82d6-4c5a-8996-f12d2f009610 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:01.873150 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5333c-82d6-4c5a-8996-f12d2f009610 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:01.873419 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5333c-82d6-4c5a-8996-f12d2f009610 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:01.884602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:01.886937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5333c-82d6-4c5a-8996-f12d2f009610 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:01.889381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5333c-82d6-4c5a-8996-f12d2f009610 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:01.893235 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51939386-e94e-47ca-879e-343e36688896 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:01.920110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-3bc5333c-82d6-4c5a-8996-f12d2f009610 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:01.920110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:01.920110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:01.920110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:01.920110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:01.920110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:01.920110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:01.920110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:01.920110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:01.920110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:01.920110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:01.920110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:01.920110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:22:01.920110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:22:01.920110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:22:01.921075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:22:01.921075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:01.921075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:01.921075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:01.921075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:01.921075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:01.921075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:01.921075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:01.921075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:01.921075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:01.921075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:01.921075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:01.921075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:01.921075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:01.921075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:01.921075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:01.921075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:01.921945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:22:01.921945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:22:01.921945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:22:01.921945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:22:01.921945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:22:01.921945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:22:01.921945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:01.921945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:01.925412 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 385/758] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:01.927577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ab1ba-1cf2-4f23-b96e-e23427cf1c5d None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:01.927923 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ab1ba-1cf2-4f23-b96e-e23427cf1c5d None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:01.928724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ab1ba-1cf2-4f23-b96e-e23427cf1c5d None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:01.930647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 386/759] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:01.931789 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ab1ba-1cf2-4f23-b96e-e23427cf1c5d None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:01.955253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fc869-910c-461d-8202-69f4b829693e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:01.956762 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fc869-910c-461d-8202-69f4b829693e None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:01.957219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fc869-910c-461d-8202-69f4b829693e None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:01.957684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fc869-910c-461d-8202-69f4b829693e None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:01.960460 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fc869-910c-461d-8202-69f4b829693e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:01.960965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fc869-910c-461d-8202-69f4b829693e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:01.963955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fc869-910c-461d-8202-69f4b829693e None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:01.994719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 374/760] 10.222.0.40 () {56 vars in 1133 bytes} [Tue Jul 12 14:22:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:01.996393 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c44581-5646-4e6f-913d-b3cb725f2ee2 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:01.996815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c44581-5646-4e6f-913d-b3cb725f2ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:01.997118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c44581-5646-4e6f-913d-b3cb725f2ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:02.017416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-63c44581-5646-4e6f-913d-b3cb725f2ee2 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:02.018736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-63c44581-5646-4e6f-913d-b3cb725f2ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:02.073833 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ab1ba-1cf2-4f23-b96e-e23427cf1c5d None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:02.111379 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 375/761] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:02.112295 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c44581-5646-4e6f-913d-b3cb725f2ee2 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:02.121990 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f773f-67d1-4dc7-9ab1-e0ac8e8e77f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:02.122671 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f773f-67d1-4dc7-9ab1-e0ac8e8e77f8 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:02.122957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f773f-67d1-4dc7-9ab1-e0ac8e8e77f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:02.123237 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f773f-67d1-4dc7-9ab1-e0ac8e8e77f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:02.124097 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f773f-67d1-4dc7-9ab1-e0ac8e8e77f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:02.124412 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f773f-67d1-4dc7-9ab1-e0ac8e8e77f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:02.125860 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f773f-67d1-4dc7-9ab1-e0ac8e8e77f8 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:02.144012 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 387/762] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:22:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:02.144995 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f773f-67d1-4dc7-9ab1-e0ac8e8e77f8 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:02.187725 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:02.206654 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:02.232009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c44581-5646-4e6f-913d-b3cb725f2ee2 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:02.258939 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f773f-67d1-4dc7-9ab1-e0ac8e8e77f8 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:02.269965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79613631-d39c-4ae0-9c40-ad8b358b46f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:02.270822 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79613631-d39c-4ae0-9c40-ad8b358b46f7 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:02.271073 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79613631-d39c-4ae0-9c40-ad8b358b46f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:02.271555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79613631-d39c-4ae0-9c40-ad8b358b46f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:02.282846 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79613631-d39c-4ae0-9c40-ad8b358b46f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:02.284374 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79613631-d39c-4ae0-9c40-ad8b358b46f7 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:02.297008 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edeec6-4fce-4746-823d-cf61fc702b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:02.298183 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edeec6-4fce-4746-823d-cf61fc702b85 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:02.298641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edeec6-4fce-4746-823d-cf61fc702b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:02.299149 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edeec6-4fce-4746-823d-cf61fc702b85 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:02.300027 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6edeec6-4fce-4746-823d-cf61fc702b85 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:02.301596 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6edeec6-4fce-4746-823d-cf61fc702b85 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:02.306426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-79613631-d39c-4ae0-9c40-ad8b358b46f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:02.306426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:02.306426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:02.306426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:02.306426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:02.306426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:02.306426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:02.306426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:02.306426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:02.306426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:02.306426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:02.306426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:02.306426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:02.306426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:02.306426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:02.307594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:02.307594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:02.307594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:02.307594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:02.307594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:02.307594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:02.307594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:02.307594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:02.307594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:02.307594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:02.307594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:02.307594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:02.307594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:02.307594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:02.307594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:02.307594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:02.307594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:02.308528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:02.308528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:02.308528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:02.308528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:02.312226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 376/763] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:02.313069 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79613631-d39c-4ae0-9c40-ad8b358b46f7 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:02.320377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-a6edeec6-4fce-4746-823d-cf61fc702b85 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 14:22:02.320377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:02.320377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:02.320377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:02.320377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:02.320377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:02.320377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:02.320377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:02.320377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 14:22:02.320377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:02.320377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:02.320377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:02.320377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:02.320377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:02.320377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:02.320377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:02.321305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:02.321305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:02.321305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:02.321305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:02.321305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:02.321305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:02.321305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:02.321305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:02.321305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:02.321305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:02.321305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:02.321305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:02.321305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:02.321305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:02.321305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:02.321305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:02.322124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:02.322124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:02.322124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:02.322124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:02.322124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:02.322124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:02.322124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:02.322124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:02.322124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:02.322124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:02.322124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:02.322124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:02.322124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:02.322124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 14:22:02.322124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:02.325099 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 388/764] 10.222.0.40 () {56 vars in 1129 bytes} [Tue Jul 12 14:22:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:02.326093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edeec6-4fce-4746-823d-cf61fc702b85 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:02.434727 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79613631-d39c-4ae0-9c40-ad8b358b46f7 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:02.439992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edeec6-4fce-4746-823d-cf61fc702b85 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:02.447710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:02.461740 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:02.473468 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42984c4f-1254-47e1-b518-1b8a35400744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:02.474499 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42984c4f-1254-47e1-b518-1b8a35400744 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:02.475057 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42984c4f-1254-47e1-b518-1b8a35400744 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:02.476317 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42984c4f-1254-47e1-b518-1b8a35400744 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:02.477976 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42984c4f-1254-47e1-b518-1b8a35400744 None admin] RBAC: Adding query filter params (role.id=c6f0b65d6ea5449ca79744ac52243ba2, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=5ec758ef106b49f4985845b3c106f94b) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:02.478316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbf038-56bb-4a19-b17f-aafd473eac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:02.478645 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42984c4f-1254-47e1-b518-1b8a35400744 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:02.479176 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbf038-56bb-4a19-b17f-aafd473eac1e None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:02.479580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbf038-56bb-4a19-b17f-aafd473eac1e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:02.479968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbf038-56bb-4a19-b17f-aafd473eac1e None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:02.480734 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42984c4f-1254-47e1-b518-1b8a35400744 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:02.480940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbf038-56bb-4a19-b17f-aafd473eac1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:02.481270 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbf038-56bb-4a19-b17f-aafd473eac1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:02.482720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbf038-56bb-4a19-b17f-aafd473eac1e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:02.487582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 377/765] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:22:02 2022] GET /identity/v3/role_assignments?user.id=5ec758ef106b49f4985845b3c106f94b&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=c6f0b65d6ea5449ca79744ac52243ba2 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:02.488661 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42984c4f-1254-47e1-b518-1b8a35400744 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:02.501211 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 389/766] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:02.503758 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbf038-56bb-4a19-b17f-aafd473eac1e None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:02.680947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42984c4f-1254-47e1-b518-1b8a35400744 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:02.717619 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbf038-56bb-4a19-b17f-aafd473eac1e None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:02.724938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b081af6-efea-4679-aef2-fec1a9f96177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:02.726743 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b081af6-efea-4679-aef2-fec1a9f96177 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:02.727250 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b081af6-efea-4679-aef2-fec1a9f96177 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:02.727777 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b081af6-efea-4679-aef2-fec1a9f96177 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:02.728713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b081af6-efea-4679-aef2-fec1a9f96177 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:02.729229 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b081af6-efea-4679-aef2-fec1a9f96177 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:02.730975 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b081af6-efea-4679-aef2-fec1a9f96177 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:02.743039 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 378/767] 10.222.0.40 () {56 vars in 1124 bytes} [Tue Jul 12 14:22:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:02.745169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b081af6-efea-4679-aef2-fec1a9f96177 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:02.786056 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:02.804791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34c457-3cb5-43de-a582-4b0213d69712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:02.805874 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34c457-3cb5-43de-a582-4b0213d69712 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:02.805874 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34c457-3cb5-43de-a582-4b0213d69712 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:02.806160 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34c457-3cb5-43de-a582-4b0213d69712 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:02.819643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34c457-3cb5-43de-a582-4b0213d69712 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:02.821259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34c457-3cb5-43de-a582-4b0213d69712 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:02.836442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-fa34c457-3cb5-43de-a582-4b0213d69712 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:02.836442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:02.836442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:02.836442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:02.836442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:02.836442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:02.836442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:02.836442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:02.836442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:02.836442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:02.836442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:02.836442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:02.836442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:22:02.836442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:22:02.836442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:22:02.837372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:22:02.837372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:02.837372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:02.837372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:02.837372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:02.837372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:02.837372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:02.837372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:02.837372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:02.837372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:02.837372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:02.837372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:02.837372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:02.837372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:02.837372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:02.837372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:02.837372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:02.843224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:22:02.843224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:22:02.843224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:22:02.843224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:22:02.843224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:22:02.843224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:22:02.843224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:02.843224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:02.843224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 390/768] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:02.857000 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34c457-3cb5-43de-a582-4b0213d69712 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:02.874245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b081af6-efea-4679-aef2-fec1a9f96177 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:02.914434 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d308cd7-9200-4cb8-be37-bdb47ad61833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:02.915543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d308cd7-9200-4cb8-be37-bdb47ad61833 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:02.916040 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d308cd7-9200-4cb8-be37-bdb47ad61833 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:02.916548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d308cd7-9200-4cb8-be37-bdb47ad61833 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:02.917468 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d308cd7-9200-4cb8-be37-bdb47ad61833 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:02.917979 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d308cd7-9200-4cb8-be37-bdb47ad61833 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:02.919578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d308cd7-9200-4cb8-be37-bdb47ad61833 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:02.930372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 379/769] 10.222.0.40 () {56 vars in 1124 bytes} [Tue Jul 12 14:22:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:02.933354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d308cd7-9200-4cb8-be37-bdb47ad61833 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:02.938551 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:03.053232 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:03.059120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d308cd7-9200-4cb8-be37-bdb47ad61833 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:03.109621 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34c457-3cb5-43de-a582-4b0213d69712 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:03.118731 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387807b-ffc6-4b41-ab3a-6f2d4b7ef27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:03.124350 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387807b-ffc6-4b41-ab3a-6f2d4b7ef27f None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:03.124895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387807b-ffc6-4b41-ab3a-6f2d4b7ef27f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:03.125381 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387807b-ffc6-4b41-ab3a-6f2d4b7ef27f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:03.126425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387807b-ffc6-4b41-ab3a-6f2d4b7ef27f None admin] RBAC: Adding query filter params (interface=public, service_id=e3c454a23758407a932ee750c0f37c46, region_id=RegionOne) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:03.126950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387807b-ffc6-4b41-ab3a-6f2d4b7ef27f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:03.128600 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387807b-ffc6-4b41-ab3a-6f2d4b7ef27f None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:03.149880 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 380/770] 10.222.0.40 () {56 vars in 1251 bytes} [Tue Jul 12 14:22:02 2022] GET /identity/v3/endpoints?service_id=e3c454a23758407a932ee750c0f37c46&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:03.153737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387807b-ffc6-4b41-ab3a-6f2d4b7ef27f None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:03.189649 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a537e3b-dd93-4f9a-ae5c-618a8720f4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:03.190773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a537e3b-dd93-4f9a-ae5c-618a8720f4ce None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:03.192191 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a537e3b-dd93-4f9a-ae5c-618a8720f4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:03.192698 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a537e3b-dd93-4f9a-ae5c-618a8720f4ce None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:03.198037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a537e3b-dd93-4f9a-ae5c-618a8720f4ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:03.198676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a537e3b-dd93-4f9a-ae5c-618a8720f4ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:03.201716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a537e3b-dd93-4f9a-ae5c-618a8720f4ce None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:03.231872 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 391/771] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:22:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:03.239427 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a537e3b-dd93-4f9a-ae5c-618a8720f4ce None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:03.361079 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387807b-ffc6-4b41-ab3a-6f2d4b7ef27f None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:03.428116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:03.432081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a537e3b-dd93-4f9a-ae5c-618a8720f4ce None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:03.434175 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe0a9b-d977-43f9-a339-0764eb9ef3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:03.441323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe0a9b-d977-43f9-a339-0764eb9ef3cf None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:03.441323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe0a9b-d977-43f9-a339-0764eb9ef3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:03.441323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe0a9b-d977-43f9-a339-0764eb9ef3cf None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:03.441323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe0a9b-d977-43f9-a339-0764eb9ef3cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:03.441323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe0a9b-d977-43f9-a339-0764eb9ef3cf None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:03.451331 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 381/772] 10.222.0.40 () {56 vars in 1087 bytes} [Tue Jul 12 14:22:03 2022] GET /identity/v3/services => generated 772 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:03.493767 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70b150-633c-46d3-8239-42270d6510c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:03.494734 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70b150-633c-46d3-8239-42270d6510c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:03.495022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70b150-633c-46d3-8239-42270d6510c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:03.495315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70b150-633c-46d3-8239-42270d6510c1 None admin] PATH_INFO: `/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/122fc227de9d4f87a66e4a0d86ff0b16/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:03.500146 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70b150-633c-46d3-8239-42270d6510c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=00424b6950d14cd4854e4add3e3d7705, user_id=122fc227de9d4f87a66e4a0d86ff0b16, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:03.501623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70b150-633c-46d3-8239-42270d6510c1 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:03.606315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 392/773] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:22:03 2022] PUT /identity/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/122fc227de9d4f87a66e4a0d86ff0b16/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:22:03.732691 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b72d0-60b2-4642-bc1b-03d9f1d6fae9 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:03.733018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b72d0-60b2-4642-bc1b-03d9f1d6fae9 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:03.733186 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b72d0-60b2-4642-bc1b-03d9f1d6fae9 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:03.734721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 382/774] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:03.740820 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20ffea-99f8-4f70-8f42-8524acb652bc None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:03.742261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20ffea-99f8-4f70-8f42-8524acb652bc None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:03.742773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20ffea-99f8-4f70-8f42-8524acb652bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:03.765709 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-8a20ffea-99f8-4f70-8f42-8524acb652bc None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:03.767400 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-8a20ffea-99f8-4f70-8f42-8524acb652bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:03.820852 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35ba2c-da9e-4d1a-b370-cf3716229e66 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:03.821208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35ba2c-da9e-4d1a-b370-cf3716229e66 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:03.821413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35ba2c-da9e-4d1a-b370-cf3716229e66 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:03.823129 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 383/775] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:03.828795 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9515e-afea-4de9-a19c-c1129b215b13 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:03.829124 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9515e-afea-4de9-a19c-c1129b215b13 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:03.829356 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9515e-afea-4de9-a19c-c1129b215b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:03.847486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-2cd9515e-afea-4de9-a19c-c1129b215b13 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:03.848694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2cd9515e-afea-4de9-a19c-c1129b215b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:03.852774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 393/776] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:03.874283 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:03.881455 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20ffea-99f8-4f70-8f42-8524acb652bc None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:03.979547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 384/777] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:22:04.014671 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9515e-afea-4de9-a19c-c1129b215b13 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:04.035642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:04.045483 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20ffea-99f8-4f70-8f42-8524acb652bc None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:04.119557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02772b-dd80-48c2-8782-ea39339b02c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:04.120363 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02772b-dd80-48c2-8782-ea39339b02c1 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:04.120646 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02772b-dd80-48c2-8782-ea39339b02c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:04.121177 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02772b-dd80-48c2-8782-ea39339b02c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:04.135190 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02772b-dd80-48c2-8782-ea39339b02c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:04.143221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-7d02772b-dd80-48c2-8782-ea39339b02c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:04.143221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:04.143221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:04.143221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:04.143221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:04.143221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:04.143221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:04.143221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:04.143221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:04.143221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:04.143221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:04.143221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:04.143221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:04.143221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:04.143221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:04.143221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:04.144170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:04.144170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:04.144170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:04.144170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:04.144170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:04.144170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:04.144170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:04.144170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:04.144170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:04.144170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:04.144170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:04.144170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:04.144170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:04.144170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:04.144170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:04.144170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:04.145277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:04.145277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:04.145277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:04.145277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:04.145277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:04.145277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:04.145277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:04.145277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:04.145277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:04.145277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:04.145277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:04.145277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:04.145277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 394/778] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:22:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:04.151083 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02772b-dd80-48c2-8782-ea39339b02c1 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:04.203511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9515e-afea-4de9-a19c-c1129b215b13 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:04.274286 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20225a53-2568-4a60-94ad-9694b48d7c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:04.275055 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20225a53-2568-4a60-94ad-9694b48d7c3a None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:04.275363 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20225a53-2568-4a60-94ad-9694b48d7c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:04.275646 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20225a53-2568-4a60-94ad-9694b48d7c3a None admin] PATH_INFO: `/v3/services/network` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:04.276306 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20225a53-2568-4a60-94ad-9694b48d7c3a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:04.277698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20225a53-2568-4a60-94ad-9694b48d7c3a None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:04.312809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-20225a53-2568-4a60-94ad-9694b48d7c3a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 14:22:04.312809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:04.312809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:04.312809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:04.312809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:04.312809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:04.312809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:04.312809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:04.312809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 14:22:04.312809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:04.312809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:04.312809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:04.312809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:04.312809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:04.312809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:04.312809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:04.312809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:04.313940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:04.313940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:04.313940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:04.313940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:04.313940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:04.313940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:04.313940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:04.313940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:04.313940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:04.313940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:04.313940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:04.313940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:04.313940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:04.313940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:04.313940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:04.313940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:04.315228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:04.315228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:04.315228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:04.315228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:04.315228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:04.315228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:04.315228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:04.315228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:04.315228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:04.315228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:04.315228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:04.315228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:04.315228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 14:22:04.315228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:04.315228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 385/779] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:04 2022] GET /identity/v3/services/network => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:04.316053 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02772b-dd80-48c2-8782-ea39339b02c1 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:04.323706 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20225a53-2568-4a60-94ad-9694b48d7c3a None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:04.368902 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588b987-4243-472e-998d-3bf29b120c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:04.369592 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588b987-4243-472e-998d-3bf29b120c4d None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:04.369878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588b987-4243-472e-998d-3bf29b120c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:04.370153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588b987-4243-472e-998d-3bf29b120c4d None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:04.371179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588b987-4243-472e-998d-3bf29b120c4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:04.371511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588b987-4243-472e-998d-3bf29b120c4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:04.375265 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588b987-4243-472e-998d-3bf29b120c4d None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:04.380193 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:04.394000 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 395/780] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:22:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:04.406139 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588b987-4243-472e-998d-3bf29b120c4d None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:04.434159 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:04.522655 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20225a53-2568-4a60-94ad-9694b48d7c3a None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:04.567073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588b987-4243-472e-998d-3bf29b120c4d None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:04.605557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594dc09-d18d-474e-b58e-9bdcc9020342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:04.606367 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594dc09-d18d-474e-b58e-9bdcc9020342 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:04.606653 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594dc09-d18d-474e-b58e-9bdcc9020342 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:04.606930 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594dc09-d18d-474e-b58e-9bdcc9020342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:04.609932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafa4e3-5ad7-47d8-b48e-e22bbebb0fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:04.610892 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafa4e3-5ad7-47d8-b48e-e22bbebb0fcf None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:04.611416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafa4e3-5ad7-47d8-b48e-e22bbebb0fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:04.611994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafa4e3-5ad7-47d8-b48e-e22bbebb0fcf None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:04.612925 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafa4e3-5ad7-47d8-b48e-e22bbebb0fcf None admin] RBAC: Adding query filter params (name=network) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:04.613436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafa4e3-5ad7-47d8-b48e-e22bbebb0fcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:04.615012 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafa4e3-5ad7-47d8-b48e-e22bbebb0fcf None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:04.619551 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594dc09-d18d-474e-b58e-9bdcc9020342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:04.621474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594dc09-d18d-474e-b58e-9bdcc9020342 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:04.626659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 386/781] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Jul 12 14:22:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:04.628203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafa4e3-5ad7-47d8-b48e-e22bbebb0fcf None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:04.642844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-c594dc09-d18d-474e-b58e-9bdcc9020342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:04.642844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:04.642844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:04.642844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:04.642844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:04.642844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:04.642844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:04.642844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:04.642844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:04.642844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:04.642844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:04.642844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:04.642844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:04.642844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:04.642844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:04.643812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:04.643812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:04.643812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:04.643812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:04.643812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:04.643812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:04.643812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:04.643812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:04.643812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:04.643812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:04.643812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:04.643812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:04.643812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:04.643812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:04.643812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:04.643812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:04.643812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:04.645299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:04.645299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:04.645299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:04.645299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:04.645299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 396/782] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:04.652423 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594dc09-d18d-474e-b58e-9bdcc9020342 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:04.763743 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:04.768348 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:04.795322 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafa4e3-5ad7-47d8-b48e-e22bbebb0fcf None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:04.802433 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594dc09-d18d-474e-b58e-9bdcc9020342 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:04.843539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01db96e-ec90-404c-8c90-b18692edc3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:04.844303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01db96e-ec90-404c-8c90-b18692edc3fc None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:04.845114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01db96e-ec90-404c-8c90-b18692edc3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:04.845519 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01db96e-ec90-404c-8c90-b18692edc3fc None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:04.846507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01db96e-ec90-404c-8c90-b18692edc3fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:04.847050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01db96e-ec90-404c-8c90-b18692edc3fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:04.848813 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01db96e-ec90-404c-8c90-b18692edc3fc None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:04.861824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad7f46-3f22-49bb-8ecc-885889401992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:04.862573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 397/783] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:04.863367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad7f46-3f22-49bb-8ecc-885889401992 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:04.863912 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad7f46-3f22-49bb-8ecc-885889401992 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:04.864323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad7f46-3f22-49bb-8ecc-885889401992 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:04.865178 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad7f46-3f22-49bb-8ecc-885889401992 None admin] RBAC: Adding query filter params (type=network) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:04.865633 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad7f46-3f22-49bb-8ecc-885889401992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:04.871935 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad7f46-3f22-49bb-8ecc-885889401992 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:04.873040 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01db96e-ec90-404c-8c90-b18692edc3fc None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:04.888981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 387/784] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Jul 12 14:22:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:04.894719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad7f46-3f22-49bb-8ecc-885889401992 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:05.021830 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad7f46-3f22-49bb-8ecc-885889401992 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:05.064981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01db96e-ec90-404c-8c90-b18692edc3fc None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:05.067650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5f535-be3d-4e05-b924-a8d6c604a0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:05.068338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5f535-be3d-4e05-b924-a8d6c604a0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:05.068622 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5f535-be3d-4e05-b924-a8d6c604a0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:05.071537 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5f535-be3d-4e05-b924-a8d6c604a0a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:05.072590 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5f535-be3d-4e05-b924-a8d6c604a0a5 None admin] RBAC: Adding query filter params (interface=public, service_id=cd700cf9814248239f5bcf5aceb84ccf, region_id=RegionOne) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:05.073113 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5f535-be3d-4e05-b924-a8d6c604a0a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:05.075071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5f535-be3d-4e05-b924-a8d6c604a0a5 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:05.082596 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 388/785] 10.222.0.40 () {56 vars in 1251 bytes} [Tue Jul 12 14:22:04 2022] GET /identity/v3/endpoints?service_id=cd700cf9814248239f5bcf5aceb84ccf&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:05.084426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f7c36-f414-48ff-ac85-3dd6ebeb822b None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:05.084948 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f7c36-f414-48ff-ac85-3dd6ebeb822b None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:05.085490 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f7c36-f414-48ff-ac85-3dd6ebeb822b None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:05.087729 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 389/786] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:05.088636 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f7c36-f414-48ff-ac85-3dd6ebeb822b None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:05.092365 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:05.112448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a81a03-afd9-42e6-9f32-9371621a0b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:05.112448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a81a03-afd9-42e6-9f32-9371621a0b7d None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:05.112448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a81a03-afd9-42e6-9f32-9371621a0b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:05.112448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a81a03-afd9-42e6-9f32-9371621a0b7d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:05.117021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:05.117147 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a81a03-afd9-42e6-9f32-9371621a0b7d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:05.119640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a81a03-afd9-42e6-9f32-9371621a0b7d None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:05.139297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-66a81a03-afd9-42e6-9f32-9371621a0b7d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:22:05.139297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:05.139297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:05.139297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:05.139297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:05.139297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:05.139297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:05.139297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:05.139297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:05.139297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:05.139297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:05.139297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:05.139297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:22:05.139297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:22:05.139297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:22:05.139297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:22:05.140511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:05.140511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:05.140511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:22:05.140511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:05.140511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:22:05.140511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:05.140511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:05.140511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:05.140511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:05.140511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:05.140511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:05.140511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:05.140511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:05.140511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:05.140511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:05.140511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:05.140511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:05.140511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:05.141647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:05.141647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:05.141647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:22:05.141647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:22:05.141647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:22:05.141647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:22:05.141647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:22:05.141647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:22:05.141647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:22:05.141647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:05.150377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 398/787] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:22:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:05.151927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f912bb-1787-481e-a465-a822dbdf1d53 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:05.152707 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f912bb-1787-481e-a465-a822dbdf1d53 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:05.153096 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f912bb-1787-481e-a465-a822dbdf1d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:05.179925 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-c9f912bb-1787-481e-a465-a822dbdf1d53 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:05.182174 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-c9f912bb-1787-481e-a465-a822dbdf1d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:05.232443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f7c36-f414-48ff-ac85-3dd6ebeb822b None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:05.279541 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 399/788] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:05.280734 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f912bb-1787-481e-a465-a822dbdf1d53 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:05.285602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468ad5b-9bad-4a86-9aee-7ecac2e5400e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:05.286940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468ad5b-9bad-4a86-9aee-7ecac2e5400e None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:05.287228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468ad5b-9bad-4a86-9aee-7ecac2e5400e None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:05.289140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468ad5b-9bad-4a86-9aee-7ecac2e5400e None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:05.289257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468ad5b-9bad-4a86-9aee-7ecac2e5400e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:05.292657 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468ad5b-9bad-4a86-9aee-7ecac2e5400e None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:05.303240 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 390/789] 10.222.0.40 () {56 vars in 1087 bytes} [Tue Jul 12 14:22:05 2022] GET /identity/v3/services => generated 772 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:05.304033 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468ad5b-9bad-4a86-9aee-7ecac2e5400e None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:05.431666 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:05.445268 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f912bb-1787-481e-a465-a822dbdf1d53 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:05.462394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:05.479552 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468ad5b-9bad-4a86-9aee-7ecac2e5400e None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:05.487473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b5c96-833a-4ee1-8161-ba0cdee1d7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:05.488484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b5c96-833a-4ee1-8161-ba0cdee1d7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:05.488931 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b5c96-833a-4ee1-8161-ba0cdee1d7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:05.489425 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b5c96-833a-4ee1-8161-ba0cdee1d7c9 None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:05.490572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b5c96-833a-4ee1-8161-ba0cdee1d7c9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:05.491615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b5c96-833a-4ee1-8161-ba0cdee1d7c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:05.493267 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b5c96-833a-4ee1-8161-ba0cdee1d7c9 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:05.516540 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 400/790] 10.222.0.40 () {56 vars in 1135 bytes} [Tue Jul 12 14:22:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:05.523229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b5c96-833a-4ee1-8161-ba0cdee1d7c9 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:05.543937 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc3ac1-c216-4aa8-9721-44a90f00e4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:05.545285 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc3ac1-c216-4aa8-9721-44a90f00e4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:05.546300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc3ac1-c216-4aa8-9721-44a90f00e4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:05.546765 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc3ac1-c216-4aa8-9721-44a90f00e4c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:05.563929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc3ac1-c216-4aa8-9721-44a90f00e4c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:05.572680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-5ccc3ac1-c216-4aa8-9721-44a90f00e4c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:22:05.572680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:05.572680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:05.572680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:05.572680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:05.572680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:05.572680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:05.572680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:05.572680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:05.572680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:05.572680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:05.572680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:05.572680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:05.572680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:05.572680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:05.572680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:05.573700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:05.573700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:05.573700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:05.573700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:05.573700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:05.573700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:05.573700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:05.573700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:05.573700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:05.573700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:05.573700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:05.573700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:05.573700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:05.573700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:05.573700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:05.573700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:05.574535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:05.574535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:05.574535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:05.574535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:05.574535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:05.574535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:05.574535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:05.574535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:05.574535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:05.574535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:05.574535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:22:05.574535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:05.574535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 391/791] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:22:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:05.581036 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc3ac1-c216-4aa8-9721-44a90f00e4c6 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:05.690628 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b5c96-833a-4ee1-8161-ba0cdee1d7c9 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:05.739461 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc3ac1-c216-4aa8-9721-44a90f00e4c6 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:05.764721 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062baa48-b66a-435b-a92c-cf698ce0cb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:05.765560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062baa48-b66a-435b-a92c-cf698ce0cb9f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:05.765846 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062baa48-b66a-435b-a92c-cf698ce0cb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:05.766125 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062baa48-b66a-435b-a92c-cf698ce0cb9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:05.786637 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062baa48-b66a-435b-a92c-cf698ce0cb9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:05.790129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062baa48-b66a-435b-a92c-cf698ce0cb9f None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:05.808074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9f1d7-3e32-4229-bec0-100f177bc79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:05.808772 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9f1d7-3e32-4229-bec0-100f177bc79a None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:05.809054 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9f1d7-3e32-4229-bec0-100f177bc79a None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:05.809329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9f1d7-3e32-4229-bec0-100f177bc79a None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:05.810088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9f1d7-3e32-4229-bec0-100f177bc79a None admin] RBAC: Adding query filter params (name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:05.810393 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9f1d7-3e32-4229-bec0-100f177bc79a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:05.811829 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9f1d7-3e32-4229-bec0-100f177bc79a None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:05.820521 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:05.825316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-062baa48-b66a-435b-a92c-cf698ce0cb9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:05.825316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:05.825316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:05.825316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:05.825316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:05.825316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:05.825316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:05.825316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:05.825316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:05.825316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:05.825316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:05.825316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:05.825316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:05.825316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:05.825316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:05.826178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:05.826178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:05.826178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:05.826178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:05.826178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:05.826178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:05.826178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:05.826178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:05.826178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:05.826178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:05.826178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:05.826178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:05.826178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:05.826178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:05.826178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:05.826178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:05.826178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:05.827054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:05.827054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:05.827054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:05.827054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:05.827054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 401/792] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:05.827345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 392/793] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:22:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:05.833412 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062baa48-b66a-435b-a92c-cf698ce0cb9f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:05.833843 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9f1d7-3e32-4229-bec0-100f177bc79a None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:05.881274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:05.981653 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062baa48-b66a-435b-a92c-cf698ce0cb9f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:06.002392 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9f1d7-3e32-4229-bec0-100f177bc79a None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:06.019819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb71cb-34e5-4a86-8713-8750bf8c05f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:06.020622 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb71cb-34e5-4a86-8713-8750bf8c05f3 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:06.020907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb71cb-34e5-4a86-8713-8750bf8c05f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:06.021188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb71cb-34e5-4a86-8713-8750bf8c05f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:06.032716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb71cb-34e5-4a86-8713-8750bf8c05f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:06.034179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb71cb-34e5-4a86-8713-8750bf8c05f3 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:06.047810 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a1d3d-cdce-4a70-8a23-b1bfc4695df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:06.048488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a1d3d-cdce-4a70-8a23-b1bfc4695df1 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:06.048778 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a1d3d-cdce-4a70-8a23-b1bfc4695df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:06.049059 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a1d3d-cdce-4a70-8a23-b1bfc4695df1 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:06.049796 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a1d3d-cdce-4a70-8a23-b1bfc4695df1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:06.050108 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a1d3d-cdce-4a70-8a23-b1bfc4695df1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:06.051501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a1d3d-cdce-4a70-8a23-b1bfc4695df1 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:06.053274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-0bcb71cb-34e5-4a86-8713-8750bf8c05f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:06.053274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:06.053274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:06.053274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:06.053274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:06.053274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:06.053274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:06.053274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:06.053274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:06.053274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:06.053274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:06.053274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:06.053274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:06.053274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:06.053274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:06.054962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:06.054962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:06.054962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:06.054962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:06.054962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:06.054962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:06.054962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:06.054962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:06.054962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:06.054962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:06.054962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:06.054962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:06.054962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:06.054962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:06.054962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:06.054962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:06.054962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:06.055867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:06.055867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:06.055867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:06.055867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:06.059429 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 402/794] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:06.060984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030113f-2b63-4195-b5d6-2d541b9686d5 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:06.061331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030113f-2b63-4195-b5d6-2d541b9686d5 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:06.061617 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030113f-2b63-4195-b5d6-2d541b9686d5 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:06.063058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 403/795] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:06.064020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c41c2-b104-4bb7-a1a6-c4f9e1e578c2 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:06.064301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c41c2-b104-4bb7-a1a6-c4f9e1e578c2 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:06.064579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c41c2-b104-4bb7-a1a6-c4f9e1e578c2 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:06.065940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 404/796] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:06.070484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c41c2-b104-4bb7-a1a6-c4f9e1e578c2 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:06.074592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 393/797] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:06.076015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4297a-0d5a-425b-8ecd-ac9f8c217dc0 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:06.076318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4297a-0d5a-425b-8ecd-ac9f8c217dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:06.076606 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4297a-0d5a-425b-8ecd-ac9f8c217dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:06.094133 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-33e4297a-0d5a-425b-8ecd-ac9f8c217dc0 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:06.095362 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-33e4297a-0d5a-425b-8ecd-ac9f8c217dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:06.154053 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:06.156842 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:06.169327 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 394/798] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:06.170402 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51fa64-6d04-4052-b221-31e07031277f None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:06.170688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51fa64-6d04-4052-b221-31e07031277f None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:06.170963 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51fa64-6d04-4052-b221-31e07031277f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:06.195132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-4d51fa64-6d04-4052-b221-31e07031277f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:06.196367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-4d51fa64-6d04-4052-b221-31e07031277f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:06.197129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c41c2-b104-4bb7-a1a6-c4f9e1e578c2 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:06.242391 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930557ad-fe9f-4c44-9260-623e24d0f688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:06.242664 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930557ad-fe9f-4c44-9260-623e24d0f688 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:06.242942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930557ad-fe9f-4c44-9260-623e24d0f688 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:06.243325 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930557ad-fe9f-4c44-9260-623e24d0f688 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:06.244059 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930557ad-fe9f-4c44-9260-623e24d0f688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:06.244382 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930557ad-fe9f-4c44-9260-623e24d0f688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:06.246127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930557ad-fe9f-4c44-9260-623e24d0f688 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:06.264909 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 405/799] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:06.264909 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930557ad-fe9f-4c44-9260-623e24d0f688 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:06.287128 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 395/800] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:06.288109 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51fa64-6d04-4052-b221-31e07031277f None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:06.378305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930557ad-fe9f-4c44-9260-623e24d0f688 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:06.397434 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51fa64-6d04-4052-b221-31e07031277f None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:06.414895 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ae1b1-5e2a-4dcb-bc9d-073cb92bd5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:06.415847 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ae1b1-5e2a-4dcb-bc9d-073cb92bd5de None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:06.416135 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ae1b1-5e2a-4dcb-bc9d-073cb92bd5de None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:06.416413 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ae1b1-5e2a-4dcb-bc9d-073cb92bd5de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:06.418501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:06.419133 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:06.424190 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ae1b1-5e2a-4dcb-bc9d-073cb92bd5de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:06.425871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ae1b1-5e2a-4dcb-bc9d-073cb92bd5de None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:06.436275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecf01e-e8d6-424e-986f-3e24bd015f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:06.437087 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecf01e-e8d6-424e-986f-3e24bd015f6c None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:06.437368 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecf01e-e8d6-424e-986f-3e24bd015f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:06.437642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecf01e-e8d6-424e-986f-3e24bd015f6c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:06.438294 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecf01e-e8d6-424e-986f-3e24bd015f6c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:06.439679 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecf01e-e8d6-424e-986f-3e24bd015f6c None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:06.440731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-675ae1b1-5e2a-4dcb-bc9d-073cb92bd5de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:06.440731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:06.440731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:06.440731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:06.440731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:06.440731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:06.440731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:06.440731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:06.440731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:06.440731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:06.440731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:06.440731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:06.440731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:22:06.440731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:22:06.440731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:22:06.441676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:22:06.441676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:06.441676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:06.441676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:06.441676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:06.441676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:06.441676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:06.441676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:06.441676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:06.441676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:06.441676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:06.441676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:06.441676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:06.441676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:06.441676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:06.441676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:06.441676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:06.442577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:22:06.442577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:22:06.442577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:22:06.442577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:22:06.442577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:22:06.442577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:22:06.442577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:06.442577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:06.442577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 406/801] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:06.443852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ae1b1-5e2a-4dcb-bc9d-073cb92bd5de None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:06.460480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-68ecf01e-e8d6-424e-986f-3e24bd015f6c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 14:22:06.460480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:06.460480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:06.460480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:06.460480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:06.460480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:06.460480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:06.460480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:06.460480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 14:22:06.460480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:06.460480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:06.460480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:06.460480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:06.460480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:06.460480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:06.460480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:06.467920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:06.467920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:06.467920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:06.467920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:06.467920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:06.467920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:06.467920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:06.467920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:06.467920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:06.467920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:06.467920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:06.467920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:06.467920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:06.467920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:06.467920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:06.467920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:06.468775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:06.468775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:06.468775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:06.468775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:06.468775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:06.468775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:06.468775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:06.468775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:06.468775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:06.468775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:06.468775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:06.468775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:06.468775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:06.468775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 14:22:06.468775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:06.468775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 396/802] 10.222.0.40 () {56 vars in 1129 bytes} [Tue Jul 12 14:22:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:06.469639 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecf01e-e8d6-424e-986f-3e24bd015f6c None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:06.549882 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ae1b1-5e2a-4dcb-bc9d-073cb92bd5de None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:06.574195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecf01e-e8d6-424e-986f-3e24bd015f6c None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:06.586520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3801a-73f5-42f2-bef6-d771379c2058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:06.587383 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3801a-73f5-42f2-bef6-d771379c2058 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:06.587673 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3801a-73f5-42f2-bef6-d771379c2058 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:06.587942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3801a-73f5-42f2-bef6-d771379c2058 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:06.595364 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3801a-73f5-42f2-bef6-d771379c2058 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:06.596808 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3801a-73f5-42f2-bef6-d771379c2058 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:06.613043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-7db3801a-73f5-42f2-bef6-d771379c2058 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:22:06.613043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:06.613043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:06.613043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:06.613043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:06.613043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:06.613043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:06.613043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:06.613043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:06.613043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:06.613043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:06.613043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:06.613043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:22:06.613043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:22:06.613043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:22:06.613043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:22:06.614005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:06.614005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:06.614005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:22:06.614005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:06.614005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:22:06.614005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:06.614005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:06.614005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:06.614005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:06.614005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:06.614005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:06.614005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:06.614005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:06.614005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:06.614005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:06.614005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:06.614005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:06.614005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:06.614928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:06.614928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:06.614928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:22:06.614928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:22:06.614928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:22:06.614928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:22:06.614928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:22:06.614928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:22:06.614928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:22:06.614928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:06.614928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 407/803] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Jul 12 14:22:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:06.616695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3801a-73f5-42f2-bef6-d771379c2058 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:06.617137 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32cfa7-b0de-46f4-a1df-824b3ebab15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:06.618092 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32cfa7-b0de-46f4-a1df-824b3ebab15e None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:06.618380 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32cfa7-b0de-46f4-a1df-824b3ebab15e None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:06.618729 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32cfa7-b0de-46f4-a1df-824b3ebab15e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:06.630065 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32cfa7-b0de-46f4-a1df-824b3ebab15e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:06.638195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-db32cfa7-b0de-46f4-a1df-824b3ebab15e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:06.638195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:06.638195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:06.638195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:06.638195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:06.638195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:06.638195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:06.638195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:06.638195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:06.638195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:06.638195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:06.638195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:06.638195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:06.638195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:06.638195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:06.638195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:06.639144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:06.639144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:06.639144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:06.639144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:06.639144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:06.639144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:06.639144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:06.639144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:06.639144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:06.639144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:06.639144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:06.639144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:06.639144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:06.639144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:06.639144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:06.639144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:06.640034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:06.640034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:06.640034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:06.640034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:06.640034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:06.640034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:06.640034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:06.640034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:06.640034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:06.640034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:06.640034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:06.640034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:06.640034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 397/804] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:22:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:06.640748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32cfa7-b0de-46f4-a1df-824b3ebab15e None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:06.688621 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:06.693896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:06.734578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3801a-73f5-42f2-bef6-d771379c2058 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:06.754618 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32cfa7-b0de-46f4-a1df-824b3ebab15e None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:06.769963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b60de4-5159-4650-81fe-2ee49218b7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:06.770623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b60de4-5159-4650-81fe-2ee49218b7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:06.770907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b60de4-5159-4650-81fe-2ee49218b7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:06.771181 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b60de4-5159-4650-81fe-2ee49218b7b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:06.772010 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b60de4-5159-4650-81fe-2ee49218b7b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:06.772863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b60de4-5159-4650-81fe-2ee49218b7b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:06.774295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b60de4-5159-4650-81fe-2ee49218b7b5 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:06.786287 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 408/805] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:22:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:06.787161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b60de4-5159-4650-81fe-2ee49218b7b5 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:06.795923 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64e50d-d41c-4f59-94fc-e5551e6017ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:06.796909 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64e50d-d41c-4f59-94fc-e5551e6017ef None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:06.797199 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64e50d-d41c-4f59-94fc-e5551e6017ef None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:06.797516 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64e50d-d41c-4f59-94fc-e5551e6017ef None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:06.798235 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64e50d-d41c-4f59-94fc-e5551e6017ef None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:06.798546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64e50d-d41c-4f59-94fc-e5551e6017ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:06.800098 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64e50d-d41c-4f59-94fc-e5551e6017ef None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:06.809359 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 398/806] 10.222.0.40 () {56 vars in 1124 bytes} [Tue Jul 12 14:22:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:06.809359 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64e50d-d41c-4f59-94fc-e5551e6017ef None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:06.896359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b60de4-5159-4650-81fe-2ee49218b7b5 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:06.912217 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:06.913035 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64e50d-d41c-4f59-94fc-e5551e6017ef None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:06.921866 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:06.930257 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d9a59-e8eb-4fe4-b779-e935569f3e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:06.930930 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d9a59-e8eb-4fe4-b779-e935569f3e8b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:06.931221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d9a59-e8eb-4fe4-b779-e935569f3e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:06.931551 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d9a59-e8eb-4fe4-b779-e935569f3e8b None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:06.932382 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d9a59-e8eb-4fe4-b779-e935569f3e8b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:06.932694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d9a59-e8eb-4fe4-b779-e935569f3e8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:06.934127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d9a59-e8eb-4fe4-b779-e935569f3e8b None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:06.949985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c1c59-3120-496d-85bf-52869768f3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:06.950905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c1c59-3120-496d-85bf-52869768f3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:06.951368 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c1c59-3120-496d-85bf-52869768f3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:06.951793 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c1c59-3120-496d-85bf-52869768f3e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:06.951931 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 409/807] 10.222.0.40 () {56 vars in 1149 bytes} [Tue Jul 12 14:22:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:06.952594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d9a59-e8eb-4fe4-b779-e935569f3e8b None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:06.952940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c1c59-3120-496d-85bf-52869768f3e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:06.953449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c1c59-3120-496d-85bf-52869768f3e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:06.954936 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c1c59-3120-496d-85bf-52869768f3e0 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:06.964766 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 399/808] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:22:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:06.965789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c1c59-3120-496d-85bf-52869768f3e0 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:07.068556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c1c59-3120-496d-85bf-52869768f3e0 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:07.071718 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d9a59-e8eb-4fe4-b779-e935569f3e8b None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:07.103558 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a05c9-e1d4-4617-bb2b-d20a5920026f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:07.104225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a05c9-e1d4-4617-bb2b-d20a5920026f None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:07.104510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a05c9-e1d4-4617-bb2b-d20a5920026f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:07.104790 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a05c9-e1d4-4617-bb2b-d20a5920026f None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:07.105497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a05c9-e1d4-4617-bb2b-d20a5920026f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:07.105805 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a05c9-e1d4-4617-bb2b-d20a5920026f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:07.107163 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a05c9-e1d4-4617-bb2b-d20a5920026f None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:07.108870 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5b254-88f8-42cd-ae72-e547aae57a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:07.109965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5b254-88f8-42cd-ae72-e547aae57a2c None admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:07.110390 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5b254-88f8-42cd-ae72-e547aae57a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:07.110807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5b254-88f8-42cd-ae72-e547aae57a2c None admin] PATH_INFO: `/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/ad12085f356a4f0682bb70ad231a10b6/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:07.111983 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 400/809] 10.222.0.40 () {56 vars in 1124 bytes} [Tue Jul 12 14:22:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:07.112755 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a05c9-e1d4-4617-bb2b-d20a5920026f None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:07.117302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5b254-88f8-42cd-ae72-e547aae57a2c None admin] RBAC: Authorizing `identity:create_grant(project_id=00424b6950d14cd4854e4add3e3d7705, user_id=ad12085f356a4f0682bb70ad231a10b6, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:07.118724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5b254-88f8-42cd-ae72-e547aae57a2c None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:07.153911 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:07.219086 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a05c9-e1d4-4617-bb2b-d20a5920026f None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:07.231305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 410/810] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:22:06 2022] PUT /identity/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/ad12085f356a4f0682bb70ad231a10b6/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:22:07.231305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5b254-88f8-42cd-ae72-e547aae57a2c None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:07.267764 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529cae7-064b-4ef2-9f95-3d9f0bbb5f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:07.268728 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529cae7-064b-4ef2-9f95-3d9f0bbb5f28 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:07.269016 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529cae7-064b-4ef2-9f95-3d9f0bbb5f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:07.269296 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529cae7-064b-4ef2-9f95-3d9f0bbb5f28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:07.283030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529cae7-064b-4ef2-9f95-3d9f0bbb5f28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:07.284617 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529cae7-064b-4ef2-9f95-3d9f0bbb5f28 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:07.290676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:07.305710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-2529cae7-064b-4ef2-9f95-3d9f0bbb5f28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:07.305710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:07.305710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:07.305710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:07.305710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:07.305710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:07.305710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:07.305710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:07.305710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:07.305710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:07.305710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:07.305710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:07.305710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:07.305710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:07.305710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:07.306738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:07.306738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:07.306738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:07.306738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:07.306738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:07.306738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:07.306738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:07.306738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:07.306738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:07.306738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:07.306738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:07.306738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:07.306738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:07.306738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:07.306738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:07.306738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:07.306738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:07.307659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:07.307659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:07.307659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:07.307659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:07.307659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 401/811] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:07.307978 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529cae7-064b-4ef2-9f95-3d9f0bbb5f28 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:07.393470 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5b254-88f8-42cd-ae72-e547aae57a2c None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:07.430559 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:07.439634 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dda01-3224-466e-9123-e95d4c5cd693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:07.447158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dda01-3224-466e-9123-e95d4c5cd693 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:07.447158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dda01-3224-466e-9123-e95d4c5cd693 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:07.447158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dda01-3224-466e-9123-e95d4c5cd693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:07.449553 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529cae7-064b-4ef2-9f95-3d9f0bbb5f28 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:07.451770 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716dda01-3224-466e-9123-e95d4c5cd693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:07.453820 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716dda01-3224-466e-9123-e95d4c5cd693 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:07.472354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-716dda01-3224-466e-9123-e95d4c5cd693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:07.472354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:07.472354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:07.472354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:07.472354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:07.472354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:07.472354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:07.472354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:07.472354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:07.472354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:07.472354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:07.472354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:07.472354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:07.472354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:07.472354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:07.473323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:07.473323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:07.473323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:07.473323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:07.473323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:07.473323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:07.473323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:07.473323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:07.473323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:07.473323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:07.473323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:07.473323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:07.473323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:07.473323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:07.473323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:07.473323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:07.473323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:07.474641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:07.474641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:07.474641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:07.474641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:07.474641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 411/812] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:07.474641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dda01-3224-466e-9123-e95d4c5cd693 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:07.493536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de4f80-56db-4192-af87-583148071c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:07.494321 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de4f80-56db-4192-af87-583148071c30 None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:07.494718 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de4f80-56db-4192-af87-583148071c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:07.495004 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de4f80-56db-4192-af87-583148071c30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:07.496052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de4f80-56db-4192-af87-583148071c30 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:07.497496 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de4f80-56db-4192-af87-583148071c30 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:07.562806 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:07.578919 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dda01-3224-466e-9123-e95d4c5cd693 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:07.591324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 402/813] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Jul 12 14:22:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:22:07.592764 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de4f80-56db-4192-af87-583148071c30 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:07.629546 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14b2f9-c22c-4a49-93f8-b44b69226f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:07.630228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14b2f9-c22c-4a49-93f8-b44b69226f81 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:07.630601 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14b2f9-c22c-4a49-93f8-b44b69226f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:07.630882 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14b2f9-c22c-4a49-93f8-b44b69226f81 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:07.632400 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14b2f9-c22c-4a49-93f8-b44b69226f81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:07.632722 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14b2f9-c22c-4a49-93f8-b44b69226f81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:07.635623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14b2f9-c22c-4a49-93f8-b44b69226f81 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:07.647804 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 412/814] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:07.649252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e992baf-7b2a-4856-8b18-63ecc2a14677 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:07.649542 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e992baf-7b2a-4856-8b18-63ecc2a14677 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:07.649822 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e992baf-7b2a-4856-8b18-63ecc2a14677 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:07.651382 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 413/815] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:07.653289 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e992baf-7b2a-4856-8b18-63ecc2a14677 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:07.737140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de4f80-56db-4192-af87-583148071c30 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:07.771106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e992baf-7b2a-4856-8b18-63ecc2a14677 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:07.779803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294e248-6360-42d3-824b-2df115b499be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:07.780571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294e248-6360-42d3-824b-2df115b499be None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:07.780931 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294e248-6360-42d3-824b-2df115b499be None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:07.781277 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294e248-6360-42d3-824b-2df115b499be None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:07.782192 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294e248-6360-42d3-824b-2df115b499be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:07.782574 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294e248-6360-42d3-824b-2df115b499be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:07.784155 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294e248-6360-42d3-824b-2df115b499be None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:07.798876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 403/816] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:07.805352 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622b3e5-108e-4be9-8d0e-cc86dd254814 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:07.805647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622b3e5-108e-4be9-8d0e-cc86dd254814 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:07.805927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622b3e5-108e-4be9-8d0e-cc86dd254814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:07.810119 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd6a01-c5e7-409f-a203-015a33a59aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:07.810922 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd6a01-c5e7-409f-a203-015a33a59aeb None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:07.811208 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd6a01-c5e7-409f-a203-015a33a59aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:07.811512 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd6a01-c5e7-409f-a203-015a33a59aeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:07.811612 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:07.820010 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd6a01-c5e7-409f-a203-015a33a59aeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:07.825247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd6a01-c5e7-409f-a203-015a33a59aeb None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:07.826185 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-1622b3e5-108e-4be9-8d0e-cc86dd254814 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:07.827640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-1622b3e5-108e-4be9-8d0e-cc86dd254814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:07.838153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-02dd6a01-c5e7-409f-a203-015a33a59aeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:07.838153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:07.838153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:07.838153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:07.838153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:07.838153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:07.838153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:07.838153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:07.838153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:07.838153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:07.838153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:07.838153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:07.838153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:22:07.838153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:22:07.838153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:22:07.839212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:22:07.839212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:07.839212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:07.839212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:07.839212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:07.839212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:07.839212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:07.839212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:07.839212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:07.839212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:07.839212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:07.839212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:07.839212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:07.839212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:07.839212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:07.839212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:07.839212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:07.840509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:22:07.840509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:22:07.840509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:22:07.840509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:22:07.840509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:22:07.840509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:22:07.840509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:07.840509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:07.840509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 414/817] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:07.841122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd6a01-c5e7-409f-a203-015a33a59aeb None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:07.843403 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:07.918791 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 404/818] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:07.920049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622b3e5-108e-4be9-8d0e-cc86dd254814 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:07.978974 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd6a01-c5e7-409f-a203-015a33a59aeb None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:08.018577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab91bf6-d40a-410b-a543-e22df8f2c1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:08.019806 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab91bf6-d40a-410b-a543-e22df8f2c1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:08.020300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab91bf6-d40a-410b-a543-e22df8f2c1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:08.020783 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab91bf6-d40a-410b-a543-e22df8f2c1a7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:08.030471 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab91bf6-d40a-410b-a543-e22df8f2c1a7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:08.032511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab91bf6-d40a-410b-a543-e22df8f2c1a7 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:08.044988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622b3e5-108e-4be9-8d0e-cc86dd254814 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:08.050236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-1ab91bf6-d40a-410b-a543-e22df8f2c1a7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:22:08.050236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:08.050236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:08.050236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:08.050236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:08.050236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:08.050236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:08.050236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:08.050236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:08.050236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:08.050236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:08.050236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:08.050236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:22:08.050236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:22:08.050236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:22:08.050236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:22:08.051131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:08.051131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:08.051131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:22:08.051131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:08.051131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:22:08.051131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:08.051131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:08.051131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:08.051131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:08.051131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:08.051131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:08.051131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:08.051131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:08.051131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:08.051131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:08.051131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:08.051131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:08.051131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:08.052083 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:08.052083 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:08.052083 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:22:08.052083 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:22:08.052083 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:22:08.052083 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:22:08.052083 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:22:08.052083 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:22:08.052083 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:22:08.052083 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:08.059927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 415/819] 10.222.0.40 () {56 vars in 1093 bytes} [Tue Jul 12 14:22:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:08.061183 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab91bf6-d40a-410b-a543-e22df8f2c1a7 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:08.078762 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:08.083943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efdf354-f422-4598-927c-d50cdd1c2d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:08.085300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efdf354-f422-4598-927c-d50cdd1c2d99 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:08.086029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efdf354-f422-4598-927c-d50cdd1c2d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:08.086029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efdf354-f422-4598-927c-d50cdd1c2d99 None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:08.086522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efdf354-f422-4598-927c-d50cdd1c2d99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:08.086836 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efdf354-f422-4598-927c-d50cdd1c2d99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:08.088313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efdf354-f422-4598-927c-d50cdd1c2d99 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:08.101514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 405/820] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:22:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:08.102850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efdf354-f422-4598-927c-d50cdd1c2d99 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:08.136934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:08.191189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab91bf6-d40a-410b-a543-e22df8f2c1a7 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:08.216169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efdf354-f422-4598-927c-d50cdd1c2d99 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:08.248761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba8b6a-5752-467c-b7a3-185e9ecbfd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:08.248761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba8b6a-5752-467c-b7a3-185e9ecbfd0e None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:08.249019 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba8b6a-5752-467c-b7a3-185e9ecbfd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:08.249094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba8b6a-5752-467c-b7a3-185e9ecbfd0e None admin] PATH_INFO: `/v3/services/network` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:08.249746 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba8b6a-5752-467c-b7a3-185e9ecbfd0e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:08.251129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba8b6a-5752-467c-b7a3-185e9ecbfd0e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:08.263460 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e350c7f-0f7b-4184-8f84-2556565829df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:08.264494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e350c7f-0f7b-4184-8f84-2556565829df None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:08.264988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e350c7f-0f7b-4184-8f84-2556565829df None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:08.265473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e350c7f-0f7b-4184-8f84-2556565829df None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:08.266516 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e350c7f-0f7b-4184-8f84-2556565829df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:08.267032 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e350c7f-0f7b-4184-8f84-2556565829df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:08.267417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-edba8b6a-5752-467c-b7a3-185e9ecbfd0e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 14:22:08.267417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:08.267417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:08.267417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:08.267417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:08.267417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:08.267417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:08.267417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:08.267417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 14:22:08.267417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:08.267417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:08.267417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:08.267417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:08.267417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:08.267417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:08.267417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:08.267417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:08.268371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:08.268371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:08.268371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:08.268371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:08.268371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:08.268371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:08.268371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:08.268371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:08.268371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:08.268371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:08.268371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:08.268371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:08.268371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:08.268371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:08.268371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:08.268371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:08.269202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:08.269202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:08.269202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:08.269202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:08.269202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:08.269202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:08.269202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:08.269202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:08.269202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:08.269202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:08.269202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:08.269202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:08.269202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 14:22:08.269202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:08.272102 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e350c7f-0f7b-4184-8f84-2556565829df None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:08.274161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 416/821] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:08 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:08.275005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba8b6a-5752-467c-b7a3-185e9ecbfd0e None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:08.304317 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 406/822] 10.222.0.40 () {56 vars in 1133 bytes} [Tue Jul 12 14:22:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:08.305105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e350c7f-0f7b-4184-8f84-2556565829df None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:08.375785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:08.388983 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba8b6a-5752-467c-b7a3-185e9ecbfd0e None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:08.414954 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:08.423860 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0107568-8425-4e09-9313-bb78e26f5cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:08.424906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0107568-8425-4e09-9313-bb78e26f5cda None admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:08.425441 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0107568-8425-4e09-9313-bb78e26f5cda None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:08.425441 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0107568-8425-4e09-9313-bb78e26f5cda None admin] PATH_INFO: `/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/5ec758ef106b49f4985845b3c106f94b/roles/c6f0b65d6ea5449ca79744ac52243ba2` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:08.440662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e350c7f-0f7b-4184-8f84-2556565829df None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:08.442278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0107568-8425-4e09-9313-bb78e26f5cda None admin] RBAC: Authorizing `identity:create_grant(project_id=00424b6950d14cd4854e4add3e3d7705, user_id=5ec758ef106b49f4985845b3c106f94b, role_id=c6f0b65d6ea5449ca79744ac52243ba2)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:08.443701 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0107568-8425-4e09-9313-bb78e26f5cda None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:08.481841 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82c2f6-c75d-456f-baf7-2196cd4c2b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:08.482964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82c2f6-c75d-456f-baf7-2196cd4c2b9d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:08.483577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82c2f6-c75d-456f-baf7-2196cd4c2b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:08.484067 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82c2f6-c75d-456f-baf7-2196cd4c2b9d None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:08.488503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82c2f6-c75d-456f-baf7-2196cd4c2b9d None admin] RBAC: Adding query filter params (name=network) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:08.488503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82c2f6-c75d-456f-baf7-2196cd4c2b9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:08.488503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82c2f6-c75d-456f-baf7-2196cd4c2b9d None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:08.498049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 407/823] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Jul 12 14:22:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:08.498049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82c2f6-c75d-456f-baf7-2196cd4c2b9d None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:08.519447 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 417/824] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:22:08 2022] PUT /identity/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/5ec758ef106b49f4985845b3c106f94b/roles/c6f0b65d6ea5449ca79744ac52243ba2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:22:08.521689 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0107568-8425-4e09-9313-bb78e26f5cda None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:08.633036 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82c2f6-c75d-456f-baf7-2196cd4c2b9d None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:08.653248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:08.672172 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2c619-9f53-415a-b07f-668300981009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:08.673207 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2c619-9f53-415a-b07f-668300981009 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:08.673875 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2c619-9f53-415a-b07f-668300981009 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:08.674304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2c619-9f53-415a-b07f-668300981009 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:08.759627 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2c619-9f53-415a-b07f-668300981009 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:08.761298 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2c619-9f53-415a-b07f-668300981009 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:08.773256 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0107568-8425-4e09-9313-bb78e26f5cda None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:08.827322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f6537-1caf-44cf-b9e6-6f83de5932fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:08.829072 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f6537-1caf-44cf-b9e6-6f83de5932fb None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:08.830811 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f6537-1caf-44cf-b9e6-6f83de5932fb None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:08.831245 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f6537-1caf-44cf-b9e6-6f83de5932fb None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:08.832197 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f6537-1caf-44cf-b9e6-6f83de5932fb None admin] RBAC: Adding query filter params (type=network) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:08.832801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f6537-1caf-44cf-b9e6-6f83de5932fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:08.835387 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f6537-1caf-44cf-b9e6-6f83de5932fb None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:08.847255 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 418/825] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Jul 12 14:22:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:08.853921 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f6537-1caf-44cf-b9e6-6f83de5932fb None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:08.920673 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:08.940308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 408/826] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:22:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:22:08.947345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2c619-9f53-415a-b07f-668300981009 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:08.973943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:08.985460 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f6537-1caf-44cf-b9e6-6f83de5932fb None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:09.028126 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfc88b-fa79-4bb4-8db6-003521deefd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:09.028714 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfc88b-fa79-4bb4-8db6-003521deefd8 None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:09.028995 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfc88b-fa79-4bb4-8db6-003521deefd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:09.029269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfc88b-fa79-4bb4-8db6-003521deefd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:09.030018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfc88b-fa79-4bb4-8db6-003521deefd8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:09.031404 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfc88b-fa79-4bb4-8db6-003521deefd8 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:09.099413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2c619-9f53-415a-b07f-668300981009 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:09.116954 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 419/827] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Jul 12 14:22:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:22:09.166520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08057645-e921-4ec4-b8ff-91a521d9e403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:09.167782 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08057645-e921-4ec4-b8ff-91a521d9e403 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:09.168274 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08057645-e921-4ec4-b8ff-91a521d9e403 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:09.168753 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08057645-e921-4ec4-b8ff-91a521d9e403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:09.188523 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08057645-e921-4ec4-b8ff-91a521d9e403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:09.190446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08057645-e921-4ec4-b8ff-91a521d9e403 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:09.214330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-08057645-e921-4ec4-b8ff-91a521d9e403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:09.214330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:09.214330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:09.214330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:09.214330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:09.214330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:09.214330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:09.214330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:09.214330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:09.214330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:09.214330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:09.214330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:09.214330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:09.214330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:09.214330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:09.215267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:09.215267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:09.215267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:09.215267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:09.215267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:09.215267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:09.215267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:09.215267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:09.215267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:09.215267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:09.215267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:09.215267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:09.215267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:09.215267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:09.215267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:09.215267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:09.215267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:09.216183 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:09.216183 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:09.216183 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:09.216183 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:09.218203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 409/828] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:09.224414 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfc88b-fa79-4bb4-8db6-003521deefd8 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:09.349269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:09.357371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfc88b-fa79-4bb4-8db6-003521deefd8 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:09.394868 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0d7c8-5482-4761-abcf-2feb72b91b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:09.395579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0d7c8-5482-4761-abcf-2feb72b91b78 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:09.396102 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0d7c8-5482-4761-abcf-2feb72b91b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:09.396454 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0d7c8-5482-4761-abcf-2feb72b91b78 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:09.398524 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0d7c8-5482-4761-abcf-2feb72b91b78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:09.398920 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0d7c8-5482-4761-abcf-2feb72b91b78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:09.400455 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0d7c8-5482-4761-abcf-2feb72b91b78 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:09.422074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 420/829] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:09.422968 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08057645-e921-4ec4-b8ff-91a521d9e403 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:09.467417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3bcc6-ebc2-4895-b438-2713bbbff116 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:09.468056 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3bcc6-ebc2-4895-b438-2713bbbff116 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:09.468550 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3bcc6-ebc2-4895-b438-2713bbbff116 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:09.470400 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 421/830] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:22:09.476013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324b7af-d4e5-4ff9-a0c2-b524310f0272 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:09.476662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324b7af-d4e5-4ff9-a0c2-b524310f0272 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:09.477161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324b7af-d4e5-4ff9-a0c2-b524310f0272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:09.503680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:09.556155 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08057645-e921-4ec4-b8ff-91a521d9e403 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:09.597468 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ae7d9-721c-4884-b0c6-442b64f6205e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:09.598283 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ae7d9-721c-4884-b0c6-442b64f6205e None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:09.598565 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ae7d9-721c-4884-b0c6-442b64f6205e None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:09.598842 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ae7d9-721c-4884-b0c6-442b64f6205e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:09.606929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ae7d9-721c-4884-b0c6-442b64f6205e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:09.608369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ae7d9-721c-4884-b0c6-442b64f6205e None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:09.618713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-3324b7af-d4e5-4ff9-a0c2-b524310f0272 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:09.620225 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-3324b7af-d4e5-4ff9-a0c2-b524310f0272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:09.623652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-f00ae7d9-721c-4884-b0c6-442b64f6205e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:09.623652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:09.623652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:09.623652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:09.623652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:09.623652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:09.623652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:09.623652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:09.623652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:09.623652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:09.623652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:09.623652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:09.623652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:22:09.623652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:22:09.623652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:22:09.628336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:22:09.628336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:09.628336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:09.628336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:09.628336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:09.628336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:09.628336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:09.628336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:09.628336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:09.628336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:09.628336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:09.628336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:09.628336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:09.628336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:09.628336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:09.628336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:09.628336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:09.629217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:22:09.629217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:22:09.629217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:22:09.629217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:22:09.629217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:22:09.629217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:22:09.629217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:09.629217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:09.629217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 410/831] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:09.633578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ae7d9-721c-4884-b0c6-442b64f6205e None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:09.707299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 422/832] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:22:09.727617 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324b7af-d4e5-4ff9-a0c2-b524310f0272 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:09.741362 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ae7d9-721c-4884-b0c6-442b64f6205e None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:09.764911 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:09.777422 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98e041-daf2-4080-982b-afd676820ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:09.779147 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98e041-daf2-4080-982b-afd676820ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:09.779147 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98e041-daf2-4080-982b-afd676820ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:09.779147 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98e041-daf2-4080-982b-afd676820ac3 None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:09.779512 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98e041-daf2-4080-982b-afd676820ac3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:09.779832 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98e041-daf2-4080-982b-afd676820ac3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:09.781272 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98e041-daf2-4080-982b-afd676820ac3 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:09.798973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 411/833] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:22:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:09.800217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98e041-daf2-4080-982b-afd676820ac3 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:09.823268 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:09.844871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324b7af-d4e5-4ff9-a0c2-b524310f0272 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:09.885181 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fd77e-d7d9-4c89-8a6a-8c617103bbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:09.886395 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fd77e-d7d9-4c89-8a6a-8c617103bbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:09.886871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fd77e-d7d9-4c89-8a6a-8c617103bbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:09.887367 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fd77e-d7d9-4c89-8a6a-8c617103bbf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:09.898685 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fd77e-d7d9-4c89-8a6a-8c617103bbf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:09.905300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98e041-daf2-4080-982b-afd676820ac3 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:09.906848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-546fd77e-d7d9-4c89-8a6a-8c617103bbf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:09.906848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:09.906848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:09.906848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:09.906848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:09.906848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:09.906848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:09.906848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:09.906848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:09.906848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:09.906848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:09.906848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:09.906848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:09.906848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:09.906848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:09.906848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:09.907781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:09.907781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:09.907781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:09.907781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:09.907781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:09.907781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:09.907781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:09.907781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:09.907781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:09.907781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:09.907781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:09.907781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:09.907781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:09.907781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:09.907781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:09.907781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:09.908605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:09.908605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:09.908605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:09.908605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:09.908605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:09.908605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:09.908605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:09.908605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:09.908605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:09.908605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:09.908605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:09.908605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:09.915530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 423/834] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:22:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:09.917367 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fd77e-d7d9-4c89-8a6a-8c617103bbf1 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:09.943675 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982586b-fe8d-47ec-8118-e2bccfa4823e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:09.944993 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982586b-fe8d-47ec-8118-e2bccfa4823e None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:09.945241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982586b-fe8d-47ec-8118-e2bccfa4823e None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:09.945549 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982586b-fe8d-47ec-8118-e2bccfa4823e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:09.946349 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982586b-fe8d-47ec-8118-e2bccfa4823e None admin] RBAC: Adding query filter params (role.id=ae530119fc5c42358179521ce865b5d7, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=122fc227de9d4f87a66e4a0d86ff0b16) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:09.946661 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982586b-fe8d-47ec-8118-e2bccfa4823e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:09.948186 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982586b-fe8d-47ec-8118-e2bccfa4823e None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:09.963495 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 412/835] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:22:09 2022] GET /identity/v3/role_assignments?user.id=122fc227de9d4f87a66e4a0d86ff0b16&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=ae530119fc5c42358179521ce865b5d7 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:10.030572 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbee5e2-874e-42e3-869c-22d6e7832b35 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:10.030892 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbee5e2-874e-42e3-869c-22d6e7832b35 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:10.031132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbee5e2-874e-42e3-869c-22d6e7832b35 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:10.032969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 413/836] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:22:10.035970 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fd77e-d7d9-4c89-8a6a-8c617103bbf1 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:10.038416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbb401-e4c3-4493-ad56-fa3204a84f45 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:10.038660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbb401-e4c3-4493-ad56-fa3204a84f45 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:10.038889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbb401-e4c3-4493-ad56-fa3204a84f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:10.058494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-63cbb401-e4c3-4493-ad56-fa3204a84f45 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:10.059789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-63cbb401-e4c3-4493-ad56-fa3204a84f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:10.076003 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3dd20-6f48-4f77-bca3-e9ae1dc7041f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:10.076848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3dd20-6f48-4f77-bca3-e9ae1dc7041f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:10.077229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3dd20-6f48-4f77-bca3-e9ae1dc7041f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:10.077597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3dd20-6f48-4f77-bca3-e9ae1dc7041f None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:10.078487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3dd20-6f48-4f77-bca3-e9ae1dc7041f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:10.078891 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3dd20-6f48-4f77-bca3-e9ae1dc7041f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:10.080424 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3dd20-6f48-4f77-bca3-e9ae1dc7041f None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:10.092773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 424/837] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:22:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:10.098350 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3dd20-6f48-4f77-bca3-e9ae1dc7041f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:10.111839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:10.119674 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:10.150361 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 414/838] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:22:10.173594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbb401-e4c3-4493-ad56-fa3204a84f45 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:10.235529 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3dd20-6f48-4f77-bca3-e9ae1dc7041f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:10.280024 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6b3d1-213d-487e-ba62-b27e7ff46885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:10.281827 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6b3d1-213d-487e-ba62-b27e7ff46885 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:10.282283 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6b3d1-213d-487e-ba62-b27e7ff46885 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:10.282729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6b3d1-213d-487e-ba62-b27e7ff46885 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:10.295652 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6b3d1-213d-487e-ba62-b27e7ff46885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:10.297281 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6b3d1-213d-487e-ba62-b27e7ff46885 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:10.304360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbb401-e4c3-4493-ad56-fa3204a84f45 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:10.321614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-72a6b3d1-213d-487e-ba62-b27e7ff46885 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:10.321614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:10.321614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:10.321614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:10.321614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:10.321614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:10.321614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:10.321614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:10.321614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:10.321614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:10.321614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:10.321614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:10.321614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:10.321614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:10.321614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:10.322544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:10.322544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:10.322544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:10.322544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:10.322544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:10.322544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:10.322544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:10.322544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:10.322544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:10.322544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:10.322544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:10.322544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:10.322544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:10.322544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:10.322544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:10.322544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:10.322544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:10.323430 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:10.323430 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:10.323430 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:10.323430 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:10.324110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 425/839] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:10.330619 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6b3d1-213d-487e-ba62-b27e7ff46885 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:10.353962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a90c15-2dca-471c-8c84-b3cd327157ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:10.354807 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a90c15-2dca-471c-8c84-b3cd327157ba None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:10.355095 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a90c15-2dca-471c-8c84-b3cd327157ba None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:10.355405 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a90c15-2dca-471c-8c84-b3cd327157ba None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:10.356075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a90c15-2dca-471c-8c84-b3cd327157ba None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:10.357473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a90c15-2dca-471c-8c84-b3cd327157ba None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:10.370100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-61a90c15-2dca-471c-8c84-b3cd327157ba None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 14:22:10.370100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:10.370100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:10.370100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:10.370100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:10.370100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:10.370100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:10.370100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:10.370100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 14:22:10.370100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:10.370100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:10.370100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:10.370100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:10.370100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:10.370100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:10.370100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:10.370100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:10.371401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:10.371401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:10.371401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:10.371401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:10.371401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:10.371401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:10.371401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:10.371401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:10.371401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:10.371401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:10.371401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:10.371401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:10.371401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:10.371401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:10.371401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:10.371401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:10.372249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:10.372249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:10.372249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:10.372249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:10.372249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:10.372249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:10.372249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:10.372249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:10.372249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:10.372249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:10.372249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:10.372249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:10.372249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 14:22:10.372249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:10.376471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 415/840] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:22:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:10.377760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a90c15-2dca-471c-8c84-b3cd327157ba None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:10.415225 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:10.423799 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:10.458241 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6b3d1-213d-487e-ba62-b27e7ff46885 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:10.486145 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a90c15-2dca-471c-8c84-b3cd327157ba None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:10.498674 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bfc1c-07c5-4f33-8418-15d0ca4a7302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:10.499715 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bfc1c-07c5-4f33-8418-15d0ca4a7302 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:10.500222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bfc1c-07c5-4f33-8418-15d0ca4a7302 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:10.500700 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bfc1c-07c5-4f33-8418-15d0ca4a7302 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:10.501618 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bfc1c-07c5-4f33-8418-15d0ca4a7302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:10.502116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bfc1c-07c5-4f33-8418-15d0ca4a7302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:10.503705 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bfc1c-07c5-4f33-8418-15d0ca4a7302 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:10.515913 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 426/841] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:10.521031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bfc1c-07c5-4f33-8418-15d0ca4a7302 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:10.527446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850075ae-ffcf-4049-8ed3-9e458ecd28c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:10.528725 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850075ae-ffcf-4049-8ed3-9e458ecd28c9 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:10.529084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850075ae-ffcf-4049-8ed3-9e458ecd28c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:10.529435 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850075ae-ffcf-4049-8ed3-9e458ecd28c9 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:10.530220 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850075ae-ffcf-4049-8ed3-9e458ecd28c9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:10.530596 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850075ae-ffcf-4049-8ed3-9e458ecd28c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:10.532134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850075ae-ffcf-4049-8ed3-9e458ecd28c9 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:10.542359 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 416/842] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:22:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:10.543631 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850075ae-ffcf-4049-8ed3-9e458ecd28c9 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:10.648295 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850075ae-ffcf-4049-8ed3-9e458ecd28c9 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:10.648492 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bfc1c-07c5-4f33-8418-15d0ca4a7302 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:10.651561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:10.678338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:10.689291 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ca391-2827-4673-8001-7c407e94b4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:10.692224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ca391-2827-4673-8001-7c407e94b4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:10.692224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ca391-2827-4673-8001-7c407e94b4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:10.692224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ca391-2827-4673-8001-7c407e94b4b9 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:10.692224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ca391-2827-4673-8001-7c407e94b4b9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:10.692527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ca391-2827-4673-8001-7c407e94b4b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:10.693679 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ca391-2827-4673-8001-7c407e94b4b9 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:10.696509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68820772-8aa5-4045-8519-f85296dcddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:10.697855 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68820772-8aa5-4045-8519-f85296dcddfc None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:10.698588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68820772-8aa5-4045-8519-f85296dcddfc None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:10.699077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68820772-8aa5-4045-8519-f85296dcddfc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:10.707371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 417/843] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:22:10 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:10.711112 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68820772-8aa5-4045-8519-f85296dcddfc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:10.712987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68820772-8aa5-4045-8519-f85296dcddfc None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:10.729940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-68820772-8aa5-4045-8519-f85296dcddfc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:22:10.729940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:10.729940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:10.729940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:10.729940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:10.729940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:10.729940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:10.729940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:10.729940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:10.729940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:10.729940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:10.729940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:10.729940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:22:10.729940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:22:10.729940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:22:10.729940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:22:10.730934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:10.730934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:10.730934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:22:10.730934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:10.730934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:22:10.730934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:10.730934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:10.730934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:10.730934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:10.730934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:10.730934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:10.730934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:10.730934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:10.730934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:10.730934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:10.730934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:10.730934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:10.730934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:10.732259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:10.732259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:10.732259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:22:10.732259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:22:10.732259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:22:10.732259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:22:10.732259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:22:10.732259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:22:10.732259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 14:22:10.732259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:10.734827 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 427/844] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:22:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:10.740901 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ca391-2827-4673-8001-7c407e94b4b9 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:10.856382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ca391-2827-4673-8001-7c407e94b4b9 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:10.880464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84147e1-beba-4bb7-88c8-002bd524d9f4 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:10.881221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84147e1-beba-4bb7-88c8-002bd524d9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:10.881758 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84147e1-beba-4bb7-88c8-002bd524d9f4 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:10.884424 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 428/845] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:22:10.889731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5ad60-f5f7-4a16-acf7-72184bd83d32 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:10.891037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5ad60-f5f7-4a16-acf7-72184bd83d32 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:10.891037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5ad60-f5f7-4a16-acf7-72184bd83d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:10.894855 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea1c90-d250-47fd-869f-c928763ec00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:10.895669 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea1c90-d250-47fd-869f-c928763ec00a None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:10.895960 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea1c90-d250-47fd-869f-c928763ec00a None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:10.896248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea1c90-d250-47fd-869f-c928763ec00a None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:10.897660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea1c90-d250-47fd-869f-c928763ec00a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:10.898012 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea1c90-d250-47fd-869f-c928763ec00a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:10.899652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea1c90-d250-47fd-869f-c928763ec00a None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:10.908436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-d2b5ad60-f5f7-4a16-acf7-72184bd83d32 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:10.909913 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d2b5ad60-f5f7-4a16-acf7-72184bd83d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:10.919461 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 418/846] 10.222.0.40 () {56 vars in 1135 bytes} [Tue Jul 12 14:22:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:10.926077 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea1c90-d250-47fd-869f-c928763ec00a None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:10.975855 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:10.985552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 429/847] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:22:11.009791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5ad60-f5f7-4a16-acf7-72184bd83d32 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:11.046760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea1c90-d250-47fd-869f-c928763ec00a None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:11.094000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38edb8-d29d-4b26-82de-aecc73c5efcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:11.094578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38edb8-d29d-4b26-82de-aecc73c5efcc None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:11.094864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38edb8-d29d-4b26-82de-aecc73c5efcc None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:11.095143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38edb8-d29d-4b26-82de-aecc73c5efcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:11.136395 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5ad60-f5f7-4a16-acf7-72184bd83d32 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:11.151460 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:11.171190 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38edb8-d29d-4b26-82de-aecc73c5efcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:11.172687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38edb8-d29d-4b26-82de-aecc73c5efcc None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:11.184718 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d57bc3-5f2d-4462-86c4-42ead1e6fae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:11.186376 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d57bc3-5f2d-4462-86c4-42ead1e6fae9 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:11.186830 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d57bc3-5f2d-4462-86c4-42ead1e6fae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:11.187243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d57bc3-5f2d-4462-86c4-42ead1e6fae9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:11.201257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:11.202550 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d57bc3-5f2d-4462-86c4-42ead1e6fae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:11.211234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-82d57bc3-5f2d-4462-86c4-42ead1e6fae9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:22:11.211234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:11.211234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:11.211234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:11.211234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:11.211234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:11.211234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:11.211234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:11.211234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:11.211234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:11.211234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:11.211234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:11.211234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:11.211234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:11.211234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:11.211234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:11.213071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:11.213071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:11.213071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:11.213071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:11.213071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:11.213071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:11.213071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:11.213071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:11.213071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:11.213071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:11.213071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:11.213071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:11.213071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:11.213071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:11.213071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:11.213071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:11.213917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:11.213917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:11.213917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:11.213917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:11.213917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:11.213917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:11.213917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:11.213917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:11.213917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:11.213917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:11.213917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:22:11.213917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:11.213917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 430/848] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:22:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:11.220580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d57bc3-5f2d-4462-86c4-42ead1e6fae9 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:11.306162 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 419/849] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:22:10 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 14:22:11.307423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38edb8-d29d-4b26-82de-aecc73c5efcc None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:11.347687 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d57bc3-5f2d-4462-86c4-42ead1e6fae9 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:11.385446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0b8fe-7f96-4857-9018-2d7a3445badd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:11.386121 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0b8fe-7f96-4857-9018-2d7a3445badd None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:11.386404 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0b8fe-7f96-4857-9018-2d7a3445badd None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:11.386682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0b8fe-7f96-4857-9018-2d7a3445badd None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:11.387465 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0b8fe-7f96-4857-9018-2d7a3445badd None admin] RBAC: Adding query filter params (name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:11.387781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0b8fe-7f96-4857-9018-2d7a3445badd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:11.389242 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0b8fe-7f96-4857-9018-2d7a3445badd None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:11.399315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 431/850] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:22:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:11.404240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0b8fe-7f96-4857-9018-2d7a3445badd None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:11.421177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38edb8-d29d-4b26-82de-aecc73c5efcc None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:11.443490 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:11.456600 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:11.472267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46062adb-79a1-4c43-b3a6-18d6ab7c1183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:11.473599 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46062adb-79a1-4c43-b3a6-18d6ab7c1183 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:11.474035 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46062adb-79a1-4c43-b3a6-18d6ab7c1183 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:11.474645 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46062adb-79a1-4c43-b3a6-18d6ab7c1183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:11.489595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46062adb-79a1-4c43-b3a6-18d6ab7c1183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:11.493515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46062adb-79a1-4c43-b3a6-18d6ab7c1183 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:11.518740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-46062adb-79a1-4c43-b3a6-18d6ab7c1183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:11.518740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:11.518740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:11.518740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:11.518740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:11.518740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:11.518740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:11.518740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:11.518740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:11.518740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:11.518740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:11.518740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:11.518740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:11.518740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:11.518740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:11.519737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:11.519737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:11.519737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:11.519737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:11.519737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:11.519737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:11.519737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:11.519737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:11.519737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:11.519737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:11.519737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:11.519737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:11.519737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:11.519737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:11.519737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:11.519737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:11.519737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:11.520614 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:11.520614 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:11.520614 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:11.520614 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:11.523625 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 420/851] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:11.528593 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46062adb-79a1-4c43-b3a6-18d6ab7c1183 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:11.538283 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0b8fe-7f96-4857-9018-2d7a3445badd None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:11.582491 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ac16d-e385-425a-9b54-555d2d15077f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:11.583575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ac16d-e385-425a-9b54-555d2d15077f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:11.584011 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ac16d-e385-425a-9b54-555d2d15077f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:11.584428 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ac16d-e385-425a-9b54-555d2d15077f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:11.599222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ac16d-e385-425a-9b54-555d2d15077f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:11.601762 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ac16d-e385-425a-9b54-555d2d15077f None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:11.624907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-0b3ac16d-e385-425a-9b54-555d2d15077f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:11.624907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:11.624907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:11.624907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:11.624907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:11.624907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:11.624907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:11.624907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:11.624907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:11.624907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:11.624907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:11.624907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:11.624907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:11.624907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:11.624907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:11.626001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:11.626001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:11.626001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:11.626001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:11.626001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:11.626001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:11.626001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:11.626001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:11.626001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:11.626001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:11.626001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:11.626001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:11.626001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:11.626001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:11.626001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:11.626001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:11.626001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:11.627072 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:11.627072 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:11.627072 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:11.627072 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:11.634012 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 432/852] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:11.636686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ac16d-e385-425a-9b54-555d2d15077f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:11.644993 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46062adb-79a1-4c43-b3a6-18d6ab7c1183 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:11.681610 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d2b9c-57f7-41ce-86a8-64022fa1e603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:11.682347 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d2b9c-57f7-41ce-86a8-64022fa1e603 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:11.682635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d2b9c-57f7-41ce-86a8-64022fa1e603 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:11.682913 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d2b9c-57f7-41ce-86a8-64022fa1e603 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:11.683684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d2b9c-57f7-41ce-86a8-64022fa1e603 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:11.683992 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d2b9c-57f7-41ce-86a8-64022fa1e603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:11.685405 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d2b9c-57f7-41ce-86a8-64022fa1e603 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:11.702726 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 421/853] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:11.703754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d2b9c-57f7-41ce-86a8-64022fa1e603 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:11.751548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:11.753907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:11.771329 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ac16d-e385-425a-9b54-555d2d15077f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:11.814784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65364117-d72b-4b9e-88f7-70d1613bb8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:11.815791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65364117-d72b-4b9e-88f7-70d1613bb8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:11.816236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65364117-d72b-4b9e-88f7-70d1613bb8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:11.816674 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65364117-d72b-4b9e-88f7-70d1613bb8a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:11.817544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65364117-d72b-4b9e-88f7-70d1613bb8a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:11.818440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65364117-d72b-4b9e-88f7-70d1613bb8a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:11.820490 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65364117-d72b-4b9e-88f7-70d1613bb8a2 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:11.833415 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d2b9c-57f7-41ce-86a8-64022fa1e603 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:11.836364 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 433/854] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:11.844304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65364117-d72b-4b9e-88f7-70d1613bb8a2 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:11.886099 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafedeb-c0a0-432e-93b2-36ebb8c8b008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:11.887178 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafedeb-c0a0-432e-93b2-36ebb8c8b008 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:11.887745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafedeb-c0a0-432e-93b2-36ebb8c8b008 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:11.888198 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafedeb-c0a0-432e-93b2-36ebb8c8b008 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:11.898808 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafedeb-c0a0-432e-93b2-36ebb8c8b008 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:11.901028 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafedeb-c0a0-432e-93b2-36ebb8c8b008 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:11.920815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-1aafedeb-c0a0-432e-93b2-36ebb8c8b008 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:11.920815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:11.920815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:11.920815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:11.920815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:11.920815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:11.920815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:11.920815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:11.920815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:11.920815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:11.920815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:11.920815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:11.920815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:22:11.920815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:22:11.920815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:22:11.921824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:22:11.921824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:11.921824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:11.921824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:11.921824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:11.921824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:11.921824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:11.921824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:11.921824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:11.921824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:11.921824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:11.921824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:11.921824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:11.921824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:11.921824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:11.921824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:11.921824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:11.922694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:22:11.922694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:22:11.922694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:22:11.922694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:22:11.922694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:22:11.922694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:22:11.922694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:11.922694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:11.925132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 422/855] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:11.930644 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafedeb-c0a0-432e-93b2-36ebb8c8b008 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:11.968970 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65364117-d72b-4b9e-88f7-70d1613bb8a2 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:12.007567 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e84a27-6353-4a81-aebd-ec50cf641c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:12.008557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e84a27-6353-4a81-aebd-ec50cf641c28 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:12.008935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e84a27-6353-4a81-aebd-ec50cf641c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:12.009305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e84a27-6353-4a81-aebd-ec50cf641c28 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:12.017504 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e84a27-6353-4a81-aebd-ec50cf641c28 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:12.019046 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e84a27-6353-4a81-aebd-ec50cf641c28 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:12.036065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-06e84a27-6353-4a81-aebd-ec50cf641c28 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:22:12.036065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:12.036065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:12.036065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:12.036065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:12.036065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:12.036065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:12.036065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:12.036065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:12.036065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:12.036065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:12.036065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:12.036065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:22:12.036065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:22:12.036065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:22:12.036065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:22:12.037206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:12.037206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:12.037206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:22:12.037206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:12.037206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:22:12.037206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:12.037206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:12.037206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:12.037206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:12.037206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:12.037206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:12.037206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:12.037206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:12.037206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:12.037206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:12.037206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:12.037206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:12.037206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:12.038366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:12.038366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:12.038366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:22:12.038366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:22:12.038366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:22:12.038366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:22:12.038366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:22:12.038366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:22:12.038366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:22:12.038366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:12.043759 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 434/856] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Jul 12 14:22:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:12.046063 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e84a27-6353-4a81-aebd-ec50cf641c28 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:12.047492 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:12.051936 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:12.053695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafedeb-c0a0-432e-93b2-36ebb8c8b008 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:12.093227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945ed6d-7b9f-46b5-a902-f1e409225dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:12.094052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945ed6d-7b9f-46b5-a902-f1e409225dbd None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:12.094505 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945ed6d-7b9f-46b5-a902-f1e409225dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:12.094880 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945ed6d-7b9f-46b5-a902-f1e409225dbd None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:12.095815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945ed6d-7b9f-46b5-a902-f1e409225dbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:12.096223 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945ed6d-7b9f-46b5-a902-f1e409225dbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:12.097840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945ed6d-7b9f-46b5-a902-f1e409225dbd None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:12.116302 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 423/857] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:22:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:12.119136 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945ed6d-7b9f-46b5-a902-f1e409225dbd None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:12.176567 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e84a27-6353-4a81-aebd-ec50cf641c28 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:12.217436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52fe30-5b9c-4744-a939-a0d6a416425c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:12.218116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52fe30-5b9c-4744-a939-a0d6a416425c None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:12.218396 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52fe30-5b9c-4744-a939-a0d6a416425c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:12.218672 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52fe30-5b9c-4744-a939-a0d6a416425c None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:12.219536 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52fe30-5b9c-4744-a939-a0d6a416425c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:12.219846 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52fe30-5b9c-4744-a939-a0d6a416425c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:12.222278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52fe30-5b9c-4744-a939-a0d6a416425c None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:12.239358 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945ed6d-7b9f-46b5-a902-f1e409225dbd None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:12.247793 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 435/858] 10.222.0.40 () {56 vars in 1149 bytes} [Tue Jul 12 14:22:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:12.248744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666acd15-2896-4091-b55a-56e00d92cde3 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:12.249037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666acd15-2896-4091-b55a-56e00d92cde3 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:12.249321 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666acd15-2896-4091-b55a-56e00d92cde3 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:12.250789 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 436/859] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:12.251411 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666acd15-2896-4091-b55a-56e00d92cde3 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:12.281819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30f653-8ad1-4fac-9b8d-43e74711e921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:12.282407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f653-8ad1-4fac-9b8d-43e74711e921 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:12.282694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f653-8ad1-4fac-9b8d-43e74711e921 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:12.282976 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f653-8ad1-4fac-9b8d-43e74711e921 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:12.283844 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30f653-8ad1-4fac-9b8d-43e74711e921 None admin] RBAC: Adding query filter params (role.id=ae530119fc5c42358179521ce865b5d7, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=ad12085f356a4f0682bb70ad231a10b6) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:12.284161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30f653-8ad1-4fac-9b8d-43e74711e921 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:12.285588 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30f653-8ad1-4fac-9b8d-43e74711e921 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:12.292092 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 424/860] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:22:12 2022] GET /identity/v3/role_assignments?user.id=ad12085f356a4f0682bb70ad231a10b6&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=ae530119fc5c42358179521ce865b5d7 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:12.293360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598bf47-8bcf-43e0-9a63-71e3b4d726d3 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:12.293679 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598bf47-8bcf-43e0-9a63-71e3b4d726d3 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:12.293961 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598bf47-8bcf-43e0-9a63-71e3b4d726d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:12.311942 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-0598bf47-8bcf-43e0-9a63-71e3b4d726d3 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:12.313188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0598bf47-8bcf-43e0-9a63-71e3b4d726d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:12.331449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:12.346925 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:12.399745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 425/861] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:12.406255 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666acd15-2896-4091-b55a-56e00d92cde3 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:12.416369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598bf47-8bcf-43e0-9a63-71e3b4d726d3 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:12.458542 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294ef1a-b4a9-4d96-8b7e-422057bf9de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:12.459218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294ef1a-b4a9-4d96-8b7e-422057bf9de0 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:12.459604 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294ef1a-b4a9-4d96-8b7e-422057bf9de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:12.460531 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294ef1a-b4a9-4d96-8b7e-422057bf9de0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:12.549728 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598bf47-8bcf-43e0-9a63-71e3b4d726d3 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:12.563678 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294ef1a-b4a9-4d96-8b7e-422057bf9de0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:12.565418 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294ef1a-b4a9-4d96-8b7e-422057bf9de0 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:12.591704 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b79d5-3790-471e-85e2-52ad59ae6d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:12.593115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b79d5-3790-471e-85e2-52ad59ae6d3b None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:12.593414 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b79d5-3790-471e-85e2-52ad59ae6d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:12.593694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b79d5-3790-471e-85e2-52ad59ae6d3b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:12.594645 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b79d5-3790-471e-85e2-52ad59ae6d3b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:12.596698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b79d5-3790-471e-85e2-52ad59ae6d3b None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:12.612926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-385b79d5-3790-471e-85e2-52ad59ae6d3b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 14:22:12.612926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:12.612926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:12.612926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:12.612926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:12.612926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:12.612926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:12.612926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:12.612926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 14:22:12.612926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:12.612926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:12.612926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:12.612926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:12.612926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:12.612926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:12.612926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:12.613895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:12.613895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:12.613895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:12.613895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:12.613895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:12.613895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:12.613895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:12.613895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:12.613895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:12.613895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:12.613895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:12.613895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:12.613895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:12.613895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:12.613895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:12.613895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:12.614719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:12.614719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:12.614719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:12.614719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:12.614719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:12.614719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:12.614719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:12.614719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:12.614719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:12.614719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:12.614719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:12.614719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:12.614719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:12.614719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 14:22:12.614719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:12.615520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 426/862] 10.222.0.40 () {56 vars in 1132 bytes} [Tue Jul 12 14:22:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:12.621455 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b79d5-3790-471e-85e2-52ad59ae6d3b None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:12.642173 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:12.648920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:12.684703 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 437/863] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:22:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:22:12.689893 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294ef1a-b4a9-4d96-8b7e-422057bf9de0 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:12.761225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b79d5-3790-471e-85e2-52ad59ae6d3b None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:12.808750 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999ecbb-5e3e-4662-9407-1aaacd0944c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:12.810285 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999ecbb-5e3e-4662-9407-1aaacd0944c9 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:12.811071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999ecbb-5e3e-4662-9407-1aaacd0944c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:12.811593 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999ecbb-5e3e-4662-9407-1aaacd0944c9 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:12.813174 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999ecbb-5e3e-4662-9407-1aaacd0944c9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:12.813837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999ecbb-5e3e-4662-9407-1aaacd0944c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:12.815840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999ecbb-5e3e-4662-9407-1aaacd0944c9 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:12.822720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294ef1a-b4a9-4d96-8b7e-422057bf9de0 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:12.823763 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 427/864] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Jul 12 14:22:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:12.830471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999ecbb-5e3e-4662-9407-1aaacd0944c9 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:12.864434 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa6553-ed8e-4665-8a83-7eea3c8f2e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:12.865233 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa6553-ed8e-4665-8a83-7eea3c8f2e3b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:12.865518 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa6553-ed8e-4665-8a83-7eea3c8f2e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:12.866353 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa6553-ed8e-4665-8a83-7eea3c8f2e3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:12.877580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa6553-ed8e-4665-8a83-7eea3c8f2e3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:12.879015 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa6553-ed8e-4665-8a83-7eea3c8f2e3b None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:12.900338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-bcaa6553-ed8e-4665-8a83-7eea3c8f2e3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:12.900338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:12.900338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:12.900338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:12.900338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:12.900338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:12.900338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:12.900338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:12.900338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:12.900338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:12.900338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:12.900338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:12.900338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:12.900338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:12.900338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:12.901303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:12.901303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:12.901303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:12.901303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:12.901303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:12.901303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:12.901303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:12.901303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:12.901303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:12.901303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:12.901303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:12.901303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:12.901303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:12.901303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:12.901303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:12.901303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:12.901303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:12.902176 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:12.902176 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:12.902176 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:12.902176 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:12.907330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 438/865] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:12.907330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbf388-94df-46c2-85ce-2f8c26c80007 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:12.907330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbf388-94df-46c2-85ce-2f8c26c80007 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:12.907330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbf388-94df-46c2-85ce-2f8c26c80007 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:12.907600 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 439/866] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:12.908136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbf388-94df-46c2-85ce-2f8c26c80007 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:12.926225 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:12.927910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:12.950277 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999ecbb-5e3e-4662-9407-1aaacd0944c9 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:12.987552 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e2004-2a81-4bc8-977f-614eb96518e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:12.988798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e2004-2a81-4bc8-977f-614eb96518e9 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:12.988798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e2004-2a81-4bc8-977f-614eb96518e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:12.988991 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e2004-2a81-4bc8-977f-614eb96518e9 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:12.989606 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e2004-2a81-4bc8-977f-614eb96518e9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:12.989915 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e2004-2a81-4bc8-977f-614eb96518e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:12.991933 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e2004-2a81-4bc8-977f-614eb96518e9 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:13.003727 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 428/867] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Jul 12 14:22:12 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:13.006018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50447e61-b8d2-4671-8cd5-6864e30dadfc None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:13.006340 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50447e61-b8d2-4671-8cd5-6864e30dadfc None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:13.007236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50447e61-b8d2-4671-8cd5-6864e30dadfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:13.027028 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-50447e61-b8d2-4671-8cd5-6864e30dadfc None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:13.028649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-50447e61-b8d2-4671-8cd5-6864e30dadfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:13.034148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbf388-94df-46c2-85ce-2f8c26c80007 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:13.082645 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0e954-89cf-419e-929b-eb744fb79f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:13.083694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0e954-89cf-419e-929b-eb744fb79f43 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:13.083991 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0e954-89cf-419e-929b-eb744fb79f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:13.084275 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0e954-89cf-419e-929b-eb744fb79f43 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:13.085280 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0e954-89cf-419e-929b-eb744fb79f43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:13.085715 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0e954-89cf-419e-929b-eb744fb79f43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:13.087134 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0e954-89cf-419e-929b-eb744fb79f43 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:13.107436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 440/868] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:13.110069 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0e954-89cf-419e-929b-eb744fb79f43 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:13.118874 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 429/869] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:13.142702 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50447e61-b8d2-4671-8cd5-6864e30dadfc None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:13.204759 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:13.232604 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0e954-89cf-419e-929b-eb744fb79f43 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:13.276951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50447e61-b8d2-4671-8cd5-6864e30dadfc None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:13.279123 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:13.283765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed3d12-033a-4427-a3c0-487b15374b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:13.284795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed3d12-033a-4427-a3c0-487b15374b58 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:13.285226 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed3d12-033a-4427-a3c0-487b15374b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:13.285713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed3d12-033a-4427-a3c0-487b15374b58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:13.295623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed3d12-033a-4427-a3c0-487b15374b58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:13.297675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed3d12-033a-4427-a3c0-487b15374b58 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:13.315898 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a92dce-1d4f-4c0f-9430-8d19569b74b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:13.316693 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a92dce-1d4f-4c0f-9430-8d19569b74b3 None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:13.317083 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a92dce-1d4f-4c0f-9430-8d19569b74b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:13.317450 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a92dce-1d4f-4c0f-9430-8d19569b74b3 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:13.317663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-90ed3d12-033a-4427-a3c0-487b15374b58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:13.317663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:13.317663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:13.317663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:13.317663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:13.317663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:13.317663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:13.317663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:13.317663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:13.317663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:13.317663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:13.317663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:13.317663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:22:13.317663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:22:13.317663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:22:13.318675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:22:13.318675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:13.318675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:13.318675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:13.318675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:13.318675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:13.318675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:13.318675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:13.318675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:13.318675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:13.318675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:13.318675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:13.318675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:13.318675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:13.318675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:13.318675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:13.318675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:13.320315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:22:13.320315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:22:13.320315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:22:13.320315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:22:13.320315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:22:13.320315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:22:13.320315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:13.320315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:13.321283 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a92dce-1d4f-4c0f-9430-8d19569b74b3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:13.327132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a92dce-1d4f-4c0f-9430-8d19569b74b3 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:13.327375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 441/870] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:13.328460 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed3d12-033a-4427-a3c0-487b15374b58 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:13.402792 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 430/871] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Jul 12 14:22:13 2022] POST /identity/v3/services => generated 251 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:22:13.452707 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed3d12-033a-4427-a3c0-487b15374b58 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:13.496041 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:13.503700 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9814f5f-6eb5-4055-b873-7baaa0de3d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:13.504458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9814f5f-6eb5-4055-b873-7baaa0de3d69 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:13.504748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9814f5f-6eb5-4055-b873-7baaa0de3d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:13.505084 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9814f5f-6eb5-4055-b873-7baaa0de3d69 None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:13.505929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9814f5f-6eb5-4055-b873-7baaa0de3d69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:13.506250 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9814f5f-6eb5-4055-b873-7baaa0de3d69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:13.511340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9814f5f-6eb5-4055-b873-7baaa0de3d69 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:13.525554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 442/872] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:22:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:13.535310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a92dce-1d4f-4c0f-9430-8d19569b74b3 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:13.652029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a92dce-1d4f-4c0f-9430-8d19569b74b3 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:13.693082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c50de6-80c6-4934-8e41-6b902f58d6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:13.693673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c50de6-80c6-4934-8e41-6b902f58d6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:13.693982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c50de6-80c6-4934-8e41-6b902f58d6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:13.694260 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c50de6-80c6-4934-8e41-6b902f58d6f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:13.695106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c50de6-80c6-4934-8e41-6b902f58d6f0 None admin] RBAC: Adding query filter params (role.id=c6f0b65d6ea5449ca79744ac52243ba2, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=5ec758ef106b49f4985845b3c106f94b) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:13.695451 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c50de6-80c6-4934-8e41-6b902f58d6f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:13.697534 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c50de6-80c6-4934-8e41-6b902f58d6f0 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:13.699401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:13.705230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 431/873] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:22:13 2022] GET /identity/v3/role_assignments?user.id=5ec758ef106b49f4985845b3c106f94b&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=c6f0b65d6ea5449ca79744ac52243ba2 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:14.450572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80007db1-de43-40d4-a52f-687fcf6c80df None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:14.451326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80007db1-de43-40d4-a52f-687fcf6c80df None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:14.451326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80007db1-de43-40d4-a52f-687fcf6c80df None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:14.452783 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 443/874] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:14.458172 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4647-455a-40cb-b632-418154145950 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:14.458469 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4647-455a-40cb-b632-418154145950 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:14.458753 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4647-455a-40cb-b632-418154145950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:14.476024 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-bb6d4647-455a-40cb-b632-418154145950 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:14.477226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-bb6d4647-455a-40cb-b632-418154145950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:14.551457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 432/875] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:14 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:14.570145 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80007db1-de43-40d4-a52f-687fcf6c80df None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:14.676146 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80007db1-de43-40d4-a52f-687fcf6c80df None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:14.712773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41412d-bd29-45f7-8a96-ec37c057068e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:14.713667 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41412d-bd29-45f7-8a96-ec37c057068e None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:14.713952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41412d-bd29-45f7-8a96-ec37c057068e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:14.714229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41412d-bd29-45f7-8a96-ec37c057068e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:14.714898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41412d-bd29-45f7-8a96-ec37c057068e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:14.716331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41412d-bd29-45f7-8a96-ec37c057068e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:14.729610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-9a41412d-bd29-45f7-8a96-ec37c057068e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:22:14.729610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:14.729610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:14.729610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:14.729610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:14.729610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:14.729610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:14.729610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:14.729610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:22:14.729610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:14.729610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:14.729610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:14.729610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:14.729610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:14.729610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:14.729610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:14.729610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:14.732047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:14.732047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:14.732047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:14.732047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:14.732047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:14.732047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:14.732047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:14.732047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:14.732047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:14.732047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:14.732047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:14.732047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:14.732047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:14.732047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:14.732047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:14.732047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:14.734065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:14.734065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:14.734065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:14.734065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:14.734065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:14.734065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:14.734065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:14.734065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:14.734065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:14.734065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:14.734065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:14.734065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:14.734065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:22:14.734065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:14.734065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 444/876] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Jul 12 14:22:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:14.739298 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d4647-455a-40cb-b632-418154145950 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:14.959697 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d4647-455a-40cb-b632-418154145950 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:14.994209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:15.002548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7521d2-1fce-4425-8c5d-5f261283e09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:15.003220 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7521d2-1fce-4425-8c5d-5f261283e09e None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:15.003529 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7521d2-1fce-4425-8c5d-5f261283e09e None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:15.003806 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7521d2-1fce-4425-8c5d-5f261283e09e None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:15.004521 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7521d2-1fce-4425-8c5d-5f261283e09e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:15.004821 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7521d2-1fce-4425-8c5d-5f261283e09e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:15.006185 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7521d2-1fce-4425-8c5d-5f261283e09e None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:15.011977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 433/877] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Jul 12 14:22:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:15.017691 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41412d-bd29-45f7-8a96-ec37c057068e None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:15.074472 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:15.119955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41412d-bd29-45f7-8a96-ec37c057068e None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:15.153798 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c6763-9961-409b-b1c7-6a8510549afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:15.154552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c6763-9961-409b-b1c7-6a8510549afc None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:15.154840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c6763-9961-409b-b1c7-6a8510549afc None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:15.155119 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c6763-9961-409b-b1c7-6a8510549afc None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:15.155932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c6763-9961-409b-b1c7-6a8510549afc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:15.156238 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c6763-9961-409b-b1c7-6a8510549afc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:15.157306 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95565d03-a58f-4fc8-a724-c9636d507219 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:15.157598 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c6763-9961-409b-b1c7-6a8510549afc None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:15.157709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95565d03-a58f-4fc8-a724-c9636d507219 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:15.158022 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95565d03-a58f-4fc8-a724-c9636d507219 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:15.159756 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 434/878] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:15.163248 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 445/879] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Jul 12 14:22:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:15.165306 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e385a-13a8-4f4c-8cc9-5db958b53468 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:15.165673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e385a-13a8-4f4c-8cc9-5db958b53468 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:15.166029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e385a-13a8-4f4c-8cc9-5db958b53468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:15.190321 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-6f9e385a-13a8-4f4c-8cc9-5db958b53468 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:15.191784 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-6f9e385a-13a8-4f4c-8cc9-5db958b53468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:15.279236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 435/880] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:15.302725 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c6763-9961-409b-b1c7-6a8510549afc None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:15.415644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c6763-9961-409b-b1c7-6a8510549afc None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:15.433960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:15.452177 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa333aef-8b7d-430f-9d84-924692cdd11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:15.459818 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa333aef-8b7d-430f-9d84-924692cdd11c None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:15.459818 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa333aef-8b7d-430f-9d84-924692cdd11c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:15.459818 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa333aef-8b7d-430f-9d84-924692cdd11c None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:15.459818 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa333aef-8b7d-430f-9d84-924692cdd11c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:15.459818 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa333aef-8b7d-430f-9d84-924692cdd11c None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:15.548836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 446/881] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Jul 12 14:22:15 2022] POST /identity/v3/services => generated 269 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:22:15.758331 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9a2ac-2657-49ca-b28c-d8a50468cd92 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:15.758331 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9a2ac-2657-49ca-b28c-d8a50468cd92 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:15.758331 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9a2ac-2657-49ca-b28c-d8a50468cd92 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:15.759258 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 436/882] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:15.766413 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a7be4-5e5b-4bc8-8267-2f76be5281c9 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:15.766413 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a7be4-5e5b-4bc8-8267-2f76be5281c9 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:15.766413 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a7be4-5e5b-4bc8-8267-2f76be5281c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:15.783069 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-394a7be4-5e5b-4bc8-8267-2f76be5281c9 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:15.784607 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-394a7be4-5e5b-4bc8-8267-2f76be5281c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:15.863023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 447/883] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:15.887084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9a2ac-2657-49ca-b28c-d8a50468cd92 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:15.895064 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe40d40-7f3a-451e-87da-76c4e4ce6929 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:15.895507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe40d40-7f3a-451e-87da-76c4e4ce6929 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:15.895788 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe40d40-7f3a-451e-87da-76c4e4ce6929 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:15.898365 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 448/884] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:22:15.903847 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3029c-79c9-4fa2-91da-739553688a48 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:15.904142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3029c-79c9-4fa2-91da-739553688a48 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:15.904416 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3029c-79c9-4fa2-91da-739553688a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:15.922583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-f7b3029c-79c9-4fa2-91da-739553688a48 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:15.923818 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f7b3029c-79c9-4fa2-91da-739553688a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:15.993998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 449/885] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:22:16.003986 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9a2ac-2657-49ca-b28c-d8a50468cd92 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:16.017217 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3029c-79c9-4fa2-91da-739553688a48 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:16.035128 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:16.052785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0487b6c-be8f-4826-9c27-1dec155bfb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:16.054741 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0487b6c-be8f-4826-9c27-1dec155bfb8a None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:16.055124 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0487b6c-be8f-4826-9c27-1dec155bfb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:16.055430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0487b6c-be8f-4826-9c27-1dec155bfb8a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:16.056369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0487b6c-be8f-4826-9c27-1dec155bfb8a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:16.059835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0487b6c-be8f-4826-9c27-1dec155bfb8a None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:16.061825 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:16.074443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-b0487b6c-be8f-4826-9c27-1dec155bfb8a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 14:22:16.074443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:16.074443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:16.074443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:16.074443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:16.074443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:16.074443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:16.074443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:16.074443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 14:22:16.074443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:16.074443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:16.074443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:16.074443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:16.074443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:16.074443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:16.074443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:16.074443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:16.081394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:16.081394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:16.081394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:16.081394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:16.081394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:16.081394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:16.081394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:16.081394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:16.081394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:16.081394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:16.081394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:16.081394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:16.081394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:16.081394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:16.081394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:16.081394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:16.082231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:16.082231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:16.082231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:16.082231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:16.082231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:16.082231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:16.082231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:16.082231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:16.082231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:16.082231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:16.082231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:16.082231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:16.082231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 14:22:16.082231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:16.082231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 437/886] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:22:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:16.084878 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0487b6c-be8f-4826-9c27-1dec155bfb8a None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:16.148856 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3029c-79c9-4fa2-91da-739553688a48 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:16.192607 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de475c-e8cd-470c-85ef-220d7e70fa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:16.195925 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de475c-e8cd-470c-85ef-220d7e70fa52 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:16.196872 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de475c-e8cd-470c-85ef-220d7e70fa52 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:16.197557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de475c-e8cd-470c-85ef-220d7e70fa52 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:16.212777 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de475c-e8cd-470c-85ef-220d7e70fa52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:16.221017 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0487b6c-be8f-4826-9c27-1dec155bfb8a None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:16.224839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-a3de475c-e8cd-470c-85ef-220d7e70fa52 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:22:16.224839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:16.224839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:16.224839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:16.224839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:16.224839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:16.224839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:16.224839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:16.224839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:16.224839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:16.224839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:16.224839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:16.224839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:16.224839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:16.224839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:16.224839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:16.225795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:16.225795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:16.225795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:16.225795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:16.225795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:16.225795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:16.225795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:16.225795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:16.225795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:16.225795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:16.225795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:16.225795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:16.225795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:16.225795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:16.225795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:16.225795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:16.226749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:16.226749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:16.226749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:16.226749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:16.226749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:16.226749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:16.226749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:16.226749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:16.226749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:16.226749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:16.226749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:22:16.226749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:16.230089 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 450/887] 10.222.0.40 () {56 vars in 1120 bytes} [Tue Jul 12 14:22:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:16.242088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de475c-e8cd-470c-85ef-220d7e70fa52 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:16.273673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da620c-4a3f-41d8-bf74-d1b0eba7e9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:16.274338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da620c-4a3f-41d8-bf74-d1b0eba7e9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:16.274621 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da620c-4a3f-41d8-bf74-d1b0eba7e9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:16.274898 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da620c-4a3f-41d8-bf74-d1b0eba7e9b3 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:16.275646 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da620c-4a3f-41d8-bf74-d1b0eba7e9b3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:16.275953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da620c-4a3f-41d8-bf74-d1b0eba7e9b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:16.277514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da620c-4a3f-41d8-bf74-d1b0eba7e9b3 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:16.286980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 438/888] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:22:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:16.288717 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da620c-4a3f-41d8-bf74-d1b0eba7e9b3 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:16.347076 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:16.380839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:16.388150 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de475c-e8cd-470c-85ef-220d7e70fa52 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:16.415355 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da620c-4a3f-41d8-bf74-d1b0eba7e9b3 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:16.424392 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f70724-bbcc-42d1-aa1d-f619e1eaa157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:16.425352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f70724-bbcc-42d1-aa1d-f619e1eaa157 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:16.425861 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f70724-bbcc-42d1-aa1d-f619e1eaa157 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:16.426343 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f70724-bbcc-42d1-aa1d-f619e1eaa157 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:16.427309 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f70724-bbcc-42d1-aa1d-f619e1eaa157 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:16.427846 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f70724-bbcc-42d1-aa1d-f619e1eaa157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:16.429973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f70724-bbcc-42d1-aa1d-f619e1eaa157 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:16.438969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 451/889] 10.222.0.40 () {56 vars in 1115 bytes} [Tue Jul 12 14:22:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:16.447345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f70724-bbcc-42d1-aa1d-f619e1eaa157 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:16.451700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554845d0-6edf-4512-9f5a-2ade324d36a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:16.452638 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554845d0-6edf-4512-9f5a-2ade324d36a6 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:16.453135 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554845d0-6edf-4512-9f5a-2ade324d36a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:16.453626 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554845d0-6edf-4512-9f5a-2ade324d36a6 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:16.454531 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554845d0-6edf-4512-9f5a-2ade324d36a6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:16.455026 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554845d0-6edf-4512-9f5a-2ade324d36a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:16.456728 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554845d0-6edf-4512-9f5a-2ade324d36a6 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:16.462649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 439/890] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:22:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:16.469759 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554845d0-6edf-4512-9f5a-2ade324d36a6 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:16.566272 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f70724-bbcc-42d1-aa1d-f619e1eaa157 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:16.598112 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554845d0-6edf-4512-9f5a-2ade324d36a6 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:16.602951 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a2dc5-2858-4b84-a12a-36183e4a67c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:16.603858 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a2dc5-2858-4b84-a12a-36183e4a67c6 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:16.604229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a2dc5-2858-4b84-a12a-36183e4a67c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:16.604576 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a2dc5-2858-4b84-a12a-36183e4a67c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:16.613583 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:16.616409 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a2dc5-2858-4b84-a12a-36183e4a67c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:16.618013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a2dc5-2858-4b84-a12a-36183e4a67c6 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:16.636935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-524a2dc5-2858-4b84-a12a-36183e4a67c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:16.636935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:16.636935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:16.636935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:16.636935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:16.636935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:16.636935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:16.636935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:16.636935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:16.636935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:16.636935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:16.636935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:16.636935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:16.636935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:16.636935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:16.638166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:16.638166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:16.638166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:16.638166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:16.638166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:16.638166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:16.638166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:16.638166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:16.638166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:16.638166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:16.638166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:16.638166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:16.638166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:16.638166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:16.638166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:16.638166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:16.638166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:16.639237 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:16.639237 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:16.639237 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:16.639237 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:16.639804 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e0659-539a-4571-8240-a635103604c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:16.640637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e0659-539a-4571-8240-a635103604c9 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:16.641074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e0659-539a-4571-8240-a635103604c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:16.641500 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e0659-539a-4571-8240-a635103604c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:16.642494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e0659-539a-4571-8240-a635103604c9 None admin] RBAC: Adding query filter params (interface=public, service_id=adedc3f1d7a34a3da7fc89e5c6171891, region_id=RegionOne) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:16.642960 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e0659-539a-4571-8240-a635103604c9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:16.643794 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 452/891] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:16.644522 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a2dc5-2858-4b84-a12a-36183e4a67c6 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:16.646180 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e0659-539a-4571-8240-a635103604c9 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:16.652548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 440/892] 10.222.0.40 () {56 vars in 1251 bytes} [Tue Jul 12 14:22:16 2022] GET /identity/v3/endpoints?service_id=adedc3f1d7a34a3da7fc89e5c6171891&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:16.657643 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e0659-539a-4571-8240-a635103604c9 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:16.661589 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:16.759356 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a2dc5-2858-4b84-a12a-36183e4a67c6 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:16.768411 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e0659-539a-4571-8240-a635103604c9 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:16.798191 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54346d-2c9d-468e-b8e1-2ce39fb76871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:16.799154 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54346d-2c9d-468e-b8e1-2ce39fb76871 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:16.799761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54346d-2c9d-468e-b8e1-2ce39fb76871 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:16.800239 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54346d-2c9d-468e-b8e1-2ce39fb76871 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:16.801207 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54346d-2c9d-468e-b8e1-2ce39fb76871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:16.801697 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54346d-2c9d-468e-b8e1-2ce39fb76871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:16.803463 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54346d-2c9d-468e-b8e1-2ce39fb76871 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:16.805754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa44cc0-671d-4028-9625-c871ed0090f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:16.806865 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa44cc0-671d-4028-9625-c871ed0090f6 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:16.806865 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa44cc0-671d-4028-9625-c871ed0090f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:16.807203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa44cc0-671d-4028-9625-c871ed0090f6 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:16.808014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa44cc0-671d-4028-9625-c871ed0090f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:16.809427 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa44cc0-671d-4028-9625-c871ed0090f6 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:16.822344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 453/894] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:16.823505 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 441/894] 10.222.0.40 () {56 vars in 1087 bytes} [Tue Jul 12 14:22:16 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:22:16.824392 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54346d-2c9d-468e-b8e1-2ce39fb76871 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:16.903690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:16.939217 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54346d-2c9d-468e-b8e1-2ce39fb76871 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:16.978060 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92130e0-4e4f-4a4a-a646-576105db1476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:16.978875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92130e0-4e4f-4a4a-a646-576105db1476 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:16.979158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92130e0-4e4f-4a4a-a646-576105db1476 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:16.979465 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92130e0-4e4f-4a4a-a646-576105db1476 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:16.987080 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92130e0-4e4f-4a4a-a646-576105db1476 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:16.988558 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92130e0-4e4f-4a4a-a646-576105db1476 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:17.005023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-a92130e0-4e4f-4a4a-a646-576105db1476 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:22:17.005023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:17.005023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:17.005023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:17.005023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:17.005023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:17.005023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:17.005023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:17.005023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:17.005023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:17.005023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:17.005023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:17.005023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:22:17.005023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:22:17.005023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:22:17.005023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:22:17.005994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:17.005994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:17.005994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:22:17.005994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:17.005994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:22:17.005994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:17.005994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:17.005994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:17.005994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:17.005994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:17.005994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:17.005994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:17.005994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:17.005994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:17.005994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:17.005994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:17.005994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:17.005994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:17.006969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:17.006969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:17.006969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:22:17.006969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:22:17.006969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:22:17.006969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:22:17.006969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:22:17.006969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:22:17.006969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:22:17.006969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:17.006969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 454/895] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Jul 12 14:22:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:17.012549 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa44cc0-671d-4028-9625-c871ed0090f6 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:17.066954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:17.128059 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa44cc0-671d-4028-9625-c871ed0090f6 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:17.163911 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63359ce4-ae32-4858-af49-096bc633a078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:17.164982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63359ce4-ae32-4858-af49-096bc633a078 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:17.165481 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63359ce4-ae32-4858-af49-096bc633a078 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:17.165961 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63359ce4-ae32-4858-af49-096bc633a078 None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:17.167007 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63359ce4-ae32-4858-af49-096bc633a078 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:17.167555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63359ce4-ae32-4858-af49-096bc633a078 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:17.169183 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63359ce4-ae32-4858-af49-096bc633a078 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:17.188734 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 442/896] 10.222.0.40 () {56 vars in 1149 bytes} [Tue Jul 12 14:22:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:17.199400 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92130e0-4e4f-4a4a-a646-576105db1476 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:17.306465 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92130e0-4e4f-4a4a-a646-576105db1476 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:17.317366 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7bdcc-b8dd-42d0-bf58-6d6804d0c3a5 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:17.317668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7bdcc-b8dd-42d0-bf58-6d6804d0c3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:17.317935 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7bdcc-b8dd-42d0-bf58-6d6804d0c3a5 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:17.319894 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 443/897] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:17.325361 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e5f60-1a5b-47ec-9125-1ad92b3f2d41 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:17.325652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e5f60-1a5b-47ec-9125-1ad92b3f2d41 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:17.325935 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e5f60-1a5b-47ec-9125-1ad92b3f2d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:17.336926 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:17.346528 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c3ad7-9f11-4e94-bf3c-aeb627f95da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:17.350890 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c3ad7-9f11-4e94-bf3c-aeb627f95da4 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:17.350890 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c3ad7-9f11-4e94-bf3c-aeb627f95da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:17.350890 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c3ad7-9f11-4e94-bf3c-aeb627f95da4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:17.353241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-445e5f60-1a5b-47ec-9125-1ad92b3f2d41 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:17.354679 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-445e5f60-1a5b-47ec-9125-1ad92b3f2d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:17.430012 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c3ad7-9f11-4e94-bf3c-aeb627f95da4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:17.431647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c3ad7-9f11-4e94-bf3c-aeb627f95da4 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:17.455436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 444/898] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:17.477387 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e5f60-1a5b-47ec-9125-1ad92b3f2d41 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:17.511108 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:17.576568 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 455/899] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:22:17 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:22:17.582578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c3ad7-9f11-4e94-bf3c-aeb627f95da4 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:17.591389 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e5f60-1a5b-47ec-9125-1ad92b3f2d41 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:17.615067 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:17.636647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41e9cd-8c0c-4247-8444-1ca20d3ffe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:17.637506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41e9cd-8c0c-4247-8444-1ca20d3ffe77 None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:17.637876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41e9cd-8c0c-4247-8444-1ca20d3ffe77 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:17.638295 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41e9cd-8c0c-4247-8444-1ca20d3ffe77 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:17.639134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41e9cd-8c0c-4247-8444-1ca20d3ffe77 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:17.640748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41e9cd-8c0c-4247-8444-1ca20d3ffe77 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:17.696312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c3ad7-9f11-4e94-bf3c-aeb627f95da4 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:17.726219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 445/900] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Jul 12 14:22:17 2022] POST /identity/v3/services => generated 241 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:22:17.727620 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7854928-7933-45be-a35c-96c57da31f67 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:17.727915 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7854928-7933-45be-a35c-96c57da31f67 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:17.728226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7854928-7933-45be-a35c-96c57da31f67 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:17.729628 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 446/901] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:17.735151 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba091b-6d5b-406f-8151-e186c2f3e769 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:17.735528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba091b-6d5b-406f-8151-e186c2f3e769 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:17.735779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba091b-6d5b-406f-8151-e186c2f3e769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:17.745277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e4b59-73d2-4641-b152-315659029726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:17.746470 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e4b59-73d2-4641-b152-315659029726 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:17.746756 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e4b59-73d2-4641-b152-315659029726 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:17.747031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e4b59-73d2-4641-b152-315659029726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:17.759436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e4b59-73d2-4641-b152-315659029726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:17.760021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-e8ba091b-6d5b-406f-8151-e186c2f3e769 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:17.760894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e4b59-73d2-4641-b152-315659029726 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:17.762118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-e8ba091b-6d5b-406f-8151-e186c2f3e769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:17.781616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-5d8e4b59-73d2-4641-b152-315659029726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:17.781616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:17.781616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:17.781616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:17.781616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:17.781616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:17.781616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:17.781616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:17.781616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:17.781616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:17.781616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:17.781616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:17.781616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:17.781616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:17.781616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:17.782579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:17.782579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:17.782579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:17.782579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:17.782579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:17.782579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:17.782579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:17.782579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:17.782579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:17.782579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:17.782579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:17.782579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:17.782579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:17.782579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:17.782579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:17.782579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:17.782579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:17.784183 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:17.784183 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:17.784183 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:17.784183 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:17.788376 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 456/902] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:17.789388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e4b59-73d2-4641-b152-315659029726 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:17.846774 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 447/903] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:22:17.871860 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba091b-6d5b-406f-8151-e186c2f3e769 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:17.882835 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:17.899454 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:17.910991 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e4b59-73d2-4641-b152-315659029726 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:17.961315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c3370-a6f8-4715-b3df-e4b00263982c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:17.961991 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c3370-a6f8-4715-b3df-e4b00263982c None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:17.962278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c3370-a6f8-4715-b3df-e4b00263982c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:17.962556 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c3370-a6f8-4715-b3df-e4b00263982c None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:17.963396 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c3370-a6f8-4715-b3df-e4b00263982c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:17.963711 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c3370-a6f8-4715-b3df-e4b00263982c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:17.966800 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c3370-a6f8-4715-b3df-e4b00263982c None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:17.978235 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 457/904] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:17.984859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c3370-a6f8-4715-b3df-e4b00263982c None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:18.005754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba091b-6d5b-406f-8151-e186c2f3e769 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:18.045104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a6137-f33c-42af-aa10-9938062786e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:18.046229 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a6137-f33c-42af-aa10-9938062786e9 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:18.046574 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a6137-f33c-42af-aa10-9938062786e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:18.046851 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a6137-f33c-42af-aa10-9938062786e9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:18.047599 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a6137-f33c-42af-aa10-9938062786e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:18.049017 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a6137-f33c-42af-aa10-9938062786e9 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:18.062382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-bc0a6137-f33c-42af-aa10-9938062786e9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 14:22:18.062382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:18.062382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:18.062382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:18.062382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:18.062382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:18.062382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:18.062382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:18.062382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 14:22:18.062382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:18.062382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:18.062382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:18.062382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:18.062382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:18.062382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:18.062382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:18.063437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:18.063437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:18.063437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:18.063437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:18.063437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:18.063437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:18.063437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:18.063437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:18.063437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:18.063437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:18.063437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:18.063437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:18.063437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:18.063437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:18.063437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:18.063437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:18.064308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:18.064308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:18.064308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:18.064308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:18.064308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:18.064308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:18.064308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:18.064308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:18.064308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:18.064308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:18.064308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:18.064308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:18.064308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:18.064308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 14:22:18.064308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:18.068959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 448/905] 10.222.0.40 () {56 vars in 1132 bytes} [Tue Jul 12 14:22:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:18.069907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a6137-f33c-42af-aa10-9938062786e9 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:18.119176 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c3370-a6f8-4715-b3df-e4b00263982c None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:18.162187 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:18.173833 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4d9dd-9717-46f0-a2cc-c3a359a0a7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:18.175421 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4d9dd-9717-46f0-a2cc-c3a359a0a7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:18.176112 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4d9dd-9717-46f0-a2cc-c3a359a0a7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:18.181524 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4d9dd-9717-46f0-a2cc-c3a359a0a7e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:18.181524 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:18.182281 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a6137-f33c-42af-aa10-9938062786e9 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:18.186741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4d9dd-9717-46f0-a2cc-c3a359a0a7e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:18.188419 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4d9dd-9717-46f0-a2cc-c3a359a0a7e3 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:18.207054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-36e4d9dd-9717-46f0-a2cc-c3a359a0a7e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:18.207054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:18.207054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:18.207054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:18.207054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:18.207054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:18.207054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:18.207054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:18.207054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:18.207054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:18.207054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:18.207054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:18.207054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:22:18.207054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:22:18.207054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:22:18.208124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:22:18.208124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:18.208124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:18.208124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:18.208124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:18.208124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:18.208124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:18.208124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:18.208124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:18.208124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:18.208124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:18.208124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:18.208124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:18.208124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:18.208124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:18.208124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:18.208124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:18.208999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:22:18.208999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:22:18.208999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:22:18.208999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:22:18.208999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:22:18.208999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:22:18.208999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:18.208999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:18.208999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 458/906] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:18.216348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4d9dd-9717-46f0-a2cc-c3a359a0a7e3 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:18.228095 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788f692-3839-49ec-970b-d6c1ea459699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:18.228978 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788f692-3839-49ec-970b-d6c1ea459699 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:18.229429 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788f692-3839-49ec-970b-d6c1ea459699 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:18.229882 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788f692-3839-49ec-970b-d6c1ea459699 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:18.230667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788f692-3839-49ec-970b-d6c1ea459699 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:18.230980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788f692-3839-49ec-970b-d6c1ea459699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:18.232444 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788f692-3839-49ec-970b-d6c1ea459699 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:18.238421 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 449/907] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Jul 12 14:22:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:18.244622 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788f692-3839-49ec-970b-d6c1ea459699 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:18.353859 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788f692-3839-49ec-970b-d6c1ea459699 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:18.358512 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4d9dd-9717-46f0-a2cc-c3a359a0a7e3 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:18.395695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dfe33-5fa4-4ddf-bab7-6518ea7783c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:18.396746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dfe33-5fa4-4ddf-bab7-6518ea7783c0 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:18.397829 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dfe33-5fa4-4ddf-bab7-6518ea7783c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:18.398311 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dfe33-5fa4-4ddf-bab7-6518ea7783c0 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:18.399269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dfe33-5fa4-4ddf-bab7-6518ea7783c0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:18.399800 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dfe33-5fa4-4ddf-bab7-6518ea7783c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:18.400242 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c11a92-9430-40c9-8c52-3d5cf0125c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:18.400912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c11a92-9430-40c9-8c52-3d5cf0125c9b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:18.401197 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c11a92-9430-40c9-8c52-3d5cf0125c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:18.401474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c11a92-9430-40c9-8c52-3d5cf0125c9b None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:18.402264 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c11a92-9430-40c9-8c52-3d5cf0125c9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:18.402537 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dfe33-5fa4-4ddf-bab7-6518ea7783c0 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:18.402655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c11a92-9430-40c9-8c52-3d5cf0125c9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:18.403999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c11a92-9430-40c9-8c52-3d5cf0125c9b None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:18.408989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 450/908] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Jul 12 14:22:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:18.415799 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dfe33-5fa4-4ddf-bab7-6518ea7783c0 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:18.426814 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 459/909] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:22:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:18.428735 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c11a92-9430-40c9-8c52-3d5cf0125c9b None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:18.436815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:18.492177 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:18.550989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dfe33-5fa4-4ddf-bab7-6518ea7783c0 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:18.552840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c11a92-9430-40c9-8c52-3d5cf0125c9b None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:18.590672 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3377c6-793c-4b21-b290-7a6d6e4d2afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:18.591463 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3377c6-793c-4b21-b290-7a6d6e4d2afe None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:18.591630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3377c6-793c-4b21-b290-7a6d6e4d2afe None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:18.591904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3377c6-793c-4b21-b290-7a6d6e4d2afe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:18.592625 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2dbb4a-b901-4c36-b86e-1a1ea60c0399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:18.592757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3377c6-793c-4b21-b290-7a6d6e4d2afe None admin] RBAC: Adding query filter params (role.id=89b4a0107e1f484683ef23398bfcb722, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=5ec758ef106b49f4985845b3c106f94b) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:18.593029 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3377c6-793c-4b21-b290-7a6d6e4d2afe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:18.593827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2dbb4a-b901-4c36-b86e-1a1ea60c0399 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:18.594308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2dbb4a-b901-4c36-b86e-1a1ea60c0399 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:18.594475 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3377c6-793c-4b21-b290-7a6d6e4d2afe None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:18.594949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2dbb4a-b901-4c36-b86e-1a1ea60c0399 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:18.595968 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2dbb4a-b901-4c36-b86e-1a1ea60c0399 None admin] RBAC: Adding query filter params (interface=public, service_id=4f0b2e8f57534dee85e0bdbab8edaa0d, region_id=RegionOne) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:18.596550 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2dbb4a-b901-4c36-b86e-1a1ea60c0399 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:18.598981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2dbb4a-b901-4c36-b86e-1a1ea60c0399 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:18.607557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 460/910] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:22:18 2022] GET /identity/v3/role_assignments?user.id=5ec758ef106b49f4985845b3c106f94b&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=89b4a0107e1f484683ef23398bfcb722 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:18.613093 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 451/911] 10.222.0.40 () {56 vars in 1251 bytes} [Tue Jul 12 14:22:18 2022] GET /identity/v3/endpoints?service_id=4f0b2e8f57534dee85e0bdbab8edaa0d&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:18.618323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3377c6-793c-4b21-b290-7a6d6e4d2afe None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:18.737358 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3377c6-793c-4b21-b290-7a6d6e4d2afe None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:18.760582 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:18.776578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27027fe1-eaf9-4749-932c-37cfbcd984ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:18.777305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27027fe1-eaf9-4749-932c-37cfbcd984ec None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:18.777593 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27027fe1-eaf9-4749-932c-37cfbcd984ec None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:18.777867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27027fe1-eaf9-4749-932c-37cfbcd984ec None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:18.778565 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27027fe1-eaf9-4749-932c-37cfbcd984ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:18.779978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27027fe1-eaf9-4749-932c-37cfbcd984ec None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:18.788705 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 461/912] 10.222.0.40 () {56 vars in 1087 bytes} [Tue Jul 12 14:22:18 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:22:19.003829 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861693c9-6da1-4139-8b44-0e4edbeba927 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:19.004330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861693c9-6da1-4139-8b44-0e4edbeba927 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:19.004330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861693c9-6da1-4139-8b44-0e4edbeba927 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:19.005982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 452/913] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:19.012257 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511f364-6767-4876-9090-f5bb46ac4d81 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:19.012542 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511f364-6767-4876-9090-f5bb46ac4d81 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:19.012824 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511f364-6767-4876-9090-f5bb46ac4d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:19.029775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-9511f364-6767-4876-9090-f5bb46ac4d81 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:19.030955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-9511f364-6767-4876-9090-f5bb46ac4d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:19.120219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 462/914] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:19.142636 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861693c9-6da1-4139-8b44-0e4edbeba927 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:19.228631 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:19.256842 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861693c9-6da1-4139-8b44-0e4edbeba927 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:19.291128 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d03c0-eb28-42dd-a4c5-6672365e6f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:19.292342 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d03c0-eb28-42dd-a4c5-6672365e6f77 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:19.292910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d03c0-eb28-42dd-a4c5-6672365e6f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:19.293199 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d03c0-eb28-42dd-a4c5-6672365e6f77 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:19.294127 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d03c0-eb28-42dd-a4c5-6672365e6f77 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:19.296128 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d03c0-eb28-42dd-a4c5-6672365e6f77 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:19.309943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-c04d03c0-eb28-42dd-a4c5-6672365e6f77 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 14:22:19.309943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:19.309943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:19.309943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:19.309943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:19.309943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:19.309943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:19.309943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:19.309943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 14:22:19.309943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:19.309943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:19.309943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:19.309943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:19.309943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:19.309943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:19.309943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:19.309943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:19.310950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:19.310950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:19.310950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:19.310950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:19.310950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:19.310950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:19.310950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:19.310950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:19.310950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:19.310950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:19.310950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:19.310950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:19.310950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:19.310950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:19.310950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:19.310950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:19.311818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:19.311818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:19.311818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:19.311818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:19.311818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:19.311818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:19.311818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:19.311818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:19.311818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:19.311818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:19.311818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:19.311818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:19.311818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 14:22:19.311818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:19.311818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 453/915] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:22:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:19.319937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511f364-6767-4876-9090-f5bb46ac4d81 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:19.423576 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511f364-6767-4876-9090-f5bb46ac4d81 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:19.438488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:19.462042 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5b8f6-fad7-44e0-948c-3a5bce8bee4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:19.463073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5b8f6-fad7-44e0-948c-3a5bce8bee4b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:19.463593 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5b8f6-fad7-44e0-948c-3a5bce8bee4b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:19.464088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5b8f6-fad7-44e0-948c-3a5bce8bee4b None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:19.465001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5b8f6-fad7-44e0-948c-3a5bce8bee4b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:19.465500 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5b8f6-fad7-44e0-948c-3a5bce8bee4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:19.467046 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5b8f6-fad7-44e0-948c-3a5bce8bee4b None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:19.472515 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 463/916] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:22:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:19.478740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d03c0-eb28-42dd-a4c5-6672365e6f77 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:19.587585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d03c0-eb28-42dd-a4c5-6672365e6f77 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:19.624386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7af118-f5df-4431-8b02-84e729108103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:19.625063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7af118-f5df-4431-8b02-84e729108103 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:19.625350 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7af118-f5df-4431-8b02-84e729108103 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:19.625628 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7af118-f5df-4431-8b02-84e729108103 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:19.626351 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7af118-f5df-4431-8b02-84e729108103 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:19.626662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7af118-f5df-4431-8b02-84e729108103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:19.628050 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7af118-f5df-4431-8b02-84e729108103 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:19.635003 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 454/917] 10.222.0.40 () {56 vars in 1114 bytes} [Tue Jul 12 14:22:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:19.640695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5b8f6-fad7-44e0-948c-3a5bce8bee4b None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:19.743713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5b8f6-fad7-44e0-948c-3a5bce8bee4b None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:19.796247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33a41b-d0c8-40f6-9a43-be316b39c9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:19.797325 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33a41b-d0c8-40f6-9a43-be316b39c9b5 None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:19.797765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33a41b-d0c8-40f6-9a43-be316b39c9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:19.798187 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33a41b-d0c8-40f6-9a43-be316b39c9b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:19.799404 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33a41b-d0c8-40f6-9a43-be316b39c9b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:19.801574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33a41b-d0c8-40f6-9a43-be316b39c9b5 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:19.891974 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 464/918] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Jul 12 14:22:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:22:19.993570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7449ef0-7fb4-4289-bbda-8afd2dbcd155 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:19.993964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7449ef0-7fb4-4289-bbda-8afd2dbcd155 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:19.994154 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7449ef0-7fb4-4289-bbda-8afd2dbcd155 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:19.996182 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 455/919] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:20.002227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ea59f-a0a9-4426-a46a-84b468921756 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:20.002548 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ea59f-a0a9-4426-a46a-84b468921756 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:20.002786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ea59f-a0a9-4426-a46a-84b468921756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:20.022642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-960ea59f-a0a9-4426-a46a-84b468921756 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:20.023622 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-960ea59f-a0a9-4426-a46a-84b468921756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:20.057691 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:20.109242 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 465/920] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:20.132826 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7449ef0-7fb4-4289-bbda-8afd2dbcd155 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:20.137030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:20.244852 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7449ef0-7fb4-4289-bbda-8afd2dbcd155 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:20.279127 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7728e-63fe-4877-bd83-d190468d96c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:20.279973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7728e-63fe-4877-bd83-d190468d96c9 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:20.280258 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7728e-63fe-4877-bd83-d190468d96c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:20.280536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7728e-63fe-4877-bd83-d190468d96c9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:20.281197 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7728e-63fe-4877-bd83-d190468d96c9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:20.282559 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7728e-63fe-4877-bd83-d190468d96c9 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:20.295871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-30b7728e-63fe-4877-bd83-d190468d96c9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:22:20.295871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:20.295871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:20.295871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:20.295871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:20.295871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:20.295871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:20.295871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:20.295871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:22:20.295871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:20.295871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:20.295871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:20.295871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:20.295871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:20.295871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:20.295871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:20.295871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:20.296929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:20.296929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:20.296929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:20.296929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:20.296929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:20.296929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:20.296929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:20.296929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:20.296929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:20.296929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:20.296929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:20.296929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:20.296929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:20.296929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:20.296929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:20.296929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:20.297781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:20.297781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:20.297781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:20.297781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:20.297781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:20.297781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:20.297781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:20.297781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:20.297781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:20.297781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:20.297781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:20.297781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:20.297781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:22:20.297781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:20.297781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 456/921] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Jul 12 14:22:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:20.304155 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ea59f-a0a9-4426-a46a-84b468921756 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:20.409879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ea59f-a0a9-4426-a46a-84b468921756 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:20.447373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d924d0-838c-440a-a77d-65a40862a2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:20.448050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d924d0-838c-440a-a77d-65a40862a2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:20.448337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d924d0-838c-440a-a77d-65a40862a2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:20.448619 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d924d0-838c-440a-a77d-65a40862a2f8 None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:20.449339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d924d0-838c-440a-a77d-65a40862a2f8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:20.449646 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d924d0-838c-440a-a77d-65a40862a2f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:20.451017 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d924d0-838c-440a-a77d-65a40862a2f8 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:20.456733 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 466/922] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Jul 12 14:22:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:20.462979 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7728e-63fe-4877-bd83-d190468d96c9 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:20.535154 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:20.571982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7728e-63fe-4877-bd83-d190468d96c9 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:20.607367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04946b9-b824-431c-90a8-0fa8884ca6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:20.608050 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04946b9-b824-431c-90a8-0fa8884ca6fb None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:20.608336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04946b9-b824-431c-90a8-0fa8884ca6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:20.608618 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04946b9-b824-431c-90a8-0fa8884ca6fb None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:20.609344 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04946b9-b824-431c-90a8-0fa8884ca6fb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:20.609657 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04946b9-b824-431c-90a8-0fa8884ca6fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:20.611022 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04946b9-b824-431c-90a8-0fa8884ca6fb None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:20.617642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 457/923] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Jul 12 14:22:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:20.623826 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d924d0-838c-440a-a77d-65a40862a2f8 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:20.652251 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:20.731089 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d924d0-838c-440a-a77d-65a40862a2f8 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:20.767115 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3946ad5-382e-4ca1-a80f-40a1412acbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:20.767812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3946ad5-382e-4ca1-a80f-40a1412acbac None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:20.768091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3946ad5-382e-4ca1-a80f-40a1412acbac None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:20.768363 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3946ad5-382e-4ca1-a80f-40a1412acbac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:20.769150 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3946ad5-382e-4ca1-a80f-40a1412acbac None admin] RBAC: Adding query filter params (interface=public, service_id=48cfbf1da33e44b0b1980379cc0fd5e7, region_id=RegionOne) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:20.769460 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3946ad5-382e-4ca1-a80f-40a1412acbac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:20.770810 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3946ad5-382e-4ca1-a80f-40a1412acbac None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:20.779643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 467/924] 10.222.0.40 () {56 vars in 1251 bytes} [Tue Jul 12 14:22:20 2022] GET /identity/v3/endpoints?service_id=48cfbf1da33e44b0b1980379cc0fd5e7&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:20.784900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04946b9-b824-431c-90a8-0fa8884ca6fb None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:20.891956 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04946b9-b824-431c-90a8-0fa8884ca6fb None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:20.923605 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:20.928680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c6d56-70bc-45b5-8b52-b1fc13fcaa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:20.929365 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c6d56-70bc-45b5-8b52-b1fc13fcaa7e None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:20.929652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c6d56-70bc-45b5-8b52-b1fc13fcaa7e None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:20.929931 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c6d56-70bc-45b5-8b52-b1fc13fcaa7e None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:20.930634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c6d56-70bc-45b5-8b52-b1fc13fcaa7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:20.932066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c6d56-70bc-45b5-8b52-b1fc13fcaa7e None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:20.938794 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 458/925] 10.222.0.40 () {56 vars in 1087 bytes} [Tue Jul 12 14:22:20 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:22:20.950089 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142547da-9c4f-4e99-8316-d36cf8ffb5fe None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:20.950378 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142547da-9c4f-4e99-8316-d36cf8ffb5fe None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:20.950661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142547da-9c4f-4e99-8316-d36cf8ffb5fe None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:20.952357 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 468/926] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:20.958131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e689038-d974-4e56-a418-5ca0ece68275 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:20.958425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e689038-d974-4e56-a418-5ca0ece68275 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:20.958708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e689038-d974-4e56-a418-5ca0ece68275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:20.973034 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670faace-2fb7-4107-b74c-01c954072728 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:20.973371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670faace-2fb7-4107-b74c-01c954072728 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:20.973656 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670faace-2fb7-4107-b74c-01c954072728 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:20.976109 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 469/927] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:22:20.980924 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-3e689038-d974-4e56-a418-5ca0ece68275 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:20.982179 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-3e689038-d974-4e56-a418-5ca0ece68275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:20.982385 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783aa344-bf9c-4a3c-8771-5d6234f6f07d None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:20.982928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783aa344-bf9c-4a3c-8771-5d6234f6f07d None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:20.983451 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783aa344-bf9c-4a3c-8771-5d6234f6f07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:21.003074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-783aa344-bf9c-4a3c-8771-5d6234f6f07d None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:21.004664 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-783aa344-bf9c-4a3c-8771-5d6234f6f07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:21.070826 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 459/928] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:21.095011 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 470/929] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:22:21.095209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e689038-d974-4e56-a418-5ca0ece68275 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:21.120499 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783aa344-bf9c-4a3c-8771-5d6234f6f07d None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:21.148689 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:21.227818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e689038-d974-4e56-a418-5ca0ece68275 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:21.257137 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783aa344-bf9c-4a3c-8771-5d6234f6f07d None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:21.264142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:21.276241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67022d-2eeb-4389-9eb6-23eb5f4f0dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:21.277324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67022d-2eeb-4389-9eb6-23eb5f4f0dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:21.277764 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67022d-2eeb-4389-9eb6-23eb5f4f0dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:21.278184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67022d-2eeb-4389-9eb6-23eb5f4f0dc8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:21.293143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67022d-2eeb-4389-9eb6-23eb5f4f0dc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:21.294538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b717b-86f1-4209-abf7-b6914d558155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:21.295668 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b717b-86f1-4209-abf7-b6914d558155 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:21.296057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b717b-86f1-4209-abf7-b6914d558155 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:21.296429 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b717b-86f1-4209-abf7-b6914d558155 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:21.297189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b717b-86f1-4209-abf7-b6914d558155 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:21.298642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b717b-86f1-4209-abf7-b6914d558155 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:21.304567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-ad67022d-2eeb-4389-9eb6-23eb5f4f0dc8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:22:21.304567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:21.304567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:21.304567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:21.304567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:21.304567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:21.304567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:21.304567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:21.304567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:21.304567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:21.304567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:21.304567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:21.304567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:21.304567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:21.304567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:21.304567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:21.305502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:21.305502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:21.305502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:21.305502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:21.305502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:21.305502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:21.305502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:21.305502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:21.305502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:21.305502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:21.305502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:21.305502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:21.305502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:21.305502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:21.305502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:21.305502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:21.306333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:21.306333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:21.306333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:21.306333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:21.306333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:21.306333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:21.306333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:21.306333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:21.306333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:21.306333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:21.306333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:22:21.306333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:21.309046 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 460/930] 10.222.0.40 () {56 vars in 1120 bytes} [Tue Jul 12 14:22:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:21.315393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-204b717b-86f1-4209-abf7-b6914d558155 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 14:22:21.315393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:21.315393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:21.315393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:21.315393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:21.315393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:21.315393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:21.315393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:21.315393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 14:22:21.315393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:21.315393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:21.315393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:21.315393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:21.315393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:21.315393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:21.315393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:21.316355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:21.316355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:21.316355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:21.316355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:21.316355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:21.316355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:21.316355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:21.316355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:21.316355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:21.316355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:21.316355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:21.316355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:21.316355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:21.316355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:21.316355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:21.316355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:21.317227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:21.317227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:21.317227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:21.317227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:21.317227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:21.317227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:21.317227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:21.317227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:21.317227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:21.317227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:21.317227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:21.317227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:21.317227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:21.317227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 14:22:21.317227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:21.317227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 471/931] 10.222.0.40 () {56 vars in 1132 bytes} [Tue Jul 12 14:22:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:21.318070 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67022d-2eeb-4389-9eb6-23eb5f4f0dc8 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:21.320632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b717b-86f1-4209-abf7-b6914d558155 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:21.424150 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:21.445454 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67022d-2eeb-4389-9eb6-23eb5f4f0dc8 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:21.451291 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b717b-86f1-4209-abf7-b6914d558155 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:21.481417 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80aee15-663a-4c5e-ad6f-bc24a5ccd08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:21.482185 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80aee15-663a-4c5e-ad6f-bc24a5ccd08a None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:21.482364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80aee15-663a-4c5e-ad6f-bc24a5ccd08a None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:21.482641 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80aee15-663a-4c5e-ad6f-bc24a5ccd08a None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:21.483468 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80aee15-663a-4c5e-ad6f-bc24a5ccd08a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:21.483728 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80aee15-663a-4c5e-ad6f-bc24a5ccd08a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:21.485089 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80aee15-663a-4c5e-ad6f-bc24a5ccd08a None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:21.491730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dd0e6-020d-43ef-80b9-2c6368d9487e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:21.492725 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dd0e6-020d-43ef-80b9-2c6368d9487e None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:21.493216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dd0e6-020d-43ef-80b9-2c6368d9487e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:21.493697 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dd0e6-020d-43ef-80b9-2c6368d9487e None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:21.494599 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5dd0e6-020d-43ef-80b9-2c6368d9487e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:21.494843 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 461/932] 10.222.0.40 () {56 vars in 1115 bytes} [Tue Jul 12 14:22:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:21.495267 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5dd0e6-020d-43ef-80b9-2c6368d9487e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:21.497001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5dd0e6-020d-43ef-80b9-2c6368d9487e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:21.500429 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80aee15-663a-4c5e-ad6f-bc24a5ccd08a None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:21.502678 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 472/933] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Jul 12 14:22:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:21.508245 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dd0e6-020d-43ef-80b9-2c6368d9487e None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:21.567846 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:21.625669 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80aee15-663a-4c5e-ad6f-bc24a5ccd08a None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:21.630984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dd0e6-020d-43ef-80b9-2c6368d9487e None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:21.662337 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a24b9-6e48-4635-ae3c-88619960425d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:21.663540 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a24b9-6e48-4635-ae3c-88619960425d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:21.664025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a24b9-6e48-4635-ae3c-88619960425d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:21.664579 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a24b9-6e48-4635-ae3c-88619960425d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:21.671168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c4009-3859-4118-b674-f2369f4d4abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:21.671868 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c4009-3859-4118-b674-f2369f4d4abd None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:21.672156 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c4009-3859-4118-b674-f2369f4d4abd None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:21.672435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c4009-3859-4118-b674-f2369f4d4abd None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:21.673152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c4009-3859-4118-b674-f2369f4d4abd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:21.673521 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c4009-3859-4118-b674-f2369f4d4abd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:21.675133 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c4009-3859-4118-b674-f2369f4d4abd None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:21.678430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a24b9-6e48-4635-ae3c-88619960425d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:21.680171 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a24b9-6e48-4635-ae3c-88619960425d None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:21.685378 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 473/934] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Jul 12 14:22:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:21.687734 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c4009-3859-4118-b674-f2369f4d4abd None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:21.702437 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:21.705275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-f70a24b9-6e48-4635-ae3c-88619960425d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:21.705275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:21.705275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:21.705275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:21.705275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:21.705275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:21.705275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:21.705275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:21.705275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:21.705275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:21.705275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:21.705275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:21.705275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:21.705275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:21.705275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:21.706210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:21.706210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:21.706210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:21.706210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:21.706210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:21.706210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:21.706210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:21.706210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:21.706210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:21.706210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:21.706210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:21.706210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:21.706210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:21.706210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:21.706210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:21.706210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:21.706210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:21.707070 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:21.707070 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:21.707070 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:21.707070 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:21.709950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 462/935] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:21.715511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a24b9-6e48-4635-ae3c-88619960425d None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:21.810628 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c4009-3859-4118-b674-f2369f4d4abd None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:21.845155 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:21.849639 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a24b9-6e48-4635-ae3c-88619960425d None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:21.853602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3aa41a-3404-411b-b7d7-9423269d12d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:21.854492 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3aa41a-3404-411b-b7d7-9423269d12d7 None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:21.854877 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3aa41a-3404-411b-b7d7-9423269d12d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:21.855258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3aa41a-3404-411b-b7d7-9423269d12d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:21.863841 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3aa41a-3404-411b-b7d7-9423269d12d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:21.863841 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3aa41a-3404-411b-b7d7-9423269d12d7 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:21.890433 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0d593-5e01-4e43-9f04-fad737b89f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:21.891105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0d593-5e01-4e43-9f04-fad737b89f25 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:21.891486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0d593-5e01-4e43-9f04-fad737b89f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:21.891764 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0d593-5e01-4e43-9f04-fad737b89f25 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:21.892500 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0d593-5e01-4e43-9f04-fad737b89f25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:21.892795 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0d593-5e01-4e43-9f04-fad737b89f25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:21.894168 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0d593-5e01-4e43-9f04-fad737b89f25 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:21.909377 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 463/936] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:21.914866 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0d593-5e01-4e43-9f04-fad737b89f25 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:21.949507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 474/937] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Jul 12 14:22:21 2022] POST /identity/v3/endpoints => generated 347 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:22:22.050036 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0d593-5e01-4e43-9f04-fad737b89f25 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:22.099152 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4ad10-cd3a-4a1f-8aea-70de9ebc9fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:22.100983 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4ad10-cd3a-4a1f-8aea-70de9ebc9fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:22.101470 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4ad10-cd3a-4a1f-8aea-70de9ebc9fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:22.101961 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4ad10-cd3a-4a1f-8aea-70de9ebc9fb6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:22.110562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4ad10-cd3a-4a1f-8aea-70de9ebc9fb6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:22.112467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4ad10-cd3a-4a1f-8aea-70de9ebc9fb6 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:22.118185 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38d19e-8037-4d48-ac69-2b4b93343b75 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:22.118471 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38d19e-8037-4d48-ac69-2b4b93343b75 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:22.118754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38d19e-8037-4d48-ac69-2b4b93343b75 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:22.120450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 475/938] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:22:22.126042 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e05a-063a-4b8a-856b-b3e11f67ce1f None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:22.126332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e05a-063a-4b8a-856b-b3e11f67ce1f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:22.126616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3e05a-063a-4b8a-856b-b3e11f67ce1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:22.130027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-efa4ad10-cd3a-4a1f-8aea-70de9ebc9fb6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:22:22.130027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:22.130027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:22.130027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:22.130027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:22.130027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:22.130027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:22.130027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:22.130027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:22.130027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:22.130027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:22.130027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:22.130027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:22:22.130027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:22:22.130027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:22:22.130027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:22:22.130965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:22.130965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:22.130965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:22:22.130965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:22.130965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:22:22.130965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:22.130965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:22.130965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:22.130965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:22.130965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:22.130965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:22.130965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:22.130965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:22.130965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:22.130965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:22.130965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:22.130965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:22.130965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:22.132001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:22.132001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:22.132001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:22:22.132001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:22:22.132001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:22:22.132001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:22:22.132001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:22:22.132001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:22:22.132001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:22:22.132001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:22.132001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 464/939] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Jul 12 14:22:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:22.137067 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4ad10-cd3a-4a1f-8aea-70de9ebc9fb6 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:22.156756 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-87f3e05a-063a-4b8a-856b-b3e11f67ce1f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:22.157987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-87f3e05a-063a-4b8a-856b-b3e11f67ce1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:22.160191 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:22.244941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:22.256321 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 476/940] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:22.274346 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4ad10-cd3a-4a1f-8aea-70de9ebc9fb6 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:22.284086 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3e05a-063a-4b8a-856b-b3e11f67ce1f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:22.314753 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681a470-478d-4538-ab1d-487f31c0aff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:22.315937 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681a470-478d-4538-ab1d-487f31c0aff8 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:22.316536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681a470-478d-4538-ab1d-487f31c0aff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:22.317008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681a470-478d-4538-ab1d-487f31c0aff8 None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:22.318047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681a470-478d-4538-ab1d-487f31c0aff8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:22.318709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681a470-478d-4538-ab1d-487f31c0aff8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:22.320514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681a470-478d-4538-ab1d-487f31c0aff8 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:22.340658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 465/941] 10.222.0.40 () {56 vars in 1149 bytes} [Tue Jul 12 14:22:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:22.347332 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681a470-478d-4538-ab1d-487f31c0aff8 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:22.408427 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3e05a-063a-4b8a-856b-b3e11f67ce1f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:22.445399 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c66998-cdb9-46bc-855c-012a400a5d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:22.446306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c66998-cdb9-46bc-855c-012a400a5d67 None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:22.446733 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c66998-cdb9-46bc-855c-012a400a5d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:22.447207 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c66998-cdb9-46bc-855c-012a400a5d67 None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:22.447733 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:22.448306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c66998-cdb9-46bc-855c-012a400a5d67 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:22.449864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c66998-cdb9-46bc-855c-012a400a5d67 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:22.451464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: WARNING keystone.server.flask.common [None req-b6c66998-cdb9-46bc-855c-012a400a5d67 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 14:22:22.475611 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681a470-478d-4538-ab1d-487f31c0aff8 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:22.498336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.sql.core [None req-b6c66998-cdb9-46bc-855c-012a400a5d67 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 14:22:22.498336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 14:22:22.498336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [parameters: {'id': '291b7168a3f84399a76e7d04e94d0eb8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 14:22:22.498336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80633) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 14:22:22.512331 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7b5b2-498c-4c17-98e4-56af0d9bce41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:22.513229 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7b5b2-498c-4c17-98e4-56af0d9bce41 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:22.513516 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7b5b2-498c-4c17-98e4-56af0d9bce41 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:22.513846 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7b5b2-498c-4c17-98e4-56af0d9bce41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:22.518345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-b6c66998-cdb9-46bc-855c-012a400a5d67 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 291b7168a3f84399a76e7d04e94d0eb8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 291b7168a3f84399a76e7d04e94d0eb8. Jul 12 14:22:22.518345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:22.518345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 14:22:22.518345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 14:22:22.518345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 14:22:22.518345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 14:22:22.518345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 14:22:22.518345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 14:22:22.518345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 14:22:22.518345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application conn.query(q) Jul 12 14:22:22.518345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 14:22:22.518345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 14:22:22.518345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 14:22:22.519152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application result.read() Jul 12 14:22:22.519152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 14:22:22.519152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 14:22:22.519152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 14:22:22.519152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 14:22:22.519152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 14:22:22.519152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 14:22:22.519152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 14:22:22.519152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 14:22:22.519152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 14:22:22.519152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:22.519152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 14:22:22.519152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:22.519152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:22.519152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 14:22:22.519152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 14:22:22.519152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 12 14:22:22.519152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 12 14:22:22.520127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 14:22:22.520127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application next(self.gen) Jul 12 14:22:22.520127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 14:22:22.520127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application yield resource Jul 12 14:22:22.520127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 14:22:22.520127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application next(self.gen) Jul 12 14:22:22.520127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 14:22:22.520127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 14:22:22.520127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 14:22:22.520127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 14:22:22.520127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 14:22:22.520127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise self.value Jul 12 14:22:22.520127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 14:22:22.520127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 14:22:22.520127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 14:22:22.520127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application session.commit() Jul 12 14:22:22.520127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 14:22:22.521009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 14:22:22.521009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 14:22:22.521009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 14:22:22.521009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 14:22:22.521009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self.session.flush() Jul 12 14:22:22.521009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 14:22:22.521009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 14:22:22.521009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 14:22:22.521009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 14:22:22.521009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 14:22:22.521009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application compat.raise_( Jul 12 14:22:22.521009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 14:22:22.521009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception Jul 12 14:22:22.521009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 14:22:22.521009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 14:22:22.521009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 14:22:22.521009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 14:22:22.521966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 14:22:22.521966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 14:22:22.521966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 14:22:22.521966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 14:22:22.521966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 14:22:22.521966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 14:22:22.521966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 14:22:22.521966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 14:22:22.521966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 14:22:22.521966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 14:22:22.521966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 14:22:22.521966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 14:22:22.521966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 14:22:22.521966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 14:22:22.521966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 14:22:22.522754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 14:22:22.522754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 14:22:22.522754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception Jul 12 14:22:22.522754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 14:22:22.522754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 14:22:22.522754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 14:22:22.522754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 14:22:22.522754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 14:22:22.522754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 14:22:22.522754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 14:22:22.522754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application conn.query(q) Jul 12 14:22:22.522754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 14:22:22.522754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 14:22:22.522754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 14:22:22.522754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application result.read() Jul 12 14:22:22.522754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 14:22:22.522754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 14:22:22.524992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 14:22:22.524992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 14:22:22.524992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 14:22:22.524992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 14:22:22.524992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 14:22:22.524992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 14:22:22.524992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 14:22:22.524992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 14:22:22.524992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [parameters: {'id': '291b7168a3f84399a76e7d04e94d0eb8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 14:22:22.524992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 14:22:22.524992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:22.524992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:22.524992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:22.524992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:22.524992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 12 14:22:22.526203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 12 14:22:22.526203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 14:22:22.526203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 14:22:22.526203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 12 14:22:22.526203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:22.526203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:22.526203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:22.526203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:22.526203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:22.526203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:22.526203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:22.526203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:22.526203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:22.526203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:22.526203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:22.526203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:22.526203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:22.527397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:22.527397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 12 14:22:22.527397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 12 14:22:22.527397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:22.527397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:22.527397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 12 14:22:22.527397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 12 14:22:22.527397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 291b7168a3f84399a76e7d04e94d0eb8. Jul 12 14:22:22.527397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:22.527397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 477/942] 10.222.0.40 () {60 vars in 1140 bytes} [Tue Jul 12 14:22:22 2022] POST /identity/v3/projects => generated 262 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:22.534566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c66998-cdb9-46bc-855c-012a400a5d67 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:22.536221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7b5b2-498c-4c17-98e4-56af0d9bce41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:22.538602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7b5b2-498c-4c17-98e4-56af0d9bce41 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:22.561694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-a7d7b5b2-498c-4c17-98e4-56af0d9bce41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:22.561694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:22.561694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:22.561694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:22.561694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:22.561694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:22.561694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:22.561694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:22.561694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:22.561694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:22.561694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:22.561694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:22.561694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:22.561694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:22.561694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:22.562637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:22.562637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:22.562637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:22.562637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:22.562637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:22.562637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:22.562637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:22.562637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:22.562637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:22.562637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:22.562637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:22.562637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:22.562637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:22.562637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:22.562637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:22.562637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:22.562637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:22.563553 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:22.563553 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:22.563553 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:22.563553 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:22.568124 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 466/943] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:22.569827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7b5b2-498c-4c17-98e4-56af0d9bce41 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:22.614084 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:22.672011 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c66998-cdb9-46bc-855c-012a400a5d67 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:22.700841 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7b5b2-498c-4c17-98e4-56af0d9bce41 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:22.711493 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189483a-5aa4-47e9-bbb3-59ed5a521bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:22.712301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189483a-5aa4-47e9-bbb3-59ed5a521bae None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:22.712589 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189483a-5aa4-47e9-bbb3-59ed5a521bae None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:22.712865 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189483a-5aa4-47e9-bbb3-59ed5a521bae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:22.720188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189483a-5aa4-47e9-bbb3-59ed5a521bae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:22.721844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189483a-5aa4-47e9-bbb3-59ed5a521bae None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:22.734322 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:22.737906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-a189483a-5aa4-47e9-bbb3-59ed5a521bae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:22.737906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:22.737906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:22.737906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:22.737906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:22.737906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:22.737906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:22.737906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:22.737906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:22.737906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:22.737906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:22.737906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:22.737906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:22:22.737906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:22:22.737906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:22:22.738774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:22:22.738774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:22.738774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:22.738774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:22.738774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:22.738774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:22.738774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:22.738774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:22.738774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:22.738774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:22.738774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:22.738774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:22.738774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:22.738774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:22.738774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:22.738774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:22.738774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:22.739686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:22:22.739686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:22:22.739686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:22:22.739686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:22:22.739686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:22:22.739686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:22:22.739686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:22.739686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:22.745144 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 478/944] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:22.752880 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189483a-5aa4-47e9-bbb3-59ed5a521bae None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:22.753018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed498872-f6b2-44b9-a632-9cdf22d60e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:22.753018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed498872-f6b2-44b9-a632-9cdf22d60e9e None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:22.753018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed498872-f6b2-44b9-a632-9cdf22d60e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:22.753018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed498872-f6b2-44b9-a632-9cdf22d60e9e None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:22.753300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed498872-f6b2-44b9-a632-9cdf22d60e9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:22.753300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed498872-f6b2-44b9-a632-9cdf22d60e9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:22.754399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed498872-f6b2-44b9-a632-9cdf22d60e9e None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:22.778847 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 467/945] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:22.784346 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed498872-f6b2-44b9-a632-9cdf22d60e9e None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:22.860259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189483a-5aa4-47e9-bbb3-59ed5a521bae None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:22.874330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:22.895956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e5788-be83-4bf0-a835-a31b31fab1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:22.897481 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e5788-be83-4bf0-a835-a31b31fab1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:22.897807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e5788-be83-4bf0-a835-a31b31fab1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:22.898086 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e5788-be83-4bf0-a835-a31b31fab1e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:22.898958 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e5788-be83-4bf0-a835-a31b31fab1e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:22.899268 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e5788-be83-4bf0-a835-a31b31fab1e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:22.900899 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e5788-be83-4bf0-a835-a31b31fab1e5 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:22.903190 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed498872-f6b2-44b9-a632-9cdf22d60e9e None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:22.929896 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 479/946] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Jul 12 14:22:22 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:22.942034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4525c3-634e-46a5-b44a-1ee2d7fc3e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:22.943353 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4525c3-634e-46a5-b44a-1ee2d7fc3e76 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:22.944417 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4525c3-634e-46a5-b44a-1ee2d7fc3e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:22.944927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4525c3-634e-46a5-b44a-1ee2d7fc3e76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:22.953409 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4525c3-634e-46a5-b44a-1ee2d7fc3e76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:22.955304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4525c3-634e-46a5-b44a-1ee2d7fc3e76 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:22.971485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-6b4525c3-634e-46a5-b44a-1ee2d7fc3e76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:22.971485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:22.971485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:22.971485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:22.971485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:22.971485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:22.971485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:22.971485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:22.971485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:22.971485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:22.971485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:22.971485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:22.971485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:22:22.971485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:22:22.971485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:22:22.972446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:22:22.972446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:22.972446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:22.972446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:22.972446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:22.972446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:22.972446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:22.972446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:22.972446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:22.972446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:22.972446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:22.972446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:22.972446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:22.972446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:22.972446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:22.972446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:22.972446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:22.973313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:22:22.973313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:22:22.973313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:22:22.973313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:22:22.973313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:22:22.973313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:22:22.973313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:22.973313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:22.976908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 468/947] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:22.987306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e5788-be83-4bf0-a835-a31b31fab1e5 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:23.099112 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e5788-be83-4bf0-a835-a31b31fab1e5 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:23.139489 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb610d4-061d-44ae-978c-b359ca8ddc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:23.140168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb610d4-061d-44ae-978c-b359ca8ddc55 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:23.140610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb610d4-061d-44ae-978c-b359ca8ddc55 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:23.140851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb610d4-061d-44ae-978c-b359ca8ddc55 None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:23.141663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb610d4-061d-44ae-978c-b359ca8ddc55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:23.141971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb610d4-061d-44ae-978c-b359ca8ddc55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:23.143125 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01cbb3-0008-4313-a71e-87c536270591 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:23.143440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb610d4-061d-44ae-978c-b359ca8ddc55 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:23.143649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01cbb3-0008-4313-a71e-87c536270591 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:23.144155 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01cbb3-0008-4313-a71e-87c536270591 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:23.148247 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 469/948] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:23.153871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaa9fe-f49b-4745-b8c2-5a389c75f2b8 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:23.154168 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaa9fe-f49b-4745-b8c2-5a389c75f2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:23.154455 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaa9fe-f49b-4745-b8c2-5a389c75f2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:23.157799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 480/949] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:22:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:23.169019 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb610d4-061d-44ae-978c-b359ca8ddc55 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:23.175969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-e6aaa9fe-f49b-4745-b8c2-5a389c75f2b8 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:23.177687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-e6aaa9fe-f49b-4745-b8c2-5a389c75f2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:23.215650 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:23.234732 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:23.275417 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 470/950] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:22:23.294348 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaa9fe-f49b-4745-b8c2-5a389c75f2b8 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:23.304087 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb610d4-061d-44ae-978c-b359ca8ddc55 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:23.348308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e0c71-3670-48ae-804b-37f03affb5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:23.349393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e0c71-3670-48ae-804b-37f03affb5bc None admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:23.349708 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e0c71-3670-48ae-804b-37f03affb5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:23.350021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e0c71-3670-48ae-804b-37f03affb5bc None admin] PATH_INFO: `/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/5ec758ef106b49f4985845b3c106f94b/roles/89b4a0107e1f484683ef23398bfcb722` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:23.352597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e0c71-3670-48ae-804b-37f03affb5bc None admin] RBAC: Authorizing `identity:create_grant(project_id=00424b6950d14cd4854e4add3e3d7705, user_id=5ec758ef106b49f4985845b3c106f94b, role_id=89b4a0107e1f484683ef23398bfcb722)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:23.354122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e0c71-3670-48ae-804b-37f03affb5bc None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:23.408071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaa9fe-f49b-4745-b8c2-5a389c75f2b8 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:23.420461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 481/951] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:22:23 2022] PUT /identity/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/5ec758ef106b49f4985845b3c106f94b/roles/89b4a0107e1f484683ef23398bfcb722 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:22:23.458714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17870e75-2d49-4add-901c-822ca0a8d784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:23.459953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17870e75-2d49-4add-901c-822ca0a8d784 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:23.460584 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17870e75-2d49-4add-901c-822ca0a8d784 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:23.461194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17870e75-2d49-4add-901c-822ca0a8d784 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:23.462122 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17870e75-2d49-4add-901c-822ca0a8d784 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:23.463877 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17870e75-2d49-4add-901c-822ca0a8d784 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:23.478096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-17870e75-2d49-4add-901c-822ca0a8d784 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:22:23.478096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:23.478096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:23.478096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:23.478096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:23.478096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:23.478096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:23.478096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:23.478096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:22:23.478096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:23.478096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:23.478096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:23.478096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:23.478096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:23.478096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:23.478096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:23.478096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:23.479343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:23.479343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:23.479343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:23.479343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:23.479343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:23.479343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:23.479343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:23.479343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:23.479343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:23.479343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:23.479343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:23.479343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:23.479343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:23.479343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:23.479343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:23.479343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:23.480280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:23.480280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:23.480280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:23.480280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:23.480280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:23.480280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:23.480280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:23.480280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:23.480280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:23.480280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:23.480280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:23.480280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:23.480280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:22:23.480280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:23.487393 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 471/952] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Jul 12 14:22:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:23.489933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e0c71-3670-48ae-804b-37f03affb5bc None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:23.605210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:23.614671 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e0c71-3670-48ae-804b-37f03affb5bc None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:23.650648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa27aaf-6c1a-4055-a116-c722bd4a6fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:23.651635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa27aaf-6c1a-4055-a116-c722bd4a6fbd None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:23.652300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa27aaf-6c1a-4055-a116-c722bd4a6fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:23.652577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa27aaf-6c1a-4055-a116-c722bd4a6fbd None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:23.653296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa27aaf-6c1a-4055-a116-c722bd4a6fbd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:23.653603 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa27aaf-6c1a-4055-a116-c722bd4a6fbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:23.654962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa27aaf-6c1a-4055-a116-c722bd4a6fbd None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:23.660752 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 482/953] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Jul 12 14:22:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:23.666893 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17870e75-2d49-4add-901c-822ca0a8d784 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:23.715956 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:23.782841 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17870e75-2d49-4add-901c-822ca0a8d784 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:23.821461 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79dd3c-520b-49ff-a2a1-071ee61d2db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:23.822153 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79dd3c-520b-49ff-a2a1-071ee61d2db9 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:23.822438 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79dd3c-520b-49ff-a2a1-071ee61d2db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:23.822713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79dd3c-520b-49ff-a2a1-071ee61d2db9 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:23.823469 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79dd3c-520b-49ff-a2a1-071ee61d2db9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:23.823779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79dd3c-520b-49ff-a2a1-071ee61d2db9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:23.825174 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79dd3c-520b-49ff-a2a1-071ee61d2db9 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:23.835391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 472/954] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Jul 12 14:22:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:23.837551 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa27aaf-6c1a-4055-a116-c722bd4a6fbd None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:23.951391 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa27aaf-6c1a-4055-a116-c722bd4a6fbd None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:23.982736 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289f302-10f4-4627-8dff-05613930bb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:23.983495 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289f302-10f4-4627-8dff-05613930bb63 None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:23.983780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289f302-10f4-4627-8dff-05613930bb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:23.984102 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289f302-10f4-4627-8dff-05613930bb63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:23.984871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289f302-10f4-4627-8dff-05613930bb63 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:23.986234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289f302-10f4-4627-8dff-05613930bb63 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:24.052764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 483/955] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Jul 12 14:22:23 2022] POST /identity/v3/endpoints => generated 349 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:22:24.139063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecaf98-20a0-42bc-8489-7395856a80fd None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:24.139417 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecaf98-20a0-42bc-8489-7395856a80fd None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:24.139661 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecaf98-20a0-42bc-8489-7395856a80fd None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:24.141373 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 473/956] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:24.148111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a092e5-ee64-43d2-9da6-627b7e65d13f None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:24.148431 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a092e5-ee64-43d2-9da6-627b7e65d13f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:24.148686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a092e5-ee64-43d2-9da6-627b7e65d13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:24.167856 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-83a092e5-ee64-43d2-9da6-627b7e65d13f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:24.169427 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-83a092e5-ee64-43d2-9da6-627b7e65d13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:24.180578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:24.272652 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 484/957] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:24.295710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecaf98-20a0-42bc-8489-7395856a80fd None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:24.411402 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecaf98-20a0-42bc-8489-7395856a80fd None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:24.415016 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:24.450116 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9618a89-8666-413d-92d9-3d73446aa967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:24.450922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9618a89-8666-413d-92d9-3d73446aa967 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:24.451265 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9618a89-8666-413d-92d9-3d73446aa967 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:24.451587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9618a89-8666-413d-92d9-3d73446aa967 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:24.452258 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9618a89-8666-413d-92d9-3d73446aa967 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:24.453627 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9618a89-8666-413d-92d9-3d73446aa967 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:24.466917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-e9618a89-8666-413d-92d9-3d73446aa967 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 14:22:24.466917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:24.466917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:24.466917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:24.466917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:24.466917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:24.466917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:24.466917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:24.466917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 14:22:24.466917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:24.466917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:24.466917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:24.466917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:24.466917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:24.466917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:24.466917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:24.466917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:24.469307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:24.469307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:24.469307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:24.469307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:24.469307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:24.469307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:24.469307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:24.469307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:24.469307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:24.469307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:24.469307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:24.469307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:24.469307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:24.469307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:24.469307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:24.469307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:24.471292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:24.471292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:24.471292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:24.471292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:24.471292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:24.471292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:24.471292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:24.471292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:24.471292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:24.471292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:24.471292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:24.471292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:24.471292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 14:22:24.471292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:24.479303 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 474/958] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:24.479574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a092e5-ee64-43d2-9da6-627b7e65d13f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:24.586490 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a092e5-ee64-43d2-9da6-627b7e65d13f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:24.623091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d8aba-aa78-4d0f-891f-04ec9dc0d332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:24.626007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d8aba-aa78-4d0f-891f-04ec9dc0d332 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:24.626007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d8aba-aa78-4d0f-891f-04ec9dc0d332 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:24.626007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d8aba-aa78-4d0f-891f-04ec9dc0d332 None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:24.626007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d8aba-aa78-4d0f-891f-04ec9dc0d332 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:24.626007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d8aba-aa78-4d0f-891f-04ec9dc0d332 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:24.626815 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d8aba-aa78-4d0f-891f-04ec9dc0d332 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:24.633739 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 485/959] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Jul 12 14:22:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:24.639369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9618a89-8666-413d-92d9-3d73446aa967 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:24.753731 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9618a89-8666-413d-92d9-3d73446aa967 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:24.792487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918707b-68ae-4264-8946-70453b7022f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:24.793169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918707b-68ae-4264-8946-70453b7022f2 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:24.793459 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918707b-68ae-4264-8946-70453b7022f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:24.793743 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918707b-68ae-4264-8946-70453b7022f2 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:24.794469 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918707b-68ae-4264-8946-70453b7022f2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:24.794784 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918707b-68ae-4264-8946-70453b7022f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:24.796195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918707b-68ae-4264-8946-70453b7022f2 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:24.807474 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 475/960] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Jul 12 14:22:24 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:25.199335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e085e65-914a-4ee6-a43c-125946cdaadb None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:25.200017 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e085e65-914a-4ee6-a43c-125946cdaadb None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:25.200017 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e085e65-914a-4ee6-a43c-125946cdaadb None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:25.201682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 486/961] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:25.207193 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b73cf-301a-4061-865f-367ae7b73496 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:25.207527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b73cf-301a-4061-865f-367ae7b73496 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:25.207913 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b73cf-301a-4061-865f-367ae7b73496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:25.227379 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-3d9b73cf-301a-4061-865f-367ae7b73496 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:25.228649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-3d9b73cf-301a-4061-865f-367ae7b73496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:25.260786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:25.315643 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 476/962] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:25.334301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e085e65-914a-4ee6-a43c-125946cdaadb None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:25.337910 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:25.450541 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e085e65-914a-4ee6-a43c-125946cdaadb None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:25.487834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd894e9-bacc-4864-855a-e2d60542480f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:25.488503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd894e9-bacc-4864-855a-e2d60542480f None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:25.488784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd894e9-bacc-4864-855a-e2d60542480f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:25.489057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd894e9-bacc-4864-855a-e2d60542480f None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:25.489775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd894e9-bacc-4864-855a-e2d60542480f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:25.492111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd894e9-bacc-4864-855a-e2d60542480f None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:25.553156 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.sql.core [None req-ffd894e9-bacc-4864-855a-e2d60542480f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 14:22:25.553156 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 14:22:25.553156 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [parameters: {'user_id': '158b606586d34d859dc448f6e8df15bd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 14:22:25.553156 dv-cinder-820027-12-smb devstack@keystone.service[80633]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80633) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 14:22:25.561210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-ffd894e9-bacc-4864-855a-e2d60542480f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 14:22:25.561210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:25.561210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 14:22:25.561210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 14:22:25.561210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 14:22:25.561210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 14:22:25.561210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 14:22:25.561210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 14:22:25.561210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 14:22:25.561210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application conn.query(q) Jul 12 14:22:25.561210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 14:22:25.561210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 14:22:25.561210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 14:22:25.561210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application result.read() Jul 12 14:22:25.561210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 14:22:25.563194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 14:22:25.563194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 14:22:25.563194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 14:22:25.563194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 14:22:25.563194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 14:22:25.563194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 14:22:25.563194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 14:22:25.563194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 14:22:25.563194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:25.563194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 14:22:25.563194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:25.563194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:25.563194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 14:22:25.563194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 14:22:25.563194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 12 14:22:25.563194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 12 14:22:25.563194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 14:22:25.563194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application next(self.gen) Jul 12 14:22:25.565474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 14:22:25.565474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application yield resource Jul 12 14:22:25.565474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 14:22:25.565474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application next(self.gen) Jul 12 14:22:25.565474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 14:22:25.565474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 14:22:25.565474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 14:22:25.565474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 14:22:25.565474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 14:22:25.565474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise self.value Jul 12 14:22:25.565474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 14:22:25.565474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 14:22:25.565474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 14:22:25.565474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application session.commit() Jul 12 14:22:25.565474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 14:22:25.565474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 14:22:25.565474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 14:22:25.567605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 14:22:25.567605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 14:22:25.567605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self.session.flush() Jul 12 14:22:25.567605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 14:22:25.567605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 14:22:25.567605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 14:22:25.567605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 14:22:25.567605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 14:22:25.567605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application compat.raise_( Jul 12 14:22:25.567605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 14:22:25.567605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception Jul 12 14:22:25.567605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 14:22:25.567605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 14:22:25.567605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 14:22:25.567605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 14:22:25.567605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 14:22:25.567605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 14:22:25.570373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 14:22:25.570373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 14:22:25.570373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 12 14:22:25.570373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 12 14:22:25.570373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 14:22:25.570373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 14:22:25.570373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 14:22:25.570373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 14:22:25.570373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 14:22:25.570373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 14:22:25.570373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 14:22:25.570373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 14:22:25.570373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 14:22:25.570373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 14:22:25.570373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 14:22:25.570373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception Jul 12 14:22:25.572537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 14:22:25.572537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 14:22:25.572537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 14:22:25.572537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 14:22:25.572537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 14:22:25.572537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 14:22:25.572537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 14:22:25.572537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application conn.query(q) Jul 12 14:22:25.572537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 14:22:25.572537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 14:22:25.572537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 14:22:25.572537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application result.read() Jul 12 14:22:25.572537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 14:22:25.572537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 14:22:25.572537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 14:22:25.572537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 14:22:25.579864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 14:22:25.579864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 14:22:25.579864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 14:22:25.579864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 14:22:25.579864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 14:22:25.579864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 14:22:25.579864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [parameters: {'user_id': '158b606586d34d859dc448f6e8df15bd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 14:22:25.579864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 14:22:25.579864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:25.579864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:25.579864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:25.579864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:25.579864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:25.579864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:25.579864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:25.581791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:25.581791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:25.581791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:25.581791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:25.581791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:25.581791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:25.581791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:25.581791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 12 14:22:25.581791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 12 14:22:25.581791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:25.581791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:25.581791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:22:25.581791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:25.581791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:22:25.581791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:25.581791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 12 14:22:25.581791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 12 14:22:25.583987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 12 14:22:25.583987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 12 14:22:25.583987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 14:22:25.583987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 14:22:25.583987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 14:22:25.583987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:25.583987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 487/963] 10.222.0.40 () {60 vars in 1131 bytes} [Tue Jul 12 14:22:25 2022] POST /identity/v3/users => generated 160 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:25.585669 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b73cf-301a-4061-865f-367ae7b73496 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:25.607871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def42df9-6029-4e36-9a71-285bd897c780 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:25.607871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def42df9-6029-4e36-9a71-285bd897c780 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:25.607871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def42df9-6029-4e36-9a71-285bd897c780 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:25.613195 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 488/964] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:25.614328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109aab8-0b85-4962-a09f-630a476051a9 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:25.614851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109aab8-0b85-4962-a09f-630a476051a9 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:25.616015 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109aab8-0b85-4962-a09f-630a476051a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:25.635747 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-2109aab8-0b85-4962-a09f-630a476051a9 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:25.637774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-2109aab8-0b85-4962-a09f-630a476051a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:25.687534 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b73cf-301a-4061-865f-367ae7b73496 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:25.715035 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:25.725831 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 489/965] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:22:25.736629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055090b8-fa34-4c30-9349-21a7f789c81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:25.737443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055090b8-fa34-4c30-9349-21a7f789c81b None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:25.737726 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055090b8-fa34-4c30-9349-21a7f789c81b None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:25.738003 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055090b8-fa34-4c30-9349-21a7f789c81b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:25.748411 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055090b8-fa34-4c30-9349-21a7f789c81b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:25.749885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055090b8-fa34-4c30-9349-21a7f789c81b None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:25.756882 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109aab8-0b85-4962-a09f-630a476051a9 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:25.769672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-055090b8-fa34-4c30-9349-21a7f789c81b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 14:22:25.769672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:25.769672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:25.769672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:25.769672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:25.769672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:25.769672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:25.769672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:25.769672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:25.769672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:25.769672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:25.769672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:25.769672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:22:25.769672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:22:25.769672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:22:25.769672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:22:25.770629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:25.770629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:25.770629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:22:25.770629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:25.770629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:22:25.770629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:25.770629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:25.770629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:25.770629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:25.770629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:25.770629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:25.770629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:25.770629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:25.770629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:25.770629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:25.770629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:25.770629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:25.770629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:25.771634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:25.771634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:25.771634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:22:25.771634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:22:25.771634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:22:25.771634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:22:25.771634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:22:25.771634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:22:25.771634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 14:22:25.771634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:25.775364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 477/966] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:22:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:25.778107 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055090b8-fa34-4c30-9349-21a7f789c81b None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:25.831678 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:25.878222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109aab8-0b85-4962-a09f-630a476051a9 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:25.907368 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055090b8-fa34-4c30-9349-21a7f789c81b None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:25.926658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3194cfa-0b66-4f69-a1c8-849daf57b168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:25.927924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3194cfa-0b66-4f69-a1c8-849daf57b168 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:25.928214 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3194cfa-0b66-4f69-a1c8-849daf57b168 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:25.928477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3194cfa-0b66-4f69-a1c8-849daf57b168 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:25.942698 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3194cfa-0b66-4f69-a1c8-849daf57b168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:25.945653 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f4707-9cfa-4e3f-9df5-00a11cbdec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:25.946372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f4707-9cfa-4e3f-9df5-00a11cbdec74 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:25.946656 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f4707-9cfa-4e3f-9df5-00a11cbdec74 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:25.946929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f4707-9cfa-4e3f-9df5-00a11cbdec74 None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:25.947781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f4707-9cfa-4e3f-9df5-00a11cbdec74 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:25.948087 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f4707-9cfa-4e3f-9df5-00a11cbdec74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:25.949601 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f4707-9cfa-4e3f-9df5-00a11cbdec74 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:25.952148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-c3194cfa-0b66-4f69-a1c8-849daf57b168 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:22:25.952148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:25.952148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:25.952148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:25.952148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:25.952148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:25.952148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:25.952148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:25.952148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:25.952148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:25.952148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:25.952148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:25.952148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:25.952148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:25.952148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:25.952148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:25.953074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:25.953074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:25.953074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:25.953074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:25.953074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:25.953074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:25.953074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:25.953074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:25.953074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:25.953074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:25.953074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:25.953074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:25.953074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:25.953074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:25.953074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:25.953074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:25.953904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:25.953904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:25.953904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:25.953904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:25.953904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:25.953904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:25.953904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:25.953904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:25.953904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:25.953904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:25.953904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:22:25.953904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:25.953904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 490/967] 10.222.0.40 () {56 vars in 1120 bytes} [Tue Jul 12 14:22:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:25.961157 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3194cfa-0b66-4f69-a1c8-849daf57b168 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:25.989086 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 478/968] 10.222.0.40 () {56 vars in 1101 bytes} [Tue Jul 12 14:22:25 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:26.021739 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:26.078502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3194cfa-0b66-4f69-a1c8-849daf57b168 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:26.118525 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a6856-7140-4c20-b709-627ad1c7149c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:26.119220 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a6856-7140-4c20-b709-627ad1c7149c None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:26.119537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a6856-7140-4c20-b709-627ad1c7149c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:26.119814 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a6856-7140-4c20-b709-627ad1c7149c None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:26.120598 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a6856-7140-4c20-b709-627ad1c7149c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:26.121160 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a6856-7140-4c20-b709-627ad1c7149c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:26.123188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a6856-7140-4c20-b709-627ad1c7149c None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:26.133587 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 491/969] 10.222.0.40 () {56 vars in 1115 bytes} [Tue Jul 12 14:22:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:26.139369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f4707-9cfa-4e3f-9df5-00a11cbdec74 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:26.221543 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6368bb-af70-4521-b1bd-39df5ae016a8 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:26.222524 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6368bb-af70-4521-b1bd-39df5ae016a8 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:26.223008 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6368bb-af70-4521-b1bd-39df5ae016a8 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:26.224632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 492/970] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:22:26.230964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f56393-7102-4a7a-bb82-29bf85de6bab None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:26.231585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f56393-7102-4a7a-bb82-29bf85de6bab None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:26.231715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:26.233946 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f56393-7102-4a7a-bb82-29bf85de6bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:26.260402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-52f56393-7102-4a7a-bb82-29bf85de6bab None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:26.261309 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-52f56393-7102-4a7a-bb82-29bf85de6bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:26.264505 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f4707-9cfa-4e3f-9df5-00a11cbdec74 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:26.303215 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afcf01-634a-4192-a68c-eabd6c9fb9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:26.304010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afcf01-634a-4192-a68c-eabd6c9fb9cc None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:26.304293 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afcf01-634a-4192-a68c-eabd6c9fb9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:26.304559 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afcf01-634a-4192-a68c-eabd6c9fb9cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:26.316899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afcf01-634a-4192-a68c-eabd6c9fb9cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:26.320900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afcf01-634a-4192-a68c-eabd6c9fb9cc None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:26.341064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-53afcf01-634a-4192-a68c-eabd6c9fb9cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:26.341064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:26.341064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:26.341064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:26.341064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:26.341064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:26.341064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:26.341064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:26.341064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:26.341064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:26.341064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:26.341064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:26.341064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:26.341064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:26.341064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:26.341995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:26.341995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:26.341995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:26.341995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:26.341995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:26.341995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:26.341995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:26.341995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:26.341995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:26.341995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:26.341995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:26.341995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:26.341995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:26.341995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:26.341995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:26.341995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:26.341995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:26.342889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:26.342889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:26.342889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:26.342889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:26.344855 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 479/971] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:26.346250 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 493/972] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:26.352239 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afcf01-634a-4192-a68c-eabd6c9fb9cc None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:26.371857 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f56393-7102-4a7a-bb82-29bf85de6bab None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:26.424623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:26.461185 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afcf01-634a-4192-a68c-eabd6c9fb9cc None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:26.480548 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f56393-7102-4a7a-bb82-29bf85de6bab None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:26.493057 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:26.498965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4e60b-19cc-4445-9264-1aeefbe1344e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:26.499573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4e60b-19cc-4445-9264-1aeefbe1344e None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:26.499872 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4e60b-19cc-4445-9264-1aeefbe1344e None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:26.500142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4e60b-19cc-4445-9264-1aeefbe1344e None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:26.500872 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4e60b-19cc-4445-9264-1aeefbe1344e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:26.501183 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4e60b-19cc-4445-9264-1aeefbe1344e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:26.502546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4e60b-19cc-4445-9264-1aeefbe1344e None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:26.513845 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 480/973] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:26.517100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d311a7-a995-4ded-a266-fd048577a030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:26.517915 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d311a7-a995-4ded-a266-fd048577a030 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:26.518462 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d311a7-a995-4ded-a266-fd048577a030 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:26.518568 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d311a7-a995-4ded-a266-fd048577a030 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:26.519214 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d311a7-a995-4ded-a266-fd048577a030 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:26.519420 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4e60b-19cc-4445-9264-1aeefbe1344e None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:26.520614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d311a7-a995-4ded-a266-fd048577a030 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:26.534274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-46d311a7-a995-4ded-a266-fd048577a030 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:22:26.534274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:26.534274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:26.534274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:26.534274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:26.534274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:26.534274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:26.534274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:26.534274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:22:26.534274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:26.534274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:26.534274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:26.534274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:26.534274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:26.534274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:26.534274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:26.534274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:26.535344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:26.535344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:26.535344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:26.535344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:26.535344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:26.535344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:26.535344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:26.535344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:26.535344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:26.535344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:26.535344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:26.535344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:26.535344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:26.535344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:26.535344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:26.535344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:26.536189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:26.536189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:26.536189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:26.536189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:26.536189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:26.536189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:26.536189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:26.536189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:26.536189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:26.536189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:26.536189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:26.536189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:26.536189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:22:26.536189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:26.541337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 494/974] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Jul 12 14:22:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:26.542181 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d311a7-a995-4ded-a266-fd048577a030 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:26.642545 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4e60b-19cc-4445-9264-1aeefbe1344e None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:26.649878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d311a7-a995-4ded-a266-fd048577a030 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:26.661503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:26.681559 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721ff85-d479-4210-bbf9-1264a5c3104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:26.682387 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721ff85-d479-4210-bbf9-1264a5c3104f None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:26.682705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721ff85-d479-4210-bbf9-1264a5c3104f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:26.682977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721ff85-d479-4210-bbf9-1264a5c3104f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:26.686788 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef186469-f1c5-48b5-b920-b83313d7b825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:26.687489 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef186469-f1c5-48b5-b920-b83313d7b825 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:26.687774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef186469-f1c5-48b5-b920-b83313d7b825 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:26.688048 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef186469-f1c5-48b5-b920-b83313d7b825 None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:26.688756 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef186469-f1c5-48b5-b920-b83313d7b825 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:26.689090 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef186469-f1c5-48b5-b920-b83313d7b825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:26.690451 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef186469-f1c5-48b5-b920-b83313d7b825 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:26.691144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721ff85-d479-4210-bbf9-1264a5c3104f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:26.692615 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721ff85-d479-4210-bbf9-1264a5c3104f None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:26.700988 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 495/975] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Jul 12 14:22:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:26.702193 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef186469-f1c5-48b5-b920-b83313d7b825 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:26.708886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-1721ff85-d479-4210-bbf9-1264a5c3104f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:22:26.708886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:26.708886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:26.708886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:26.708886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:26.708886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:26.708886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:26.708886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:26.708886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:26.708886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:26.708886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:26.708886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:26.708886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:22:26.708886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:22:26.708886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:22:26.708886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:22:26.710120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:26.710120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:26.710120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:22:26.710120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:26.710120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:22:26.710120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:26.710120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:26.710120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:26.710120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:26.710120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:26.710120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:26.710120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:26.710120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:26.710120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:26.710120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:26.710120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:26.710120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:26.710120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:26.711058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:26.711058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:26.711058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:22:26.711058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:22:26.711058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:22:26.711058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:22:26.711058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:22:26.711058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:22:26.711058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 14:22:26.711058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:26.714865 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 481/976] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Jul 12 14:22:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:26.715697 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721ff85-d479-4210-bbf9-1264a5c3104f None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:26.776753 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:26.812499 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef186469-f1c5-48b5-b920-b83313d7b825 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:26.841848 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721ff85-d479-4210-bbf9-1264a5c3104f None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:26.846986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe971b8-e993-4b0a-8265-7b8c6f6e7c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:26.847706 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe971b8-e993-4b0a-8265-7b8c6f6e7c84 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:26.847993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe971b8-e993-4b0a-8265-7b8c6f6e7c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:26.848268 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe971b8-e993-4b0a-8265-7b8c6f6e7c84 None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:26.848988 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe971b8-e993-4b0a-8265-7b8c6f6e7c84 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:26.849304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe971b8-e993-4b0a-8265-7b8c6f6e7c84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:26.851211 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe971b8-e993-4b0a-8265-7b8c6f6e7c84 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:26.861135 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 496/977] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Jul 12 14:22:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:26.868016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe971b8-e993-4b0a-8265-7b8c6f6e7c84 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:26.885785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b28452-c9e4-40bd-9fb4-efed6b719980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:26.886444 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b28452-c9e4-40bd-9fb4-efed6b719980 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:26.886731 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b28452-c9e4-40bd-9fb4-efed6b719980 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:26.887016 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b28452-c9e4-40bd-9fb4-efed6b719980 None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:26.887883 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b28452-c9e4-40bd-9fb4-efed6b719980 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:26.888197 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b28452-c9e4-40bd-9fb4-efed6b719980 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:26.889620 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b28452-c9e4-40bd-9fb4-efed6b719980 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:26.908218 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 482/978] 10.222.0.40 () {56 vars in 1149 bytes} [Tue Jul 12 14:22:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:26.913765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:26.915513 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b28452-c9e4-40bd-9fb4-efed6b719980 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:26.979498 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe971b8-e993-4b0a-8265-7b8c6f6e7c84 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:27.022837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b28452-c9e4-40bd-9fb4-efed6b719980 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:27.023686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b0cafa-865b-4667-8d90-ee9970952603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:27.024345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0cafa-865b-4667-8d90-ee9970952603 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:27.024623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0cafa-865b-4667-8d90-ee9970952603 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:27.024901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0cafa-865b-4667-8d90-ee9970952603 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:27.025699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0cafa-865b-4667-8d90-ee9970952603 None admin] RBAC: Adding query filter params (interface=admin, service_id=48cfbf1da33e44b0b1980379cc0fd5e7, region_id=RegionOne) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:27.026009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0cafa-865b-4667-8d90-ee9970952603 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:27.027436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b0cafa-865b-4667-8d90-ee9970952603 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:27.032426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 497/979] 10.222.0.40 () {56 vars in 1249 bytes} [Tue Jul 12 14:22:26 2022] GET /identity/v3/endpoints?service_id=48cfbf1da33e44b0b1980379cc0fd5e7&interface=admin®ion_id=RegionOne => generated 193 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:27.033645 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792bbe5-bdfe-4bb1-b988-2a93d85a3b7a None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:27.033927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792bbe5-bdfe-4bb1-b988-2a93d85a3b7a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:27.034202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792bbe5-bdfe-4bb1-b988-2a93d85a3b7a None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:27.035533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 498/980] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:27.035954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:27.038645 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792bbe5-bdfe-4bb1-b988-2a93d85a3b7a None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:27.060826 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223fe91-bb6b-43ee-94f6-e34247637eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:27.061517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223fe91-bb6b-43ee-94f6-e34247637eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:27.061798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223fe91-bb6b-43ee-94f6-e34247637eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:27.062077 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223fe91-bb6b-43ee-94f6-e34247637eb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:27.130095 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223fe91-bb6b-43ee-94f6-e34247637eb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:27.131600 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223fe91-bb6b-43ee-94f6-e34247637eb8 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:27.140683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792bbe5-bdfe-4bb1-b988-2a93d85a3b7a None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:27.142572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:27.175211 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd06314-b4ac-4303-a0d5-5eb100a1b176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:27.176007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd06314-b4ac-4303-a0d5-5eb100a1b176 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:27.176307 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd06314-b4ac-4303-a0d5-5eb100a1b176 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:27.176580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd06314-b4ac-4303-a0d5-5eb100a1b176 None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:27.177261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd06314-b4ac-4303-a0d5-5eb100a1b176 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:27.178744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd06314-b4ac-4303-a0d5-5eb100a1b176 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:27.186026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 499/981] 10.222.0.40 () {56 vars in 1087 bytes} [Tue Jul 12 14:22:27 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:22:27.188059 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1262d-2f59-49e3-bb5e-014103c1a94d None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:27.188351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1262d-2f59-49e3-bb5e-014103c1a94d None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:27.188630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1262d-2f59-49e3-bb5e-014103c1a94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:27.214533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-83e1262d-2f59-49e3-bb5e-014103c1a94d None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:27.215967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-83e1262d-2f59-49e3-bb5e-014103c1a94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:27.242524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 483/982] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:22:26 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 14:22:27.249114 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223fe91-bb6b-43ee-94f6-e34247637eb8 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:27.262818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:27.312718 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 500/983] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:27.337201 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1262d-2f59-49e3-bb5e-014103c1a94d None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:27.372286 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223fe91-bb6b-43ee-94f6-e34247637eb8 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:27.411012 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b715d5-eeeb-48fe-8609-dee99ee47c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:27.412085 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b715d5-eeeb-48fe-8609-dee99ee47c37 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:27.413092 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b715d5-eeeb-48fe-8609-dee99ee47c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:27.413581 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b715d5-eeeb-48fe-8609-dee99ee47c37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:27.424963 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b715d5-eeeb-48fe-8609-dee99ee47c37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:27.426848 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b715d5-eeeb-48fe-8609-dee99ee47c37 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:27.442796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:27.447528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-99b715d5-eeeb-48fe-8609-dee99ee47c37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:27.447528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:27.447528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:27.447528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:27.447528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:27.447528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:27.447528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:27.447528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:27.447528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:27.447528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:27.447528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:27.447528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:27.447528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:27.447528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:27.447528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:27.448425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:27.448425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:27.448425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:27.448425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:27.448425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:27.448425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:27.448425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:27.448425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:27.448425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:27.448425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:27.448425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:27.448425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:27.448425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:27.448425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:27.448425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:27.448425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:27.448425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:27.449292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:27.449292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:27.449292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:27.449292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:27.449292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 484/984] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:27.449581 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1262d-2f59-49e3-bb5e-014103c1a94d None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:27.454476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b715d5-eeeb-48fe-8609-dee99ee47c37 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:27.485303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c3621-5bdc-4b86-bc7b-58ebd16412fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:27.486061 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c3621-5bdc-4b86-bc7b-58ebd16412fc None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:27.486349 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c3621-5bdc-4b86-bc7b-58ebd16412fc None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:27.486630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c3621-5bdc-4b86-bc7b-58ebd16412fc None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:27.487397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c3621-5bdc-4b86-bc7b-58ebd16412fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:27.488776 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c3621-5bdc-4b86-bc7b-58ebd16412fc None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:27.520530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:27.542309 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 501/985] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Jul 12 14:22:27 2022] POST /identity/v3/services => generated 242 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:22:27.564600 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b715d5-eeeb-48fe-8609-dee99ee47c37 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:27.614151 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532d34a-b399-4b09-acb4-195a157ef74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:27.614846 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532d34a-b399-4b09-acb4-195a157ef74f None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:27.622308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532d34a-b399-4b09-acb4-195a157ef74f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:27.622308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532d34a-b399-4b09-acb4-195a157ef74f None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:27.622308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532d34a-b399-4b09-acb4-195a157ef74f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:27.622308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532d34a-b399-4b09-acb4-195a157ef74f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:27.622308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532d34a-b399-4b09-acb4-195a157ef74f None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:27.638442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 485/986] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:27.640227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c3621-5bdc-4b86-bc7b-58ebd16412fc None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:27.759989 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c3621-5bdc-4b86-bc7b-58ebd16412fc None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:27.796750 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572740e0-e5da-460c-b0c5-06fdc57adf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:27.797550 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572740e0-e5da-460c-b0c5-06fdc57adf70 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:27.797840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572740e0-e5da-460c-b0c5-06fdc57adf70 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:27.798119 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572740e0-e5da-460c-b0c5-06fdc57adf70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:27.806289 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572740e0-e5da-460c-b0c5-06fdc57adf70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:27.807780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572740e0-e5da-460c-b0c5-06fdc57adf70 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:27.822484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-572740e0-e5da-460c-b0c5-06fdc57adf70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:27.822484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:27.822484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:27.822484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:27.822484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:27.822484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:27.822484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:27.822484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:27.822484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:27.822484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:27.822484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:27.822484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:27.822484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:22:27.822484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:22:27.822484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:22:27.823661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:22:27.823661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:27.823661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:27.823661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:27.823661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:27.823661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:27.823661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:27.823661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:27.823661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:27.823661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:27.823661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:27.823661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:27.823661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:27.823661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:27.823661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:27.823661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:27.823661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:27.824583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:22:27.824583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:22:27.824583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:22:27.824583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:22:27.824583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:22:27.824583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:22:27.824583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:27.824583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:27.828490 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 502/987] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:27.829861 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532d34a-b399-4b09-acb4-195a157ef74f None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:27.942684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532d34a-b399-4b09-acb4-195a157ef74f None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:27.961534 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:27.979940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf89c94-5d2d-4adc-87cc-4c5ae1722ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:27.980616 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf89c94-5d2d-4adc-87cc-4c5ae1722ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:27.980906 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf89c94-5d2d-4adc-87cc-4c5ae1722ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:27.981189 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf89c94-5d2d-4adc-87cc-4c5ae1722ac6 None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:27.981988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf89c94-5d2d-4adc-87cc-4c5ae1722ac6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:27.982306 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf89c94-5d2d-4adc-87cc-4c5ae1722ac6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:27.983787 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf89c94-5d2d-4adc-87cc-4c5ae1722ac6 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:28.002946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 486/988] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:22:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:28.004414 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572740e0-e5da-460c-b0c5-06fdc57adf70 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:28.024994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:28.114900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572740e0-e5da-460c-b0c5-06fdc57adf70 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:28.150793 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80025416-eaa2-4865-b2ad-ea31a31c39e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:28.151480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80025416-eaa2-4865-b2ad-ea31a31c39e1 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:28.151770 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80025416-eaa2-4865-b2ad-ea31a31c39e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:28.152049 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80025416-eaa2-4865-b2ad-ea31a31c39e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:28.152893 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80025416-eaa2-4865-b2ad-ea31a31c39e1 None admin] RBAC: Adding query filter params (role.id=89b4a0107e1f484683ef23398bfcb722, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=5ec758ef106b49f4985845b3c106f94b) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:28.153212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80025416-eaa2-4865-b2ad-ea31a31c39e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:28.154641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80025416-eaa2-4865-b2ad-ea31a31c39e1 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:28.167533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 503/989] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:22:28 2022] GET /identity/v3/role_assignments?user.id=5ec758ef106b49f4985845b3c106f94b&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=89b4a0107e1f484683ef23398bfcb722 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:29.256649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30805c65-5aef-425b-a041-12cdb19db68c None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:29.257168 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30805c65-5aef-425b-a041-12cdb19db68c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:29.257246 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30805c65-5aef-425b-a041-12cdb19db68c None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:29.258739 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 487/990] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:29.263817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16c7f6-3e23-47c5-8900-252875508c59 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:29.264253 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16c7f6-3e23-47c5-8900-252875508c59 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:29.264443 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16c7f6-3e23-47c5-8900-252875508c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:29.281724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-4d16c7f6-3e23-47c5-8900-252875508c59 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:29.282914 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-4d16c7f6-3e23-47c5-8900-252875508c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:29.359524 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 504/991] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:29.377703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30805c65-5aef-425b-a041-12cdb19db68c None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:29.480379 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30805c65-5aef-425b-a041-12cdb19db68c None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:29.515730 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3dd003-480b-41ac-8cb2-018e9226154f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:29.516468 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dd003-480b-41ac-8cb2-018e9226154f None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:29.516739 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dd003-480b-41ac-8cb2-018e9226154f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:29.517013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dd003-480b-41ac-8cb2-018e9226154f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:29.517666 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3dd003-480b-41ac-8cb2-018e9226154f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:29.519026 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3dd003-480b-41ac-8cb2-018e9226154f None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:29.531068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-dd3dd003-480b-41ac-8cb2-018e9226154f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:22:29.531068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:29.531068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:29.531068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:29.531068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:29.531068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:29.531068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:29.531068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:29.531068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:22:29.531068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:29.531068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:29.531068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:29.531068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:29.531068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:29.531068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:29.531068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:29.531068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:29.532165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:29.532165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:29.532165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:29.532165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:29.532165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:29.532165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:29.532165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:29.532165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:29.532165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:29.532165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:29.532165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:29.532165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:29.532165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:29.532165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:29.532165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:29.532165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:29.532982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:29.532982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:29.532982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:29.532982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:29.532982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:29.532982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:29.532982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:29.532982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:29.532982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:29.532982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:29.532982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:29.532982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:29.532982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 14:22:29.532982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:29.535360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 488/992] 10.222.0.40 () {56 vars in 1126 bytes} [Tue Jul 12 14:22:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:29.538503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16c7f6-3e23-47c5-8900-252875508c59 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:29.550145 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:29.640364 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16c7f6-3e23-47c5-8900-252875508c59 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:29.643063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf511b3-949b-4f89-aa1d-839a9538be22 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:29.643379 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf511b3-949b-4f89-aa1d-839a9538be22 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:29.643661 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf511b3-949b-4f89-aa1d-839a9538be22 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:29.645155 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 489/993] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:29.650363 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e37cd-f56a-4c7c-9345-5af3f9c45aeb None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:29.650654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e37cd-f56a-4c7c-9345-5af3f9c45aeb None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:29.650940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e37cd-f56a-4c7c-9345-5af3f9c45aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:29.669713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-fb7e37cd-f56a-4c7c-9345-5af3f9c45aeb None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:29.670911 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fb7e37cd-f56a-4c7c-9345-5af3f9c45aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:29.677051 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ebaac-befc-4903-b25d-5d77a7353384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:29.678367 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ebaac-befc-4903-b25d-5d77a7353384 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:29.678657 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ebaac-befc-4903-b25d-5d77a7353384 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:29.678939 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ebaac-befc-4903-b25d-5d77a7353384 None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:29.679743 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ebaac-befc-4903-b25d-5d77a7353384 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:29.680001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ebaac-befc-4903-b25d-5d77a7353384 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:29.681494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ebaac-befc-4903-b25d-5d77a7353384 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:29.686725 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 505/994] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Jul 12 14:22:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:29.692263 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ebaac-befc-4903-b25d-5d77a7353384 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:29.713942 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:29.750729 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 490/995] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:22:29.773536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e37cd-f56a-4c7c-9345-5af3f9c45aeb None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:29.773976 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:29.806523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ebaac-befc-4903-b25d-5d77a7353384 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:29.850451 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4f3b7-9eb2-4976-b03e-372078d6401c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:29.851118 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4f3b7-9eb2-4976-b03e-372078d6401c None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:29.851433 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4f3b7-9eb2-4976-b03e-372078d6401c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:29.851714 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4f3b7-9eb2-4976-b03e-372078d6401c None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:29.852424 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4f3b7-9eb2-4976-b03e-372078d6401c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:29.852917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4f3b7-9eb2-4976-b03e-372078d6401c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:29.854088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4f3b7-9eb2-4976-b03e-372078d6401c None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:29.860503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 506/996] 10.222.0.40 () {56 vars in 1122 bytes} [Tue Jul 12 14:22:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:29.866585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4f3b7-9eb2-4976-b03e-372078d6401c None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:29.879024 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e37cd-f56a-4c7c-9345-5af3f9c45aeb None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:29.918379 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840776c9-2a91-4d46-8ceb-03b263d12b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:29.919197 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840776c9-2a91-4d46-8ceb-03b263d12b9d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:29.919516 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840776c9-2a91-4d46-8ceb-03b263d12b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:29.919801 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840776c9-2a91-4d46-8ceb-03b263d12b9d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:29.920594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840776c9-2a91-4d46-8ceb-03b263d12b9d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:29.922029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840776c9-2a91-4d46-8ceb-03b263d12b9d None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:29.935904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-840776c9-2a91-4d46-8ceb-03b263d12b9d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 14:22:29.935904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:29.935904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:29.935904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:29.935904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:29.935904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:29.935904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:29.935904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:29.935904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 14:22:29.935904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:29.935904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:29.935904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:29.935904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:29.935904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:29.935904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:29.935904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:29.935904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:29.937105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:29.937105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:29.937105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:29.937105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:29.937105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:29.937105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:29.937105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:29.937105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:29.937105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:29.937105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:29.937105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:29.937105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:29.937105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:29.937105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:29.937105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:29.937105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:29.937989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:29.937989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:29.937989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:29.937989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:29.937989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:29.937989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:29.937989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:29.937989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:29.937989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:29.937989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:29.937989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:29.937989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:29.937989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 14:22:29.937989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:29.937989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 491/997] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:29.944030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840776c9-2a91-4d46-8ceb-03b263d12b9d None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:29.974472 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4f3b7-9eb2-4976-b03e-372078d6401c None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:29.981733 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:30.012128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b71e0-a41f-4785-ac2a-ebbcc0f60c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:30.012787 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b71e0-a41f-4785-ac2a-ebbcc0f60c1e None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:30.013071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b71e0-a41f-4785-ac2a-ebbcc0f60c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:30.013349 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b71e0-a41f-4785-ac2a-ebbcc0f60c1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:30.014097 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b71e0-a41f-4785-ac2a-ebbcc0f60c1e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:30.015503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b71e0-a41f-4785-ac2a-ebbcc0f60c1e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:30.055610 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840776c9-2a91-4d46-8ceb-03b263d12b9d None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:30.057777 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:30.065485 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 507/998] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Jul 12 14:22:29 2022] POST /identity/v3/endpoints => generated 325 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:22:30.112311 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec7dce-fc78-479c-bccd-915c4241471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:30.113000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec7dce-fc78-479c-bccd-915c4241471c None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:30.113283 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec7dce-fc78-479c-bccd-915c4241471c None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:30.113552 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec7dce-fc78-479c-bccd-915c4241471c None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:30.114283 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec7dce-fc78-479c-bccd-915c4241471c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:30.114590 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec7dce-fc78-479c-bccd-915c4241471c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:30.116926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec7dce-fc78-479c-bccd-915c4241471c None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:30.128281 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 492/999] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Jul 12 14:22:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:30.130213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b71e0-a41f-4785-ac2a-ebbcc0f60c1e None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:30.249831 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b71e0-a41f-4785-ac2a-ebbcc0f60c1e None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:30.252292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba103cc7-3a94-4832-9a17-70ff010d89ee None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:30.252592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba103cc7-3a94-4832-9a17-70ff010d89ee None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:30.252882 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba103cc7-3a94-4832-9a17-70ff010d89ee None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:30.254403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 493/1000] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:30.259641 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884b64a-84fd-4dbe-bf82-0bb89191e3e0 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:30.260217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884b64a-84fd-4dbe-bf82-0bb89191e3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:30.260217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884b64a-84fd-4dbe-bf82-0bb89191e3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:30.280389 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-b884b64a-84fd-4dbe-bf82-0bb89191e3e0 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:30.281602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b884b64a-84fd-4dbe-bf82-0bb89191e3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:30.290395 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14a2c3-0cde-4048-a567-ca7c2e1681c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:30.291068 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14a2c3-0cde-4048-a567-ca7c2e1681c6 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:30.291380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14a2c3-0cde-4048-a567-ca7c2e1681c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:30.291664 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14a2c3-0cde-4048-a567-ca7c2e1681c6 None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:30.292382 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14a2c3-0cde-4048-a567-ca7c2e1681c6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:30.292689 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14a2c3-0cde-4048-a567-ca7c2e1681c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:30.294063 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14a2c3-0cde-4048-a567-ca7c2e1681c6 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:30.299136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 508/1001] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Jul 12 14:22:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:30.306267 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14a2c3-0cde-4048-a567-ca7c2e1681c6 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:30.360385 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 494/1002] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:22:30.375163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:30.382453 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884b64a-84fd-4dbe-bf82-0bb89191e3e0 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:30.410115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:30.418660 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14a2c3-0cde-4048-a567-ca7c2e1681c6 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:30.454549 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee7b96-0f8d-404f-a1f6-64395963223f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:30.455207 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee7b96-0f8d-404f-a1f6-64395963223f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:30.455524 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee7b96-0f8d-404f-a1f6-64395963223f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:30.455802 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee7b96-0f8d-404f-a1f6-64395963223f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:30.456606 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee7b96-0f8d-404f-a1f6-64395963223f None admin] RBAC: Adding query filter params (interface=public, service_id=9acd67ea9f8046b9a9fcbac0defb0a5c, region_id=RegionOne) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:30.456899 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee7b96-0f8d-404f-a1f6-64395963223f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:30.458255 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee7b96-0f8d-404f-a1f6-64395963223f None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:30.464008 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 509/1003] 10.222.0.40 () {56 vars in 1251 bytes} [Tue Jul 12 14:22:30 2022] GET /identity/v3/endpoints?service_id=9acd67ea9f8046b9a9fcbac0defb0a5c&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:30.469700 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee7b96-0f8d-404f-a1f6-64395963223f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:30.495686 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884b64a-84fd-4dbe-bf82-0bb89191e3e0 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:30.532790 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8793054-491f-4cb0-bec3-a0f73f13817a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:30.533594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8793054-491f-4cb0-bec3-a0f73f13817a None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:30.533877 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8793054-491f-4cb0-bec3-a0f73f13817a None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:30.534155 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8793054-491f-4cb0-bec3-a0f73f13817a None admin] PATH_INFO: `/v3/services/image` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:30.534827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8793054-491f-4cb0-bec3-a0f73f13817a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:30.536225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8793054-491f-4cb0-bec3-a0f73f13817a None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:30.548227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-c8793054-491f-4cb0-bec3-a0f73f13817a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 14:22:30.548227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:30.548227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:30.548227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:30.548227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:30.548227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:30.548227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:30.548227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:30.548227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 14:22:30.548227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:30.548227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:30.548227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:30.548227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:30.548227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:30.548227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:30.548227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:30.548227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:30.549489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:30.549489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:30.549489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:30.549489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:30.549489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:30.549489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:30.549489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:30.549489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:30.549489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:30.549489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:30.549489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:30.549489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:30.549489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:30.549489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:30.549489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:30.549489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:30.550530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:30.550530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:30.550530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:30.550530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:30.550530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:30.550530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:30.550530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:30.550530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:30.550530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:30.550530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:30.550530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:30.550530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:30.550530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 14:22:30.550530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:30.554764 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 495/1004] 10.222.0.40 () {56 vars in 1105 bytes} [Tue Jul 12 14:22:30 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:30.555711 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8793054-491f-4cb0-bec3-a0f73f13817a None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:30.579461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee7b96-0f8d-404f-a1f6-64395963223f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:30.606855 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:30.615688 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34040606-bca6-483e-8186-b744e2cb6493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:30.616520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34040606-bca6-483e-8186-b744e2cb6493 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:30.616808 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34040606-bca6-483e-8186-b744e2cb6493 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:30.617086 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34040606-bca6-483e-8186-b744e2cb6493 None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:30.617773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34040606-bca6-483e-8186-b744e2cb6493 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:30.619213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34040606-bca6-483e-8186-b744e2cb6493 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:30.626141 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 510/1005] 10.222.0.40 () {56 vars in 1087 bytes} [Tue Jul 12 14:22:30 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:22:30.669132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:30.680324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8793054-491f-4cb0-bec3-a0f73f13817a None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:30.719071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b297f5-736d-45cc-9760-0f0e2811ee50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:30.719795 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b297f5-736d-45cc-9760-0f0e2811ee50 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:30.720079 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b297f5-736d-45cc-9760-0f0e2811ee50 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:30.720354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b297f5-736d-45cc-9760-0f0e2811ee50 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:30.721078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b297f5-736d-45cc-9760-0f0e2811ee50 None admin] RBAC: Adding query filter params (name=image) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:30.721387 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b297f5-736d-45cc-9760-0f0e2811ee50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:30.722790 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b297f5-736d-45cc-9760-0f0e2811ee50 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:30.728716 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 496/1006] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:30.734552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34040606-bca6-483e-8186-b744e2cb6493 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:30.845670 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34040606-bca6-483e-8186-b744e2cb6493 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:30.880649 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4a6c6-043f-488e-b85e-e58c0c29b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:30.882090 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a6c6-043f-488e-b85e-e58c0c29b060 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:30.882376 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a6c6-043f-488e-b85e-e58c0c29b060 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:30.882649 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a6c6-043f-488e-b85e-e58c0c29b060 None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:30.883415 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4a6c6-043f-488e-b85e-e58c0c29b060 None admin] RBAC: Adding query filter params (type=image) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:30.883726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4a6c6-043f-488e-b85e-e58c0c29b060 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:30.885086 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4a6c6-043f-488e-b85e-e58c0c29b060 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:30.897336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 511/1007] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:30 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:32.160897 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdc6a1-3eb5-4aae-ac9c-12c16c19185c None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:32.161562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdc6a1-3eb5-4aae-ac9c-12c16c19185c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:32.161562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdc6a1-3eb5-4aae-ac9c-12c16c19185c None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:32.163827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 497/1008] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:32.170861 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bd816-5c9e-4c5f-a8dc-213975ba4f72 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:32.171344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bd816-5c9e-4c5f-a8dc-213975ba4f72 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:32.171450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bd816-5c9e-4c5f-a8dc-213975ba4f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:32.192277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-3e0bd816-5c9e-4c5f-a8dc-213975ba4f72 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:32.193499 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-3e0bd816-5c9e-4c5f-a8dc-213975ba4f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:32.263938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:32.282537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 512/1009] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:32 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:32.306998 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdc6a1-3eb5-4aae-ac9c-12c16c19185c None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:32.444375 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdc6a1-3eb5-4aae-ac9c-12c16c19185c None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:32.484480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533a7be-feaa-4fcf-a551-8c0a7e405662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:32.485666 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533a7be-feaa-4fcf-a551-8c0a7e405662 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:32.486188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533a7be-feaa-4fcf-a551-8c0a7e405662 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:32.486670 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533a7be-feaa-4fcf-a551-8c0a7e405662 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:32.488139 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533a7be-feaa-4fcf-a551-8c0a7e405662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:32.489803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533a7be-feaa-4fcf-a551-8c0a7e405662 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:32.497496 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 498/1010] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:32.500578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bd816-5c9e-4c5f-a8dc-213975ba4f72 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:32.629984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bd816-5c9e-4c5f-a8dc-213975ba4f72 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:32.671087 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a389ad-d3d7-4aad-a1df-377270089e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:32.672192 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a389ad-d3d7-4aad-a1df-377270089e8e None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:32.672712 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a389ad-d3d7-4aad-a1df-377270089e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:32.673411 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a389ad-d3d7-4aad-a1df-377270089e8e None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:32.674673 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a389ad-d3d7-4aad-a1df-377270089e8e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:32.676389 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a389ad-d3d7-4aad-a1df-377270089e8e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:32.689555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e033d3-95dd-4f7c-9cd6-66129b4e09f9 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:32.689928 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e033d3-95dd-4f7c-9cd6-66129b4e09f9 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:32.690283 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e033d3-95dd-4f7c-9cd6-66129b4e09f9 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:32.692572 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 499/1011] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:22:32.698740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec70bd-9858-4869-a378-0c6f941605e4 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:32.698953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec70bd-9858-4869-a378-0c6f941605e4 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:32.699309 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec70bd-9858-4869-a378-0c6f941605e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:32.722130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-18ec70bd-9858-4869-a378-0c6f941605e4 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:32.723367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-18ec70bd-9858-4869-a378-0c6f941605e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:32.743206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:32.757434 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 513/1012] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Jul 12 14:22:32 2022] POST /identity/v3/projects => generated 311 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:22:32.825104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 500/1013] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:32 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:32.848757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a389ad-d3d7-4aad-a1df-377270089e8e None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:32.893300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:32.933063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954eed3f-82f3-4936-97f0-89bab65bfd0e None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:32.933374 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954eed3f-82f3-4936-97f0-89bab65bfd0e None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:32.933632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954eed3f-82f3-4936-97f0-89bab65bfd0e None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:32.935051 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 501/1014] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:22:32.940659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb548c9-59a6-42e2-a51b-90770b681d33 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:32.941200 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb548c9-59a6-42e2-a51b-90770b681d33 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:32.941684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb548c9-59a6-42e2-a51b-90770b681d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:32.964361 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-cdb548c9-59a6-42e2-a51b-90770b681d33 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:32.965479 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-cdb548c9-59a6-42e2-a51b-90770b681d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:32.980431 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a389ad-d3d7-4aad-a1df-377270089e8e None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:33.019880 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a06d0-20fc-46b1-8d12-392e0c0e949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:33.020687 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a06d0-20fc-46b1-8d12-392e0c0e949e None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:33.020971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a06d0-20fc-46b1-8d12-392e0c0e949e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:33.021248 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a06d0-20fc-46b1-8d12-392e0c0e949e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:33.022472 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a06d0-20fc-46b1-8d12-392e0c0e949e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:33.023936 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a06d0-20fc-46b1-8d12-392e0c0e949e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:33.036819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-6d4a06d0-20fc-46b1-8d12-392e0c0e949e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 14:22:33.036819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:33.036819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:33.036819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:33.036819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:33.036819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:33.036819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:33.036819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:33.036819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 14:22:33.036819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:33.036819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:33.036819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:33.036819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:33.036819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:33.036819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:33.036819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:33.036819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:33.037994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:33.037994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:33.037994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:33.037994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:33.037994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:33.037994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:33.037994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:33.037994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:33.037994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:33.037994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:33.037994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:33.037994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:33.037994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:33.037994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:33.037994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:33.037994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:33.038834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:33.038834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:33.038834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:33.038834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:33.038834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:33.038834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:33.038834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:33.038834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:33.038834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:33.038834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:33.038834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:33.038834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:33.038834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 14:22:33.038834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:33.038834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 514/1015] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:33.044173 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a06d0-20fc-46b1-8d12-392e0c0e949e None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:33.059742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 502/1016] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:32 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:22:33.085380 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb548c9-59a6-42e2-a51b-90770b681d33 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:33.171187 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:33.174714 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a06d0-20fc-46b1-8d12-392e0c0e949e None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:33.181853 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:33.207827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb548c9-59a6-42e2-a51b-90770b681d33 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:33.227110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579d86f-356a-4454-ba98-f5bf115b1dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:33.227724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579d86f-356a-4454-ba98-f5bf115b1dcd None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:33.228010 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579d86f-356a-4454-ba98-f5bf115b1dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:33.228313 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579d86f-356a-4454-ba98-f5bf115b1dcd None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:33.229008 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579d86f-356a-4454-ba98-f5bf115b1dcd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:33.229317 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579d86f-356a-4454-ba98-f5bf115b1dcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:33.230697 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579d86f-356a-4454-ba98-f5bf115b1dcd None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:33.236628 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 515/1017] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Jul 12 14:22:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:33.242673 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579d86f-356a-4454-ba98-f5bf115b1dcd None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:33.265206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2314093-8abe-4bf5-9581-a880e3612398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:33.265948 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2314093-8abe-4bf5-9581-a880e3612398 None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:33.266237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2314093-8abe-4bf5-9581-a880e3612398 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:33.266567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2314093-8abe-4bf5-9581-a880e3612398 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:33.267431 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2314093-8abe-4bf5-9581-a880e3612398 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:33.268917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2314093-8abe-4bf5-9581-a880e3612398 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:33.355632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579d86f-356a-4454-ba98-f5bf115b1dcd None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:33.371041 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 503/1018] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Jul 12 14:22:33 2022] POST /identity/v3/services => generated 242 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:22:33.414299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de492ffe-df02-4b46-abdc-431e0647e50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:33.414957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de492ffe-df02-4b46-abdc-431e0647e50a None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:33.415302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de492ffe-df02-4b46-abdc-431e0647e50a None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:33.415600 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de492ffe-df02-4b46-abdc-431e0647e50a None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:33.416377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de492ffe-df02-4b46-abdc-431e0647e50a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:33.416689 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de492ffe-df02-4b46-abdc-431e0647e50a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:33.418157 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de492ffe-df02-4b46-abdc-431e0647e50a None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:33.429316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 516/1019] 10.222.0.40 () {56 vars in 1112 bytes} [Tue Jul 12 14:22:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:33.430924 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2314093-8abe-4bf5-9581-a880e3612398 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:33.554460 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2314093-8abe-4bf5-9581-a880e3612398 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:33.596113 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1805fc-299c-4fdc-ab2f-a02495fe3178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:33.596779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1805fc-299c-4fdc-ab2f-a02495fe3178 None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:33.597067 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1805fc-299c-4fdc-ab2f-a02495fe3178 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:33.597529 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1805fc-299c-4fdc-ab2f-a02495fe3178 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:33.598295 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1805fc-299c-4fdc-ab2f-a02495fe3178 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:33.599734 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1805fc-299c-4fdc-ab2f-a02495fe3178 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:33.675147 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:33.687305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 504/1020] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Jul 12 14:22:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:22:34.999454 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2f7b9-2c46-427c-954f-4466c03b8230 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:34.999982 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2f7b9-2c46-427c-954f-4466c03b8230 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:35.000117 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2f7b9-2c46-427c-954f-4466c03b8230 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:35.001445 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 517/1021] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:35.008237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de3bdc-02ce-4a25-bd39-3edc73075a44 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:35.008749 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de3bdc-02ce-4a25-bd39-3edc73075a44 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:35.008822 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de3bdc-02ce-4a25-bd39-3edc73075a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:35.026881 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-03de3bdc-02ce-4a25-bd39-3edc73075a44 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:35.028122 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-03de3bdc-02ce-4a25-bd39-3edc73075a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:35.105465 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 505/1022] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:35.131626 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2f7b9-2c46-427c-954f-4466c03b8230 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:35.158332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:35.244697 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2f7b9-2c46-427c-954f-4466c03b8230 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:35.286058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd911e16-ee00-4089-90b1-888a5c213fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:35.286787 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd911e16-ee00-4089-90b1-888a5c213fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:35.287105 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd911e16-ee00-4089-90b1-888a5c213fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:35.287422 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd911e16-ee00-4089-90b1-888a5c213fc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:35.288716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd911e16-ee00-4089-90b1-888a5c213fc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:35.290213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd911e16-ee00-4089-90b1-888a5c213fc7 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:35.296609 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 518/1023] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:35.297866 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de3bdc-02ce-4a25-bd39-3edc73075a44 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:35.407059 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de3bdc-02ce-4a25-bd39-3edc73075a44 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:35.434485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:35.446662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65c924-633d-4df7-a5eb-0f05b75bfc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:35.447381 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65c924-633d-4df7-a5eb-0f05b75bfc5a None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:35.447671 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65c924-633d-4df7-a5eb-0f05b75bfc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:35.447950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65c924-633d-4df7-a5eb-0f05b75bfc5a None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:35.451525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65c924-633d-4df7-a5eb-0f05b75bfc5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:35.451525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65c924-633d-4df7-a5eb-0f05b75bfc5a None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:35.531375 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 506/1024] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Jul 12 14:22:35 2022] POST /identity/v3/users => generated 285 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:22:35.531579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf904ce-1f24-496d-a8f5-62c99a95ac06 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:35.531579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf904ce-1f24-496d-a8f5-62c99a95ac06 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:35.531579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf904ce-1f24-496d-a8f5-62c99a95ac06 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:35.531579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 519/1025] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:35.535730 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06e41c-624f-450d-a52b-a0b5de2669e4 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:35.536027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06e41c-624f-450d-a52b-a0b5de2669e4 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:35.536510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06e41c-624f-450d-a52b-a0b5de2669e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:35.555952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-bb06e41c-624f-450d-a52b-a0b5de2669e4 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:35.557250 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-bb06e41c-624f-450d-a52b-a0b5de2669e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:35.639724 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 507/1026] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:35.664704 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf904ce-1f24-496d-a8f5-62c99a95ac06 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:35.772960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:35.790560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf904ce-1f24-496d-a8f5-62c99a95ac06 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:35.833158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56a9fd-bc78-4bca-b892-61d645143652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:35.834516 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56a9fd-bc78-4bca-b892-61d645143652 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:35.834798 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56a9fd-bc78-4bca-b892-61d645143652 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:35.835070 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56a9fd-bc78-4bca-b892-61d645143652 None admin] PATH_INFO: `/v3/services/image` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:35.835753 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56a9fd-bc78-4bca-b892-61d645143652 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:35.837193 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56a9fd-bc78-4bca-b892-61d645143652 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:35.849295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-0d56a9fd-bc78-4bca-b892-61d645143652 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 14:22:35.849295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:35.849295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:35.849295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:35.849295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:35.849295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:35.849295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:35.849295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:35.849295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 14:22:35.849295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:35.849295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:35.849295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:35.849295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:35.849295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:35.849295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:35.849295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:35.849295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:35.850641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:35.850641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:35.850641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:35.850641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:35.850641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:35.850641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:35.850641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:35.850641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:35.850641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:35.850641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:35.850641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:35.850641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:35.850641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:35.850641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:35.850641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:35.850641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:35.851901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:35.851901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:35.851901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:35.851901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:35.851901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:35.851901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:35.851901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:35.851901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:35.851901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:35.851901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:35.851901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:35.851901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:35.851901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 14:22:35.851901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:35.851901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 520/1027] 10.222.0.40 () {56 vars in 1105 bytes} [Tue Jul 12 14:22:35 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:35.860550 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06e41c-624f-450d-a52b-a0b5de2669e4 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:35.925646 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd905504-ca36-4ed7-aa52-536bf3be9971 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:35.925967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd905504-ca36-4ed7-aa52-536bf3be9971 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:35.926208 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd905504-ca36-4ed7-aa52-536bf3be9971 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:35.927811 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 521/1028] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:35.932496 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40127609-3b15-49ac-8f67-cc075f2435d3 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:35.932787 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40127609-3b15-49ac-8f67-cc075f2435d3 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:35.933067 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40127609-3b15-49ac-8f67-cc075f2435d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:35.950825 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-40127609-3b15-49ac-8f67-cc075f2435d3 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:35.952043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-40127609-3b15-49ac-8f67-cc075f2435d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:36.009860 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06e41c-624f-450d-a52b-a0b5de2669e4 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:36.023336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:36.027329 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 522/1029] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:22:36.049360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e08e1-4180-47aa-b59d-8ffadcc6a6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:36.050293 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e08e1-4180-47aa-b59d-8ffadcc6a6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:36.050654 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40127609-3b15-49ac-8f67-cc075f2435d3 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:36.051013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e08e1-4180-47aa-b59d-8ffadcc6a6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:36.051813 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e08e1-4180-47aa-b59d-8ffadcc6a6f9 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:36.053345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e08e1-4180-47aa-b59d-8ffadcc6a6f9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:36.054197 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e08e1-4180-47aa-b59d-8ffadcc6a6f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:36.055967 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e08e1-4180-47aa-b59d-8ffadcc6a6f9 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:36.061987 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 508/1030] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:36.068063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e08e1-4180-47aa-b59d-8ffadcc6a6f9 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:36.153778 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:36.171528 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40127609-3b15-49ac-8f67-cc075f2435d3 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:36.199981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e08e1-4180-47aa-b59d-8ffadcc6a6f9 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:36.210118 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92132c08-032b-43c3-b744-ac5a410b3d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:36.211125 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92132c08-032b-43c3-b744-ac5a410b3d1c None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:36.211444 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92132c08-032b-43c3-b744-ac5a410b3d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:36.211728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92132c08-032b-43c3-b744-ac5a410b3d1c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:36.222687 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92132c08-032b-43c3-b744-ac5a410b3d1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:36.233850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-92132c08-032b-43c3-b744-ac5a410b3d1c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:22:36.233850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:36.233850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:36.233850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:36.233850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:36.233850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:36.233850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:36.233850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:36.233850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:36.233850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:36.233850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:36.233850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:36.233850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:36.233850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:36.233850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:36.233850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:36.234898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:36.234898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:36.234898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:36.234898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:36.234898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:36.234898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:36.234898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:36.234898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:36.234898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:36.234898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:36.234898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:36.234898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:36.234898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:36.234898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:36.234898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:36.234898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:36.235863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:36.235863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:36.235863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:36.235863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:36.235863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:36.235863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:36.235863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:36.235863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:36.235863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:36.235863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:36.235863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:22:36.235863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:36.235863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 523/1031] 10.222.0.40 () {56 vars in 1120 bytes} [Tue Jul 12 14:22:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:36.243138 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92132c08-032b-43c3-b744-ac5a410b3d1c None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:36.254263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa3af7-ca9e-4ced-8ae3-3807ffc401a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:36.255358 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa3af7-ca9e-4ced-8ae3-3807ffc401a5 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:36.256839 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa3af7-ca9e-4ced-8ae3-3807ffc401a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:36.257391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa3af7-ca9e-4ced-8ae3-3807ffc401a5 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:36.259889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa3af7-ca9e-4ced-8ae3-3807ffc401a5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:36.260481 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa3af7-ca9e-4ced-8ae3-3807ffc401a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:36.262945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa3af7-ca9e-4ced-8ae3-3807ffc401a5 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:36.270426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 509/1032] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:36.278157 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa3af7-ca9e-4ced-8ae3-3807ffc401a5 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:36.334024 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:36.364633 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92132c08-032b-43c3-b744-ac5a410b3d1c None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:36.405822 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa3af7-ca9e-4ced-8ae3-3807ffc401a5 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:36.408497 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a6ece-ab43-46c7-aa6a-65e9d8aed8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:36.409203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a6ece-ab43-46c7-aa6a-65e9d8aed8da None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:36.409493 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a6ece-ab43-46c7-aa6a-65e9d8aed8da None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:36.409873 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a6ece-ab43-46c7-aa6a-65e9d8aed8da None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:36.410663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a6ece-ab43-46c7-aa6a-65e9d8aed8da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:36.410977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a6ece-ab43-46c7-aa6a-65e9d8aed8da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:36.412929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a6ece-ab43-46c7-aa6a-65e9d8aed8da None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:36.430153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 524/1033] 10.222.0.40 () {56 vars in 1115 bytes} [Tue Jul 12 14:22:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:36.431390 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a6ece-ab43-46c7-aa6a-65e9d8aed8da None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:36.446049 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:36.457783 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c2719-0486-4222-9f00-5dfc43bc9946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:36.458467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c2719-0486-4222-9f00-5dfc43bc9946 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:36.458864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c2719-0486-4222-9f00-5dfc43bc9946 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:36.459716 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c2719-0486-4222-9f00-5dfc43bc9946 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:36.460570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c2719-0486-4222-9f00-5dfc43bc9946 None admin] RBAC: Adding query filter params (interface=public, service_id=c946ae3d034a43c1b8f7c9a3302cf54a, region_id=RegionOne) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:36.460890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c2719-0486-4222-9f00-5dfc43bc9946 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:36.462288 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c2719-0486-4222-9f00-5dfc43bc9946 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:36.468442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 510/1034] 10.222.0.40 () {56 vars in 1251 bytes} [Tue Jul 12 14:22:36 2022] GET /identity/v3/endpoints?service_id=c946ae3d034a43c1b8f7c9a3302cf54a&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:36.474150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c2719-0486-4222-9f00-5dfc43bc9946 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:36.560869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a6ece-ab43-46c7-aa6a-65e9d8aed8da None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:36.605122 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c2719-0486-4222-9f00-5dfc43bc9946 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:36.607027 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522467e-b1b3-4523-8a31-f2a8dfb72414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:36.607886 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522467e-b1b3-4523-8a31-f2a8dfb72414 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:36.608176 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522467e-b1b3-4523-8a31-f2a8dfb72414 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:36.608453 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522467e-b1b3-4523-8a31-f2a8dfb72414 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:36.610316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:36.621166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522467e-b1b3-4523-8a31-f2a8dfb72414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:36.622693 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522467e-b1b3-4523-8a31-f2a8dfb72414 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:36.642420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-6522467e-b1b3-4523-8a31-f2a8dfb72414 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:36.642420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:36.642420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:36.642420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:36.642420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:36.642420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:36.642420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:36.642420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:36.642420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:36.642420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:36.642420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:36.642420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:36.642420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:36.642420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:36.642420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:36.643458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:36.643458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:36.643458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:36.643458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:36.643458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:36.643458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:36.643458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:36.643458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:36.643458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:36.643458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:36.643458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:36.643458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:36.643458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:36.643458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:36.643458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:36.643458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:36.643458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:36.644430 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:36.644430 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:36.644430 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:36.644430 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:36.644430 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 525/1035] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:36.650000 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522467e-b1b3-4523-8a31-f2a8dfb72414 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:36.652970 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80300252-cb01-43aa-b424-0c03a8b82efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:36.653661 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80300252-cb01-43aa-b424-0c03a8b82efd None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:36.653953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80300252-cb01-43aa-b424-0c03a8b82efd None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:36.654234 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80300252-cb01-43aa-b424-0c03a8b82efd None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:36.654957 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80300252-cb01-43aa-b424-0c03a8b82efd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:36.656430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80300252-cb01-43aa-b424-0c03a8b82efd None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:36.669474 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 511/1036] 10.222.0.40 () {56 vars in 1087 bytes} [Tue Jul 12 14:22:36 2022] GET /identity/v3/services => generated 1957 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:22:36.734227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:36.799584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522467e-b1b3-4523-8a31-f2a8dfb72414 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:36.845107 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b620f-280d-4aff-9df0-3a8033b4dc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:36.846101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b620f-280d-4aff-9df0-3a8033b4dc6f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:36.846378 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b620f-280d-4aff-9df0-3a8033b4dc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:36.846656 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b620f-280d-4aff-9df0-3a8033b4dc6f None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:36.847437 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b620f-280d-4aff-9df0-3a8033b4dc6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:36.847756 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b620f-280d-4aff-9df0-3a8033b4dc6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:36.849159 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b620f-280d-4aff-9df0-3a8033b4dc6f None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:36.866245 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 526/1037] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:36.872417 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80300252-cb01-43aa-b424-0c03a8b82efd None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:36.997325 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80300252-cb01-43aa-b424-0c03a8b82efd None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:37.039167 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f26256-8b05-4b39-a5bd-d6156b0b95b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:37.040115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f26256-8b05-4b39-a5bd-d6156b0b95b2 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:37.040400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f26256-8b05-4b39-a5bd-d6156b0b95b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:37.040669 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f26256-8b05-4b39-a5bd-d6156b0b95b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:37.048437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f26256-8b05-4b39-a5bd-d6156b0b95b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:37.049872 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f26256-8b05-4b39-a5bd-d6156b0b95b2 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:37.067074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-58f26256-8b05-4b39-a5bd-d6156b0b95b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:22:37.067074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:37.067074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:37.067074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:37.067074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:37.067074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:37.067074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:37.067074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:37.067074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:37.067074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:37.067074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:37.067074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:37.067074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:22:37.067074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:22:37.067074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:22:37.067074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:22:37.068949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:37.068949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:37.068949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:22:37.068949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:37.068949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:22:37.068949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:37.068949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:37.068949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:37.068949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:37.068949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:37.068949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:37.068949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:37.068949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:37.068949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:37.068949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:37.068949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:37.068949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:37.068949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:37.070224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:37.070224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:37.070224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:22:37.070224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:22:37.070224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:22:37.070224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:22:37.070224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:22:37.070224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:22:37.070224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:22:37.070224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:37.070224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 512/1038] 10.222.0.40 () {56 vars in 1093 bytes} [Tue Jul 12 14:22:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:37.081552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b620f-280d-4aff-9df0-3a8033b4dc6f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:37.211182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b620f-280d-4aff-9df0-3a8033b4dc6f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:37.233268 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:37.253821 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe658ad-4c11-4877-afd3-631bd4677dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:37.254498 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe658ad-4c11-4877-afd3-631bd4677dca None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:37.254780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe658ad-4c11-4877-afd3-631bd4677dca None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:37.255055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe658ad-4c11-4877-afd3-631bd4677dca None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:37.256421 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe658ad-4c11-4877-afd3-631bd4677dca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:37.256796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe658ad-4c11-4877-afd3-631bd4677dca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:37.258225 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe658ad-4c11-4877-afd3-631bd4677dca None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:37.281083 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 527/1039] 10.222.0.40 () {56 vars in 1133 bytes} [Tue Jul 12 14:22:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:37.282266 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f26256-8b05-4b39-a5bd-d6156b0b95b2 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:37.310656 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:37.385962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f26256-8b05-4b39-a5bd-d6156b0b95b2 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:37.423178 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99e424-ce04-4dd4-a072-0578783b4592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:37.423871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99e424-ce04-4dd4-a072-0578783b4592 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:37.424157 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99e424-ce04-4dd4-a072-0578783b4592 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:37.424436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99e424-ce04-4dd4-a072-0578783b4592 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:37.496521 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99e424-ce04-4dd4-a072-0578783b4592 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:37.497881 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99e424-ce04-4dd4-a072-0578783b4592 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:37.525074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:37.608110 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 513/1040] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:22:37 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:22:37.609486 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe658ad-4c11-4877-afd3-631bd4677dca None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:37.728157 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe658ad-4c11-4877-afd3-631bd4677dca None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:37.764076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cde50a-a250-45e5-a6c3-126e8834f5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:37.764811 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cde50a-a250-45e5-a6c3-126e8834f5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:37.765092 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cde50a-a250-45e5-a6c3-126e8834f5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:37.765363 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cde50a-a250-45e5-a6c3-126e8834f5c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:37.775847 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cde50a-a250-45e5-a6c3-126e8834f5c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:37.777321 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cde50a-a250-45e5-a6c3-126e8834f5c7 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:37.795188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-12cde50a-a250-45e5-a6c3-126e8834f5c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:37.795188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:37.795188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:37.795188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:37.795188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:37.795188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:37.795188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:37.795188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:37.795188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:37.795188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:37.795188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:37.795188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:37.795188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:37.795188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:37.795188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:37.796278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:37.796278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:37.796278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:37.796278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:37.796278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:37.796278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:37.796278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:37.796278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:37.796278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:37.796278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:37.796278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:37.796278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:37.796278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:37.796278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:37.796278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:37.796278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:37.796278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:37.797179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:37.797179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:37.797179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:37.797179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:37.799346 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 528/1041] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:37.802153 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99e424-ce04-4dd4-a072-0578783b4592 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:37.910690 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99e424-ce04-4dd4-a072-0578783b4592 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:37.933804 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63333e96-4015-4f30-8f90-2f9ee8442a6e None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:37.934089 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63333e96-4015-4f30-8f90-2f9ee8442a6e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:37.934373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63333e96-4015-4f30-8f90-2f9ee8442a6e None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:37.935925 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 529/1042] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:22:37.938611 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:37.940920 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca61e78-558d-48c0-9ea9-3a65827347e1 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:37.941214 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca61e78-558d-48c0-9ea9-3a65827347e1 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:37.941501 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca61e78-558d-48c0-9ea9-3a65827347e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:37.949130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33e664-9457-4b7d-829a-3dd84e32a445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:37.952980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33e664-9457-4b7d-829a-3dd84e32a445 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:37.952980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33e664-9457-4b7d-829a-3dd84e32a445 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:37.952980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33e664-9457-4b7d-829a-3dd84e32a445 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:37.952980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33e664-9457-4b7d-829a-3dd84e32a445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:37.952980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33e664-9457-4b7d-829a-3dd84e32a445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:37.952980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33e664-9457-4b7d-829a-3dd84e32a445 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:37.963916 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-aca61e78-558d-48c0-9ea9-3a65827347e1 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:37.965125 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-aca61e78-558d-48c0-9ea9-3a65827347e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:37.966591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 514/1043] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:37.971933 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33e664-9457-4b7d-829a-3dd84e32a445 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:37.990794 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:38.043359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 530/1044] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:22:38.063934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca61e78-558d-48c0-9ea9-3a65827347e1 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:38.086050 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33e664-9457-4b7d-829a-3dd84e32a445 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:38.126491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2fc85-8991-4a0c-bafa-9ea95d2583bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:38.128029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2fc85-8991-4a0c-bafa-9ea95d2583bc None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:38.128555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2fc85-8991-4a0c-bafa-9ea95d2583bc None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:38.129075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2fc85-8991-4a0c-bafa-9ea95d2583bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:38.137713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2fc85-8991-4a0c-bafa-9ea95d2583bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:38.139086 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2fc85-8991-4a0c-bafa-9ea95d2583bc None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:38.158786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-e1a2fc85-8991-4a0c-bafa-9ea95d2583bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:38.158786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:38.158786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:38.158786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:38.158786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:38.158786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:38.158786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:38.158786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:38.158786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:38.158786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:38.158786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:38.158786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:38.158786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:22:38.158786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:22:38.158786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:22:38.159779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:22:38.159779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:38.159779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:38.159779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:38.159779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:38.159779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:38.159779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:38.159779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:38.159779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:38.159779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:38.159779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:38.159779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:38.159779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:38.159779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:38.159779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:38.159779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:38.159779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:38.161150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:22:38.161150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:22:38.161150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:22:38.161150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:22:38.161150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:22:38.161150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:22:38.161150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:38.161150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:38.161150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 515/1045] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:38.166691 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2fc85-8991-4a0c-bafa-9ea95d2583bc None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:38.175535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca61e78-558d-48c0-9ea9-3a65827347e1 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:38.213333 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95371e-df0f-4ea5-ab9f-053aa18b206f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:38.214133 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95371e-df0f-4ea5-ab9f-053aa18b206f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:38.214419 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95371e-df0f-4ea5-ab9f-053aa18b206f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:38.214699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95371e-df0f-4ea5-ab9f-053aa18b206f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:38.217930 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:38.226494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95371e-df0f-4ea5-ab9f-053aa18b206f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:38.234662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-8b95371e-df0f-4ea5-ab9f-053aa18b206f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:38.234662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:38.234662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:38.234662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:38.234662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:38.234662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:38.234662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:38.234662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:38.234662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:38.234662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:38.234662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:38.234662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:38.234662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:38.234662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:38.234662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:38.234662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:38.235675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:38.235675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:38.235675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:38.235675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:38.235675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:38.235675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:38.235675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:38.235675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:38.235675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:38.235675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:38.235675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:38.235675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:38.235675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:38.235675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:38.235675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:38.235675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:38.236748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:38.236748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:38.236748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:38.236748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:38.236748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:38.236748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:38.236748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:38.236748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:38.236748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:38.236748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:38.236748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:38.236748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:38.236748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 531/1046] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:22:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:38.243093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95371e-df0f-4ea5-ab9f-053aa18b206f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:38.271764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:38.286362 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2fc85-8991-4a0c-bafa-9ea95d2583bc None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:38.326012 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbaa602-89da-47e5-b4d6-be86471f827c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:38.326684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbaa602-89da-47e5-b4d6-be86471f827c None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:38.326976 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbaa602-89da-47e5-b4d6-be86471f827c None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:38.327259 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbaa602-89da-47e5-b4d6-be86471f827c None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:38.328085 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbaa602-89da-47e5-b4d6-be86471f827c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:38.328406 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbaa602-89da-47e5-b4d6-be86471f827c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:38.329863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbaa602-89da-47e5-b4d6-be86471f827c None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:38.343051 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 516/1047] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:22:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:38.349144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbaa602-89da-47e5-b4d6-be86471f827c None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:38.362551 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95371e-df0f-4ea5-ab9f-053aa18b206f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:38.400047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322c302-08ca-4961-bff9-7c1432ba7c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:38.400728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322c302-08ca-4961-bff9-7c1432ba7c22 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:38.401016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322c302-08ca-4961-bff9-7c1432ba7c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:38.401295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322c302-08ca-4961-bff9-7c1432ba7c22 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:38.402060 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322c302-08ca-4961-bff9-7c1432ba7c22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:38.402372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322c302-08ca-4961-bff9-7c1432ba7c22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:38.403937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322c302-08ca-4961-bff9-7c1432ba7c22 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:38.412980 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 532/1048] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:22:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:38.419121 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322c302-08ca-4961-bff9-7c1432ba7c22 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:38.475455 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbaa602-89da-47e5-b4d6-be86471f827c None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:38.482792 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:38.516665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:38.519775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55367c-dddc-48c9-90f8-acd11987aba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:38.520440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55367c-dddc-48c9-90f8-acd11987aba1 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:38.520722 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55367c-dddc-48c9-90f8-acd11987aba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:38.520997 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55367c-dddc-48c9-90f8-acd11987aba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:38.521898 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55367c-dddc-48c9-90f8-acd11987aba1 None admin] RBAC: Adding query filter params (role.id=89b4a0107e1f484683ef23398bfcb722, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=122fc227de9d4f87a66e4a0d86ff0b16) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:38.522354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55367c-dddc-48c9-90f8-acd11987aba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:38.523739 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55367c-dddc-48c9-90f8-acd11987aba1 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:38.535510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322c302-08ca-4961-bff9-7c1432ba7c22 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:38.539689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 517/1049] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:22:38 2022] GET /identity/v3/role_assignments?user.id=122fc227de9d4f87a66e4a0d86ff0b16&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=89b4a0107e1f484683ef23398bfcb722 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:38.577955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d8ce8-8d8b-42f3-9a26-fb4386a902db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:38.578731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d8ce8-8d8b-42f3-9a26-fb4386a902db None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:38.579018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d8ce8-8d8b-42f3-9a26-fb4386a902db None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:38.579331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d8ce8-8d8b-42f3-9a26-fb4386a902db None admin] PATH_INFO: `/v3/users/0e2ba5e8a4de4c9782a31d18affae3c7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:38.596490 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d8ce8-8d8b-42f3-9a26-fb4386a902db None admin] RBAC: Authorizing `identity:get_user(user_id=0e2ba5e8a4de4c9782a31d18affae3c7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:38.598014 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d8ce8-8d8b-42f3-9a26-fb4386a902db None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:38.600207 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 533/1050] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:22:38 2022] GET /identity/v3/users/0e2ba5e8a4de4c9782a31d18affae3c7 => generated 285 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:38.606095 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55367c-dddc-48c9-90f8-acd11987aba1 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:38.720637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55367c-dddc-48c9-90f8-acd11987aba1 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:38.757745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f2738-8fc2-4418-81e4-5f6234f9c84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:38.758404 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f2738-8fc2-4418-81e4-5f6234f9c84b None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:38.758690 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f2738-8fc2-4418-81e4-5f6234f9c84b None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:38.758965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f2738-8fc2-4418-81e4-5f6234f9c84b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:38.800035 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:38.822282 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f121d01-4162-4d7b-bb0a-6785db1036b7 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:38.822620 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f121d01-4162-4d7b-bb0a-6785db1036b7 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:38.822844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f121d01-4162-4d7b-bb0a-6785db1036b7 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:38.824253 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 534/1051] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:22:38.829370 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50d1a6-859d-4632-a66a-8a01474ea0dc None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:38.829597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50d1a6-859d-4632-a66a-8a01474ea0dc None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:38.829710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f2738-8fc2-4418-81e4-5f6234f9c84b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:38.829884 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50d1a6-859d-4632-a66a-8a01474ea0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:38.831207 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f2738-8fc2-4418-81e4-5f6234f9c84b None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:38.846494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-3d50d1a6-859d-4632-a66a-8a01474ea0dc None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:38.847731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-3d50d1a6-859d-4632-a66a-8a01474ea0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:38.920946 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 535/1052] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:22:38.942949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 518/1053] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:22:38 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:22:38.948874 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50d1a6-859d-4632-a66a-8a01474ea0dc None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:38.949022 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f2738-8fc2-4418-81e4-5f6234f9c84b None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:39.027843 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:39.028046 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:39.060531 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50d1a6-859d-4632-a66a-8a01474ea0dc None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:39.062031 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f2738-8fc2-4418-81e4-5f6234f9c84b None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:39.098329 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d0b71-e0f6-42b4-a9a0-a3513ee39623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:39.098637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55ae61-b693-4688-8c78-12f0ca4c99e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:39.100032 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55ae61-b693-4688-8c78-12f0ca4c99e4 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:39.100317 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55ae61-b693-4688-8c78-12f0ca4c99e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:39.100591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55ae61-b693-4688-8c78-12f0ca4c99e4 None admin] PATH_INFO: `/v3/projects/65363303aff946ab969bc4a46b3e63e8` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:39.101277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d0b71-e0f6-42b4-a9a0-a3513ee39623 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:39.101759 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d0b71-e0f6-42b4-a9a0-a3513ee39623 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:39.101862 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55ae61-b693-4688-8c78-12f0ca4c99e4 None admin] RBAC: Authorizing `identity:get_project(project_id=65363303aff946ab969bc4a46b3e63e8)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:39.102333 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d0b71-e0f6-42b4-a9a0-a3513ee39623 None admin] PATH_INFO: `/v3/services/image` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:39.103187 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d0b71-e0f6-42b4-a9a0-a3513ee39623 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:39.103315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55ae61-b693-4688-8c78-12f0ca4c99e4 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:39.104883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d0b71-e0f6-42b4-a9a0-a3513ee39623 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:39.105005 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 519/1054] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:22:38 2022] GET /identity/v3/projects/65363303aff946ab969bc4a46b3e63e8 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:39.110784 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55ae61-b693-4688-8c78-12f0ca4c99e4 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:39.118037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-805d0b71-e0f6-42b4-a9a0-a3513ee39623 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 14:22:39.118037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:39.118037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:22:39.118037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:22:39.118037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:22:39.118037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:22:39.118037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:22:39.118037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:39.118037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 14:22:39.118037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:39.118037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:22:39.118037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:39.118037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:39.118037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:39.118037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:39.118037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:39.118037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:39.119249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:39.119249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:39.119249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:39.119249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:39.119249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:39.119249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:39.119249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:22:39.119249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:22:39.119249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:22:39.119249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:22:39.119249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:39.119249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:39.119249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:39.119249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:39.119249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:39.119249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:39.120127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:39.120127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:39.120127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:39.120127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:39.120127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:39.120127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:39.120127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:39.120127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:39.120127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:39.120127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:39.120127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:22:39.120127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:22:39.120127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 14:22:39.120127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:39.123908 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 536/1055] 10.222.0.40 () {56 vars in 1105 bytes} [Tue Jul 12 14:22:38 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:39.127340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d0b71-e0f6-42b4-a9a0-a3513ee39623 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:39.219859 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55ae61-b693-4688-8c78-12f0ca4c99e4 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:39.236427 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d0b71-e0f6-42b4-a9a0-a3513ee39623 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:39.263512 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fbdbc-1dba-4205-a341-46348c725e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:39.264183 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fbdbc-1dba-4205-a341-46348c725e0e None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:39.264471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fbdbc-1dba-4205-a341-46348c725e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:39.264756 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fbdbc-1dba-4205-a341-46348c725e0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:39.265597 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fbdbc-1dba-4205-a341-46348c725e0e None admin] RBAC: Adding query filter params (role.id=ae530119fc5c42358179521ce865b5d7, scope.project.id=65363303aff946ab969bc4a46b3e63e8, user.id=0e2ba5e8a4de4c9782a31d18affae3c7) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:39.265914 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fbdbc-1dba-4205-a341-46348c725e0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:39.267361 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fbdbc-1dba-4205-a341-46348c725e0e None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:39.274473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 520/1056] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:22:39 2022] GET /identity/v3/role_assignments?user.id=0e2ba5e8a4de4c9782a31d18affae3c7&scope.project.id=65363303aff946ab969bc4a46b3e63e8&role.id=ae530119fc5c42358179521ce865b5d7 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:39.281438 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af4021-4d86-4a30-8d38-3ba21a0a88df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:39.282446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af4021-4d86-4a30-8d38-3ba21a0a88df None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:39.282938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af4021-4d86-4a30-8d38-3ba21a0a88df None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:39.283432 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af4021-4d86-4a30-8d38-3ba21a0a88df None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:39.284374 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af4021-4d86-4a30-8d38-3ba21a0a88df None admin] RBAC: Adding query filter params (name=image) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:39.284877 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af4021-4d86-4a30-8d38-3ba21a0a88df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:39.286675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af4021-4d86-4a30-8d38-3ba21a0a88df None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:39.288925 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:39.294372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 537/1057] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:39.300612 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fbdbc-1dba-4205-a341-46348c725e0e None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:39.304865 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:39.417023 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fbdbc-1dba-4205-a341-46348c725e0e None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:39.453458 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095bf94-807e-43dc-93e5-cd84af78e42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:39.454128 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095bf94-807e-43dc-93e5-cd84af78e42a None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:39.454414 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095bf94-807e-43dc-93e5-cd84af78e42a None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:39.454687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095bf94-807e-43dc-93e5-cd84af78e42a None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:39.455431 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095bf94-807e-43dc-93e5-cd84af78e42a None admin] RBAC: Adding query filter params (type=image) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:39.455738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095bf94-807e-43dc-93e5-cd84af78e42a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:39.457097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095bf94-807e-43dc-93e5-cd84af78e42a None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:39.462604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 521/1058] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:39.468039 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af4021-4d86-4a30-8d38-3ba21a0a88df None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:39.578795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af4021-4d86-4a30-8d38-3ba21a0a88df None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:39.613066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ecd94-102d-400f-beeb-83a159c17812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:39.613721 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ecd94-102d-400f-beeb-83a159c17812 None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:39.614001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ecd94-102d-400f-beeb-83a159c17812 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:39.614272 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ecd94-102d-400f-beeb-83a159c17812 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:39.615222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ecd94-102d-400f-beeb-83a159c17812 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:39.616580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ecd94-102d-400f-beeb-83a159c17812 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:39.698869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 538/1059] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Jul 12 14:22:39 2022] POST /identity/v3/endpoints => generated 327 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:22:40.626262 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135926a1-909c-44c1-abae-d188fe5bcf5e None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:40.626787 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135926a1-909c-44c1-abae-d188fe5bcf5e None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:40.633130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135926a1-909c-44c1-abae-d188fe5bcf5e None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:40.633130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 522/1060] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:40.634346 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebaa523-68a6-4259-bd9d-bbdda2250328 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:40.634744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebaa523-68a6-4259-bd9d-bbdda2250328 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:40.634908 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebaa523-68a6-4259-bd9d-bbdda2250328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:40.652079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-7ebaa523-68a6-4259-bd9d-bbdda2250328 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:40.653271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7ebaa523-68a6-4259-bd9d-bbdda2250328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:40.704754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:40.728549 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 539/1061] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:40.751915 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135926a1-909c-44c1-abae-d188fe5bcf5e None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:40.823786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:40.862259 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135926a1-909c-44c1-abae-d188fe5bcf5e None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:40.902782 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036c628-df73-418a-8c1a-7d2654c4518c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:40.903550 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036c628-df73-418a-8c1a-7d2654c4518c None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:40.903835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036c628-df73-418a-8c1a-7d2654c4518c None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:40.904110 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036c628-df73-418a-8c1a-7d2654c4518c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:40.917304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036c628-df73-418a-8c1a-7d2654c4518c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:40.925482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-f036c628-df73-418a-8c1a-7d2654c4518c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:22:40.925482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:40.925482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:40.925482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:40.925482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:40.925482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:40.925482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:40.925482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:40.925482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:40.925482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:40.925482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:40.925482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:40.925482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:40.925482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:40.925482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:40.925482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:40.926446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:40.926446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:40.926446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:40.926446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:40.926446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:40.926446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:40.926446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:40.926446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:40.926446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:40.926446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:40.926446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:40.926446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:40.926446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:40.926446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:40.926446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:40.926446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:40.927315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:40.927315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:40.927315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:40.927315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:40.927315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:40.927315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:40.927315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:40.927315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:40.927315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:40.927315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:40.927315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:22:40.927315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:40.931642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 523/1062] 10.222.0.40 () {56 vars in 1120 bytes} [Tue Jul 12 14:22:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:40.933110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebaa523-68a6-4259-bd9d-bbdda2250328 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:41.036330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebaa523-68a6-4259-bd9d-bbdda2250328 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:41.075399 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fa34e-d8c9-4476-b205-12cf567828ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:41.076077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fa34e-d8c9-4476-b205-12cf567828ef None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:41.076366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fa34e-d8c9-4476-b205-12cf567828ef None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:41.076641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fa34e-d8c9-4476-b205-12cf567828ef None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:41.077398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fa34e-d8c9-4476-b205-12cf567828ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:41.077704 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fa34e-d8c9-4476-b205-12cf567828ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:41.079073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fa34e-d8c9-4476-b205-12cf567828ef None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:41.092372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 540/1063] 10.222.0.40 () {56 vars in 1115 bytes} [Tue Jul 12 14:22:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:41.093634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036c628-df73-418a-8c1a-7d2654c4518c None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:41.200432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036c628-df73-418a-8c1a-7d2654c4518c None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:41.227025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:41.239486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61450a9-06e9-4247-bcee-3b18c3ba957b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:41.240939 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61450a9-06e9-4247-bcee-3b18c3ba957b None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:41.241224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61450a9-06e9-4247-bcee-3b18c3ba957b None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:41.241521 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61450a9-06e9-4247-bcee-3b18c3ba957b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:41.254186 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61450a9-06e9-4247-bcee-3b18c3ba957b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:41.255889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61450a9-06e9-4247-bcee-3b18c3ba957b None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:41.275161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-a61450a9-06e9-4247-bcee-3b18c3ba957b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:41.275161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:41.275161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:41.275161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:41.275161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:41.275161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:41.275161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:41.275161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:41.275161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:41.275161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:41.275161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:41.275161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:41.275161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:41.275161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:41.275161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:41.276144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:41.276144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:41.276144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:41.276144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:41.276144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:41.276144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:41.276144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:41.276144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:41.276144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:41.276144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:41.276144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:41.276144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:41.276144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:41.276144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:41.276144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:41.276144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:41.276144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:41.277120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:41.277120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:41.277120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:41.277120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:41.281618 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 524/1064] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:41.282871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fa34e-d8c9-4476-b205-12cf567828ef None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:41.328505 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ecc5e-ad12-482b-bc9d-db1d969b80e1 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:41.328793 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ecc5e-ad12-482b-bc9d-db1d969b80e1 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:41.329093 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ecc5e-ad12-482b-bc9d-db1d969b80e1 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:41.330574 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 525/1065] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:22:41.331429 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:41.336503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8aea72-80aa-4ca5-ab31-c8a468e67984 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:41.336789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8aea72-80aa-4ca5-ab31-c8a468e67984 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:41.337062 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8aea72-80aa-4ca5-ab31-c8a468e67984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:41.355619 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-5c8aea72-80aa-4ca5-ab31-c8a468e67984 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:41.357006 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5c8aea72-80aa-4ca5-ab31-c8a468e67984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:41.394321 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fa34e-d8c9-4476-b205-12cf567828ef None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:41.431097 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465bf63-47a1-4870-b253-7d51e92dcdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:41.431802 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465bf63-47a1-4870-b253-7d51e92dcdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:41.432117 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465bf63-47a1-4870-b253-7d51e92dcdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:41.432365 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465bf63-47a1-4870-b253-7d51e92dcdf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:41.433102 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465bf63-47a1-4870-b253-7d51e92dcdf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:41.433601 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465bf63-47a1-4870-b253-7d51e92dcdf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:41.433720 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 526/1066] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:22:41.434851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465bf63-47a1-4870-b253-7d51e92dcdf7 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:41.452613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 541/1067] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:41.453795 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8aea72-80aa-4ca5-ab31-c8a468e67984 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:41.458245 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465bf63-47a1-4870-b253-7d51e92dcdf7 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:41.572495 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465bf63-47a1-4870-b253-7d51e92dcdf7 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:41.573928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:41.582642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8aea72-80aa-4ca5-ab31-c8a468e67984 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:41.593259 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:41.613394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042500d-7e4f-44b9-81fd-43113ec823e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:41.614196 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042500d-7e4f-44b9-81fd-43113ec823e3 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:41.614470 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042500d-7e4f-44b9-81fd-43113ec823e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:41.615594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042500d-7e4f-44b9-81fd-43113ec823e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:41.621927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7eefa5-1810-4465-b5bb-cf7f6cd1e6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:41.622888 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7eefa5-1810-4465-b5bb-cf7f6cd1e6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:41.623242 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7eefa5-1810-4465-b5bb-cf7f6cd1e6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:41.623675 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7eefa5-1810-4465-b5bb-cf7f6cd1e6a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:41.627801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042500d-7e4f-44b9-81fd-43113ec823e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:41.631804 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7eefa5-1810-4465-b5bb-cf7f6cd1e6a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:41.633481 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7eefa5-1810-4465-b5bb-cf7f6cd1e6a2 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:41.638520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-c042500d-7e4f-44b9-81fd-43113ec823e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:41.638520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:41.638520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:41.638520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:41.638520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:41.638520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:41.638520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:41.638520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:41.638520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:41.638520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:41.638520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:41.638520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:41.638520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:41.638520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:41.638520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:41.638520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:41.640180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:41.640180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:41.640180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:41.640180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:41.640180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:41.640180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:41.640180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:41.640180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:41.640180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:41.640180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:41.640180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:41.640180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:41.640180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:41.640180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:41.640180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:41.640180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:41.641094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:41.641094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:41.641094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:41.641094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:41.641094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:41.641094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:41.641094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:41.641094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:41.641094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:41.641094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:41.641094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:41.641094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:41.641094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 542/1068] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:22:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:41.643732 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042500d-7e4f-44b9-81fd-43113ec823e3 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:41.651399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-cd7eefa5-1810-4465-b5bb-cf7f6cd1e6a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:22:41.651399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:41.651399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:41.651399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:41.651399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:41.651399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:41.651399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:41.651399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:41.651399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:41.651399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:41.651399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:41.651399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:41.651399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:22:41.651399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:22:41.651399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:22:41.651399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:22:41.652457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:41.652457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:41.652457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:22:41.652457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:41.652457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:22:41.652457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:41.652457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:41.652457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:41.652457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:41.652457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:41.652457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:41.652457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:41.652457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:41.652457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:41.652457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:41.652457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:41.652457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:41.652457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:41.653982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:41.653982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:41.653982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:22:41.653982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:22:41.653982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:22:41.653982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:22:41.653982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:22:41.653982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:22:41.653982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:22:41.653982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:41.653982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 527/1069] 10.222.0.40 () {56 vars in 1093 bytes} [Tue Jul 12 14:22:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:41.658783 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7eefa5-1810-4465-b5bb-cf7f6cd1e6a2 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:41.764500 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042500d-7e4f-44b9-81fd-43113ec823e3 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:41.776536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7eefa5-1810-4465-b5bb-cf7f6cd1e6a2 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:41.802551 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938be389-9e84-4314-a84a-533a23452e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:41.803600 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938be389-9e84-4314-a84a-533a23452e7f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:41.803888 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938be389-9e84-4314-a84a-533a23452e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:41.804185 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938be389-9e84-4314-a84a-533a23452e7f None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:41.804934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938be389-9e84-4314-a84a-533a23452e7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:41.805246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938be389-9e84-4314-a84a-533a23452e7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:41.806633 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938be389-9e84-4314-a84a-533a23452e7f None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:41.813056 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f232323-adc1-4857-a4e0-1a6cd6218a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:41.813736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f232323-adc1-4857-a4e0-1a6cd6218a09 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:41.814017 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f232323-adc1-4857-a4e0-1a6cd6218a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:41.814292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f232323-adc1-4857-a4e0-1a6cd6218a09 None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:41.815138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f232323-adc1-4857-a4e0-1a6cd6218a09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:41.815478 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f232323-adc1-4857-a4e0-1a6cd6218a09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:41.817127 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f232323-adc1-4857-a4e0-1a6cd6218a09 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:41.817244 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 543/1070] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:22:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:41.823609 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938be389-9e84-4314-a84a-533a23452e7f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:41.843816 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 528/1071] 10.222.0.40 () {56 vars in 1133 bytes} [Tue Jul 12 14:22:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:41.845008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f232323-adc1-4857-a4e0-1a6cd6218a09 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:41.857206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:41.875937 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:41.935449 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938be389-9e84-4314-a84a-533a23452e7f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:41.953596 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f232323-adc1-4857-a4e0-1a6cd6218a09 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:41.974986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abced3-942b-4846-ab8b-77c46b0f5abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:41.976140 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abced3-942b-4846-ab8b-77c46b0f5abb None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:41.976439 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abced3-942b-4846-ab8b-77c46b0f5abb None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:41.976716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abced3-942b-4846-ab8b-77c46b0f5abb None admin] PATH_INFO: `/v3/users/0e2ba5e8a4de4c9782a31d18affae3c7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:41.978095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abced3-942b-4846-ab8b-77c46b0f5abb None admin] RBAC: Authorizing `identity:get_user(user_id=0e2ba5e8a4de4c9782a31d18affae3c7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:41.979587 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abced3-942b-4846-ab8b-77c46b0f5abb None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:41.981307 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 544/1072] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:22:41 2022] GET /identity/v3/users/0e2ba5e8a4de4c9782a31d18affae3c7 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:41.982641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ad123-c42d-411e-bd95-7a035ac8cab0 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:41.982936 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ad123-c42d-411e-bd95-7a035ac8cab0 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:41.983216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ad123-c42d-411e-bd95-7a035ac8cab0 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:41.984636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 545/1073] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:41.988984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ad123-c42d-411e-bd95-7a035ac8cab0 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:41.993295 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfeb94-2eb9-4d6e-b07d-ec49e93300c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:41.994115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfeb94-2eb9-4d6e-b07d-ec49e93300c0 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:41.994402 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfeb94-2eb9-4d6e-b07d-ec49e93300c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:41.994746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfeb94-2eb9-4d6e-b07d-ec49e93300c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:42.007140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bfeb94-2eb9-4d6e-b07d-ec49e93300c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:42.008701 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bfeb94-2eb9-4d6e-b07d-ec49e93300c0 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:42.028802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-f2bfeb94-2eb9-4d6e-b07d-ec49e93300c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:42.028802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:42.028802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:42.028802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:42.028802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:42.028802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:42.028802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:42.028802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:42.028802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:42.028802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:42.028802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:42.028802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:42.028802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:42.028802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:42.028802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:42.029971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:42.029971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:42.029971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:42.029971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:42.029971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:42.029971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:42.029971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:42.029971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:42.029971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:42.029971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:42.029971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:42.029971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:42.029971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:42.029971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:42.029971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:42.029971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:42.029971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:42.031112 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:42.031112 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:42.031112 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:42.031112 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:42.031112 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 529/1074] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:42.031646 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6ca07-7686-4315-b7ed-6591d7dca3ba None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:42.031965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6ca07-7686-4315-b7ed-6591d7dca3ba None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:42.032243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6ca07-7686-4315-b7ed-6591d7dca3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:42.051730 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-a8e6ca07-7686-4315-b7ed-6591d7dca3ba None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:42.053773 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-a8e6ca07-7686-4315-b7ed-6591d7dca3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:42.089100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:42.104321 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ad123-c42d-411e-bd95-7a035ac8cab0 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:42.134476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 530/1075] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:42.135488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6ca07-7686-4315-b7ed-6591d7dca3ba None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:42.142279 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9803b6-6ddb-448e-964e-2f3a73338a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:42.143142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9803b6-6ddb-448e-964e-2f3a73338a72 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:42.143456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9803b6-6ddb-448e-964e-2f3a73338a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:42.143732 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9803b6-6ddb-448e-964e-2f3a73338a72 None admin] PATH_INFO: `/v3/projects/65363303aff946ab969bc4a46b3e63e8` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:42.144928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9803b6-6ddb-448e-964e-2f3a73338a72 None admin] RBAC: Authorizing `identity:get_project(project_id=65363303aff946ab969bc4a46b3e63e8)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:42.146449 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9803b6-6ddb-448e-964e-2f3a73338a72 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:42.151429 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 546/1076] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:22:41 2022] GET /identity/v3/projects/65363303aff946ab969bc4a46b3e63e8 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:42.154600 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9803b6-6ddb-448e-964e-2f3a73338a72 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:42.160149 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:42.258227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6ca07-7686-4315-b7ed-6591d7dca3ba None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:42.261335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9803b6-6ddb-448e-964e-2f3a73338a72 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:42.293633 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740ac9d-f3b9-46f2-8c72-bf36517a6d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:42.294226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740ac9d-f3b9-46f2-8c72-bf36517a6d58 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:42.294515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740ac9d-f3b9-46f2-8c72-bf36517a6d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:42.294792 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740ac9d-f3b9-46f2-8c72-bf36517a6d58 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:42.295243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6111c2-eeb7-448b-98f5-39657c56b485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:42.295577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740ac9d-f3b9-46f2-8c72-bf36517a6d58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:42.295887 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740ac9d-f3b9-46f2-8c72-bf36517a6d58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:42.296159 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6111c2-eeb7-448b-98f5-39657c56b485 None admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:42.296438 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6111c2-eeb7-448b-98f5-39657c56b485 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:42.296712 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6111c2-eeb7-448b-98f5-39657c56b485 None admin] PATH_INFO: `/v3/projects/65363303aff946ab969bc4a46b3e63e8/users/0e2ba5e8a4de4c9782a31d18affae3c7/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:42.297303 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740ac9d-f3b9-46f2-8c72-bf36517a6d58 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:42.298675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6111c2-eeb7-448b-98f5-39657c56b485 None admin] RBAC: Authorizing `identity:create_grant(project_id=65363303aff946ab969bc4a46b3e63e8, user_id=0e2ba5e8a4de4c9782a31d18affae3c7, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:42.300116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6111c2-eeb7-448b-98f5-39657c56b485 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:42.309888 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 531/1077] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:42.310716 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740ac9d-f3b9-46f2-8c72-bf36517a6d58 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:42.377104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:42.393015 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 547/1078] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:22:42 2022] PUT /identity/v3/projects/65363303aff946ab969bc4a46b3e63e8/users/0e2ba5e8a4de4c9782a31d18affae3c7/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:22:42.393850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6111c2-eeb7-448b-98f5-39657c56b485 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:42.419616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:42.426269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740ac9d-f3b9-46f2-8c72-bf36517a6d58 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:42.470677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc691f-d6d3-4920-89a7-b0cd5ac10971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:42.471397 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc691f-d6d3-4920-89a7-b0cd5ac10971 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:42.471685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc691f-d6d3-4920-89a7-b0cd5ac10971 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:42.471971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc691f-d6d3-4920-89a7-b0cd5ac10971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:42.519820 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6111c2-eeb7-448b-98f5-39657c56b485 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:42.557512 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc691f-d6d3-4920-89a7-b0cd5ac10971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:42.558897 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc691f-d6d3-4920-89a7-b0cd5ac10971 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:42.569698 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2b342-2d4c-44f1-8985-203ecefd373a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:42.572296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2b342-2d4c-44f1-8985-203ecefd373a None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:42.572622 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2b342-2d4c-44f1-8985-203ecefd373a None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:42.572907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2b342-2d4c-44f1-8985-203ecefd373a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:42.585166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2b342-2d4c-44f1-8985-203ecefd373a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:42.587995 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2b342-2d4c-44f1-8985-203ecefd373a None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:42.607128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-76f2b342-2d4c-44f1-8985-203ecefd373a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:42.607128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:42.607128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:42.607128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:42.607128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:42.607128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:42.607128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:42.607128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:42.607128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:42.607128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:42.607128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:42.607128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:42.607128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:22:42.607128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:22:42.607128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:22:42.608640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:22:42.608640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:42.608640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:42.608640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:42.608640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:42.608640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:42.608640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:42.608640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:42.608640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:42.608640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:42.608640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:42.608640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:42.608640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:42.608640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:42.608640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:42.608640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:42.608640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:42.609735 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:22:42.609735 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:22:42.609735 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:22:42.609735 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:22:42.609735 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:22:42.609735 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:22:42.609735 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:42.609735 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:42.609735 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 548/1079] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:42.616110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2b342-2d4c-44f1-8985-203ecefd373a None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:42.661264 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:42.704868 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 532/1080] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:22:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:22:42.711804 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc691f-d6d3-4920-89a7-b0cd5ac10971 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:42.720814 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:42.745353 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2b342-2d4c-44f1-8985-203ecefd373a None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:42.787748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0338e-e042-42c1-a05a-36bf0440df89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:42.788114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0338e-e042-42c1-a05a-36bf0440df89 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:42.788404 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0338e-e042-42c1-a05a-36bf0440df89 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:42.788684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0338e-e042-42c1-a05a-36bf0440df89 None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:42.789483 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0338e-e042-42c1-a05a-36bf0440df89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:42.789802 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0338e-e042-42c1-a05a-36bf0440df89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:42.791316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0338e-e042-42c1-a05a-36bf0440df89 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:42.811127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 549/1081] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:22:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:42.811916 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0338e-e042-42c1-a05a-36bf0440df89 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:42.845195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc691f-d6d3-4920-89a7-b0cd5ac10971 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:42.899645 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2ff3e-d03d-4356-a7db-7b583ee364a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:42.900512 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2ff3e-d03d-4356-a7db-7b583ee364a8 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:42.900798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2ff3e-d03d-4356-a7db-7b583ee364a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:42.901072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2ff3e-d03d-4356-a7db-7b583ee364a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:42.912641 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2ff3e-d03d-4356-a7db-7b583ee364a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:42.914308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2ff3e-d03d-4356-a7db-7b583ee364a8 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:42.932587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-06e2ff3e-d03d-4356-a7db-7b583ee364a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:42.932587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:42.932587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:42.932587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:42.932587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:42.932587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:42.932587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:42.932587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:42.932587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:42.932587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:42.932587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:42.932587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:42.932587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:42.932587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:42.932587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:42.934248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:42.934248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:42.934248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:42.934248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:42.934248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:42.934248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:42.934248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:42.934248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:42.934248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:42.934248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:42.934248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:42.934248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:42.934248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:42.934248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:42.934248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:42.934248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:42.934248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:42.935980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:42.935980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:42.935980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:42.935980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:42.935980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 533/1082] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:42.939604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2ff3e-d03d-4356-a7db-7b583ee364a8 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:42.949060 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0338e-e042-42c1-a05a-36bf0440df89 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:42.965240 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:43.006028 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb2cba-3430-4ded-8836-c96282b6d960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:43.007362 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb2cba-3430-4ded-8836-c96282b6d960 None admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:43.007822 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb2cba-3430-4ded-8836-c96282b6d960 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:43.008276 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb2cba-3430-4ded-8836-c96282b6d960 None admin] PATH_INFO: `/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/122fc227de9d4f87a66e4a0d86ff0b16/roles/89b4a0107e1f484683ef23398bfcb722` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:43.011641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb2cba-3430-4ded-8836-c96282b6d960 None admin] RBAC: Authorizing `identity:create_grant(project_id=00424b6950d14cd4854e4add3e3d7705, user_id=122fc227de9d4f87a66e4a0d86ff0b16, role_id=89b4a0107e1f484683ef23398bfcb722)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:43.014132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb2cba-3430-4ded-8836-c96282b6d960 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:43.064169 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:43.065528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2ff3e-d03d-4356-a7db-7b583ee364a8 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:43.069482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 550/1083] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:22:42 2022] PUT /identity/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/122fc227de9d4f87a66e4a0d86ff0b16/roles/89b4a0107e1f484683ef23398bfcb722 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:22:43.110551 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3e313-5b38-4ea9-80fe-50ffd163aa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:43.111237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3e313-5b38-4ea9-80fe-50ffd163aa0f None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:43.111549 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3e313-5b38-4ea9-80fe-50ffd163aa0f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:43.111830 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3e313-5b38-4ea9-80fe-50ffd163aa0f None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:43.112675 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3e313-5b38-4ea9-80fe-50ffd163aa0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:43.113181 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3e313-5b38-4ea9-80fe-50ffd163aa0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:43.114375 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3e313-5b38-4ea9-80fe-50ffd163aa0f None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:43.129097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 534/1084] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:44.539147 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2a2d3-6c73-4e24-8f40-3e2ab9b1df61 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:44.540111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2a2d3-6c73-4e24-8f40-3e2ab9b1df61 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:44.540111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2a2d3-6c73-4e24-8f40-3e2ab9b1df61 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:44.541730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 551/1085] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:44.548206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993913d-7a4d-4261-817c-7b569f06cabe None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:44.549018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993913d-7a4d-4261-817c-7b569f06cabe None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:44.549018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993913d-7a4d-4261-817c-7b569f06cabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:44.570145 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-1993913d-7a4d-4261-817c-7b569f06cabe None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:44.571490 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-1993913d-7a4d-4261-817c-7b569f06cabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:44.654804 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 535/1086] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:44.679858 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2a2d3-6c73-4e24-8f40-3e2ab9b1df61 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:44.798789 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2a2d3-6c73-4e24-8f40-3e2ab9b1df61 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:44.839802 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a116ca-e327-460b-a019-7bdf3cb09589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:44.840800 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a116ca-e327-460b-a019-7bdf3cb09589 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:44.841156 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a116ca-e327-460b-a019-7bdf3cb09589 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:44.841499 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a116ca-e327-460b-a019-7bdf3cb09589 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:44.854655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a116ca-e327-460b-a019-7bdf3cb09589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:44.883505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-65a116ca-e327-460b-a019-7bdf3cb09589 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:44.883505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:44.883505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:44.883505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:44.883505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:44.883505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:44.883505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:44.883505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:44.883505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:44.883505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:44.883505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:44.883505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:44.883505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:44.883505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:44.883505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:44.883505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:44.886093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:44.886093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:44.886093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:44.886093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:44.886093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:44.886093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:44.886093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:44.886093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:44.886093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:44.886093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:44.886093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:44.886093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:44.886093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:44.886093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:44.886093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:44.886093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:44.887875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:44.887875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:44.887875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:44.887875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:44.887875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:44.887875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:44.887875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:44.887875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:44.887875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:44.887875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:44.887875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:22:44.887875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:44.887875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 552/1087] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:22:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:44.889432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993913d-7a4d-4261-817c-7b569f06cabe None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:44.892613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:45.016520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993913d-7a4d-4261-817c-7b569f06cabe None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:45.058954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca16c89-c0de-4e54-a169-131159885a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:45.059843 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca16c89-c0de-4e54-a169-131159885a19 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:45.060237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca16c89-c0de-4e54-a169-131159885a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:45.060732 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca16c89-c0de-4e54-a169-131159885a19 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:45.061634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca16c89-c0de-4e54-a169-131159885a19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:45.062046 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca16c89-c0de-4e54-a169-131159885a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:45.063598 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca16c89-c0de-4e54-a169-131159885a19 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:45.075189 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 536/1088] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:22:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:45.081395 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a116ca-e327-460b-a019-7bdf3cb09589 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:45.175956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:45.249793 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a116ca-e327-460b-a019-7bdf3cb09589 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:45.294703 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb5ad0-aeec-44a8-a28c-5a66fecbaa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:45.295720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb5ad0-aeec-44a8-a28c-5a66fecbaa96 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:45.296073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb5ad0-aeec-44a8-a28c-5a66fecbaa96 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:45.296414 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb5ad0-aeec-44a8-a28c-5a66fecbaa96 None admin] PATH_INFO: `/v3/users/0e2ba5e8a4de4c9782a31d18affae3c7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:45.297818 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb5ad0-aeec-44a8-a28c-5a66fecbaa96 None admin] RBAC: Authorizing `identity:get_user(user_id=0e2ba5e8a4de4c9782a31d18affae3c7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:45.299374 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb5ad0-aeec-44a8-a28c-5a66fecbaa96 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:45.301271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 553/1089] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:22:45 2022] GET /identity/v3/users/0e2ba5e8a4de4c9782a31d18affae3c7 => generated 285 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:45.308297 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca16c89-c0de-4e54-a169-131159885a19 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:45.395113 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:45.434484 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca16c89-c0de-4e54-a169-131159885a19 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:45.481798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bee23e-bfc5-496e-94cf-72130736e9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:45.482904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bee23e-bfc5-496e-94cf-72130736e9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:45.483460 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bee23e-bfc5-496e-94cf-72130736e9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:45.483973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bee23e-bfc5-496e-94cf-72130736e9b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:45.580708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bee23e-bfc5-496e-94cf-72130736e9b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:45.582179 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bee23e-bfc5-496e-94cf-72130736e9b2 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:45.588251 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15203c-4a29-4e07-b586-8627e374c95c None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:45.588864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15203c-4a29-4e07-b586-8627e374c95c None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:45.589251 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15203c-4a29-4e07-b586-8627e374c95c None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:45.595606 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 554/1090] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:45 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:22:45.601203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0d516-5122-415b-b5d6-2514e4c30e77 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:45.601680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0d516-5122-415b-b5d6-2514e4c30e77 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:45.602172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0d516-5122-415b-b5d6-2514e4c30e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:45.628818 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-5ff0d516-5122-415b-b5d6-2514e4c30e77 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:45.631382 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-5ff0d516-5122-415b-b5d6-2514e4c30e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:45.668941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:45.713109 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 537/1091] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:22:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 14:22:45.719813 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bee23e-bfc5-496e-94cf-72130736e9b2 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:45.732445 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 555/1092] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:45.769662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0d516-5122-415b-b5d6-2514e4c30e77 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:45.845496 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:45.862029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bee23e-bfc5-496e-94cf-72130736e9b2 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:45.917969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0d516-5122-415b-b5d6-2514e4c30e77 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:45.918784 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31eb1-85fb-45ab-a8f4-22b822db00d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:45.919576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31eb1-85fb-45ab-a8f4-22b822db00d0 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:45.919977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31eb1-85fb-45ab-a8f4-22b822db00d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:45.920288 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d31eb1-85fb-45ab-a8f4-22b822db00d0 None admin] PATH_INFO: `/v3/projects/65363303aff946ab969bc4a46b3e63e8` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:45.922077 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d31eb1-85fb-45ab-a8f4-22b822db00d0 None admin] RBAC: Authorizing `identity:get_project(project_id=65363303aff946ab969bc4a46b3e63e8)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:45.923594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d31eb1-85fb-45ab-a8f4-22b822db00d0 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:45.925602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 538/1093] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:22:45 2022] GET /identity/v3/projects/65363303aff946ab969bc4a46b3e63e8 => generated 311 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:45.933012 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31eb1-85fb-45ab-a8f4-22b822db00d0 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:45.964504 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17b4e7-7b66-4043-b67f-c5d93639bcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:45.965855 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17b4e7-7b66-4043-b67f-c5d93639bcbf None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:45.966327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17b4e7-7b66-4043-b67f-c5d93639bcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:45.966806 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17b4e7-7b66-4043-b67f-c5d93639bcbf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:45.986448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17b4e7-7b66-4043-b67f-c5d93639bcbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:22:45.988883 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:46.002079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-5b17b4e7-7b66-4043-b67f-c5d93639bcbf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:22:46.002079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:46.002079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:46.002079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:46.002079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:46.002079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:46.002079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:46.002079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:46.002079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:46.002079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:46.002079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:46.002079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:46.002079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:22:46.002079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:22:46.002079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:22:46.002079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:22:46.017510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:22:46.017510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:22:46.017510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:22:46.017510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:22:46.017510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:46.017510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:46.017510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:46.017510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:46.017510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:46.017510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:46.017510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:46.017510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:46.017510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:46.017510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:46.017510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:46.017510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:46.018682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:46.018682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:46.018682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:46.018682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:46.018682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:22:46.018682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:22:46.018682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:22:46.018682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:22:46.018682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:22:46.018682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:22:46.018682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 14:22:46.018682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:46.018682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 556/1094] 10.222.0.40 () {56 vars in 1120 bytes} [Tue Jul 12 14:22:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:46.018682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17b4e7-7b66-4043-b67f-c5d93639bcbf None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:46.058507 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d31eb1-85fb-45ab-a8f4-22b822db00d0 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:46.101361 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7eeccc-7a4d-49e6-9fae-951b33d4fbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:46.102251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7eeccc-7a4d-49e6-9fae-951b33d4fbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:46.102635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7eeccc-7a4d-49e6-9fae-951b33d4fbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:46.103016 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7eeccc-7a4d-49e6-9fae-951b33d4fbd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:46.104075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7eeccc-7a4d-49e6-9fae-951b33d4fbd3 None admin] RBAC: Adding query filter params (role.id=ae530119fc5c42358179521ce865b5d7, scope.project.id=65363303aff946ab969bc4a46b3e63e8, user.id=0e2ba5e8a4de4c9782a31d18affae3c7) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:46.104504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7eeccc-7a4d-49e6-9fae-951b33d4fbd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:46.106406 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7eeccc-7a4d-49e6-9fae-951b33d4fbd3 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:46.114116 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 539/1095] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:22:45 2022] GET /identity/v3/role_assignments?user.id=0e2ba5e8a4de4c9782a31d18affae3c7&scope.project.id=65363303aff946ab969bc4a46b3e63e8&role.id=ae530119fc5c42358179521ce865b5d7 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:46.153712 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17b4e7-7b66-4043-b67f-c5d93639bcbf None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:46.176805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:46.200177 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c0218-5f2c-4698-9b19-27b240125248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:46.200960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c0218-5f2c-4698-9b19-27b240125248 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:46.201349 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c0218-5f2c-4698-9b19-27b240125248 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:46.201765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c0218-5f2c-4698-9b19-27b240125248 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:46.202879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c0218-5f2c-4698-9b19-27b240125248 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:46.203737 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c0218-5f2c-4698-9b19-27b240125248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:46.205762 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c0218-5f2c-4698-9b19-27b240125248 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:46.218341 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 557/1096] 10.222.0.40 () {56 vars in 1115 bytes} [Tue Jul 12 14:22:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:46.225006 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7eeccc-7a4d-49e6-9fae-951b33d4fbd3 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:46.377244 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7eeccc-7a4d-49e6-9fae-951b33d4fbd3 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:46.379856 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:46.418673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b165173-5e7c-4c7a-a0b9-015bfc3d81ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:46.419653 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b165173-5e7c-4c7a-a0b9-015bfc3d81ea None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:46.420041 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b165173-5e7c-4c7a-a0b9-015bfc3d81ea None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:46.420413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b165173-5e7c-4c7a-a0b9-015bfc3d81ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:46.433975 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b165173-5e7c-4c7a-a0b9-015bfc3d81ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:46.435566 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b165173-5e7c-4c7a-a0b9-015bfc3d81ea None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:46.456557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-4b165173-5e7c-4c7a-a0b9-015bfc3d81ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:46.456557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:46.456557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:46.456557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:46.456557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:46.456557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:46.456557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:46.456557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:46.456557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:46.456557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:46.456557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:46.456557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:46.456557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:46.456557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:46.456557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:46.459184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:46.459184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:46.459184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:46.459184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:46.459184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:46.459184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:46.459184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:46.459184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:46.459184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:46.459184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:46.459184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:46.459184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:46.459184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:46.459184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:46.459184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:46.459184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:46.459184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:46.460958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:46.460958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:46.460958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:46.460958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:46.460958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 540/1097] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:46.466319 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c0218-5f2c-4698-9b19-27b240125248 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:46.584644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c0218-5f2c-4698-9b19-27b240125248 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:46.624629 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224e129-73ba-4a02-ba1a-d537c8722f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:46.625584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224e129-73ba-4a02-ba1a-d537c8722f86 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:46.625753 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224e129-73ba-4a02-ba1a-d537c8722f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:46.626068 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224e129-73ba-4a02-ba1a-d537c8722f86 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:46.626890 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224e129-73ba-4a02-ba1a-d537c8722f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:46.627259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224e129-73ba-4a02-ba1a-d537c8722f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:46.628778 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224e129-73ba-4a02-ba1a-d537c8722f86 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:46.643918 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 558/1098] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:46.651423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b165173-5e7c-4c7a-a0b9-015bfc3d81ea None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:46.769959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b165173-5e7c-4c7a-a0b9-015bfc3d81ea None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:46.808793 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d3657-6c9a-40ec-b94d-065f5e2000ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:46.809600 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d3657-6c9a-40ec-b94d-065f5e2000ce None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:46.809882 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d3657-6c9a-40ec-b94d-065f5e2000ce None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:46.810159 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d3657-6c9a-40ec-b94d-065f5e2000ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:46.818325 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d3657-6c9a-40ec-b94d-065f5e2000ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:46.819918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d3657-6c9a-40ec-b94d-065f5e2000ce None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:46.835969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-138d3657-6c9a-40ec-b94d-065f5e2000ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:22:46.835969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:46.835969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:46.835969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:46.835969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:46.835969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:46.835969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:46.835969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:46.835969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:46.835969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:46.835969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:46.835969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:46.835969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:22:46.835969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:22:46.835969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:22:46.835969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:22:46.838084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:46.838084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:46.838084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:22:46.838084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:46.838084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:22:46.838084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:22:46.838084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:46.838084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:46.838084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:46.838084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:46.838084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:46.838084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:46.838084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:46.838084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:46.838084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:46.838084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:46.838084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:46.838084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:46.844754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:46.844754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:46.844754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:22:46.844754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:22:46.844754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:22:46.844754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:22:46.844754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:22:46.844754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:22:46.844754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 14:22:46.844754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:22:46.844754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 541/1099] 10.222.0.40 () {56 vars in 1093 bytes} [Tue Jul 12 14:22:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:46.845882 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224e129-73ba-4a02-ba1a-d537c8722f86 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:46.894184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:46.960559 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224e129-73ba-4a02-ba1a-d537c8722f86 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:46.997926 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1447beb-781a-4b32-8cad-a55c3312a6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:46.998681 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1447beb-781a-4b32-8cad-a55c3312a6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:46.999019 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1447beb-781a-4b32-8cad-a55c3312a6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:46.999396 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1447beb-781a-4b32-8cad-a55c3312a6d3 None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:47.000302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1447beb-781a-4b32-8cad-a55c3312a6d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:47.000665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1447beb-781a-4b32-8cad-a55c3312a6d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:47.002153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1447beb-781a-4b32-8cad-a55c3312a6d3 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:47.022079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 559/1100] 10.222.0.40 () {56 vars in 1133 bytes} [Tue Jul 12 14:22:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:22:47.028574 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d3657-6c9a-40ec-b94d-065f5e2000ce None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:47.053053 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:47.145188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d3657-6c9a-40ec-b94d-065f5e2000ce None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:47.183139 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466c5f8-2080-4c09-a06b-68381bc63ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:47.183911 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c5f8-2080-4c09-a06b-68381bc63ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:47.184262 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c5f8-2080-4c09-a06b-68381bc63ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:47.184604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c5f8-2080-4c09-a06b-68381bc63ec8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:47.273948 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466c5f8-2080-4c09-a06b-68381bc63ec8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:47.275434 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466c5f8-2080-4c09-a06b-68381bc63ec8 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:47.298951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:47.410787 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 542/1101] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:22:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:22:47.412721 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1447beb-781a-4b32-8cad-a55c3312a6d3 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:47.515711 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:47.519327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1447beb-781a-4b32-8cad-a55c3312a6d3 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:47.562558 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d829d-b5ae-4584-8b1c-10930a951b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:47.563384 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d829d-b5ae-4584-8b1c-10930a951b96 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:47.563670 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d829d-b5ae-4584-8b1c-10930a951b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:47.563944 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d829d-b5ae-4584-8b1c-10930a951b96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:47.576129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d829d-b5ae-4584-8b1c-10930a951b96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:47.577575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d829d-b5ae-4584-8b1c-10930a951b96 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:47.596523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-061d829d-b5ae-4584-8b1c-10930a951b96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:47.596523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:47.596523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:47.596523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:47.596523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:47.596523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:47.596523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:47.596523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:47.596523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:47.596523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:47.596523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:47.596523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:47.596523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:22:47.596523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:22:47.596523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:22:47.597573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:22:47.597573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:47.597573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:47.597573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:47.597573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:47.597573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:47.597573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:47.597573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:47.597573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:47.597573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:47.597573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:47.597573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:47.597573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:47.597573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:47.597573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:47.597573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:47.597573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:47.598464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:22:47.598464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:22:47.598464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:22:47.598464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:47.598464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 560/1102] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:22:47.604075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466c5f8-2080-4c09-a06b-68381bc63ec8 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:47.743846 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466c5f8-2080-4c09-a06b-68381bc63ec8 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:47.761748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:47.780624 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27c05a-067f-42b5-8ecc-778f84bf9ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:47.781327 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27c05a-067f-42b5-8ecc-778f84bf9ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:47.781698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27c05a-067f-42b5-8ecc-778f84bf9ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:47.782039 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27c05a-067f-42b5-8ecc-778f84bf9ca4 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:47.782786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27c05a-067f-42b5-8ecc-778f84bf9ca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:47.783100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27c05a-067f-42b5-8ecc-778f84bf9ca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:47.784620 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27c05a-067f-42b5-8ecc-778f84bf9ca4 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:47.796863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 543/1103] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:47.802827 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d829d-b5ae-4584-8b1c-10930a951b96 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:47.914160 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d829d-b5ae-4584-8b1c-10930a951b96 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:47.952218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d8acc-b5e7-4dd5-bfd2-c79d769cc0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:47.953025 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d8acc-b5e7-4dd5-bfd2-c79d769cc0df None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:47.953315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d8acc-b5e7-4dd5-bfd2-c79d769cc0df None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:47.953595 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d8acc-b5e7-4dd5-bfd2-c79d769cc0df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:47.961580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d8acc-b5e7-4dd5-bfd2-c79d769cc0df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:47.963227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d8acc-b5e7-4dd5-bfd2-c79d769cc0df None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:47.978554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-467d8acc-b5e7-4dd5-bfd2-c79d769cc0df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:47.978554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:22:47.978554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:22:47.978554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:22:47.978554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:22:47.978554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:22:47.978554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:22:47.978554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:22:47.978554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:22:47.978554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:22:47.978554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:22:47.978554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:22:47.978554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:22:47.978554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:22:47.978554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:22:47.979594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:22:47.979594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:22:47.979594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:22:47.979594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:22:47.979594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:22:47.979594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:22:47.979594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:22:47.979594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:22:47.979594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:22:47.979594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:22:47.979594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:22:47.979594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:22:47.979594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:22:47.979594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:22:47.979594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:22:47.979594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:22:47.979594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:22:47.980482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:22:47.980482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:22:47.980482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:22:47.980482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:22:47.980482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:22:47.980482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:22:47.980482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:22:47.980482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:22:47.980482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 561/1104] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:22:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:22:47.985692 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27c05a-067f-42b5-8ecc-778f84bf9ca4 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:48.145625 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27c05a-067f-42b5-8ecc-778f84bf9ca4 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:48.206896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e40dc-57a8-43ef-9260-646cdecbbdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:48.208000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e40dc-57a8-43ef-9260-646cdecbbdf8 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:48.208999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e40dc-57a8-43ef-9260-646cdecbbdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:48.209455 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e40dc-57a8-43ef-9260-646cdecbbdf8 None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:48.211215 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e40dc-57a8-43ef-9260-646cdecbbdf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:48.211814 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e40dc-57a8-43ef-9260-646cdecbbdf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:48.214589 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e40dc-57a8-43ef-9260-646cdecbbdf8 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:48.238631 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 544/1105] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:22:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:48.245178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d8acc-b5e7-4dd5-bfd2-c79d769cc0df None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:48.268325 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:48.308012 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3a4d4-849e-487f-9e81-91be3b544def None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:48.308309 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3a4d4-849e-487f-9e81-91be3b544def None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:48.308596 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3a4d4-849e-487f-9e81-91be3b544def None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:48.310177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 545/1106] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:22:48.315923 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d880a-5ff9-4846-9212-754717a89563 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:48.316252 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d880a-5ff9-4846-9212-754717a89563 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:48.316535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d880a-5ff9-4846-9212-754717a89563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:48.335337 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-301d880a-5ff9-4846-9212-754717a89563 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:48.336543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-301d880a-5ff9-4846-9212-754717a89563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:48.368272 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:48.385973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d8acc-b5e7-4dd5-bfd2-c79d769cc0df None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:48.412194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 546/1107] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:22:48.423739 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3e816-4fa6-4ae2-a153-6805c6148b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:48.424402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3e816-4fa6-4ae2-a153-6805c6148b7a None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:48.424686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3e816-4fa6-4ae2-a153-6805c6148b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:48.424961 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3e816-4fa6-4ae2-a153-6805c6148b7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:48.425795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3e816-4fa6-4ae2-a153-6805c6148b7a None admin] RBAC: Adding query filter params (role.id=89b4a0107e1f484683ef23398bfcb722, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=122fc227de9d4f87a66e4a0d86ff0b16) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:48.426107 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3e816-4fa6-4ae2-a153-6805c6148b7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:48.427723 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3e816-4fa6-4ae2-a153-6805c6148b7a None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:48.434371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 562/1108] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:22:48 2022] GET /identity/v3/role_assignments?user.id=122fc227de9d4f87a66e4a0d86ff0b16&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=89b4a0107e1f484683ef23398bfcb722 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:48.440363 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d880a-5ff9-4846-9212-754717a89563 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:48.557527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d880a-5ff9-4846-9212-754717a89563 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:48.598454 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d4584-69eb-4eb4-bbbf-5be02fe9e214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:48.599593 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d4584-69eb-4eb4-bbbf-5be02fe9e214 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:48.599952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d4584-69eb-4eb4-bbbf-5be02fe9e214 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:48.600235 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d4584-69eb-4eb4-bbbf-5be02fe9e214 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:48.601511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d4584-69eb-4eb4-bbbf-5be02fe9e214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:48.602973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d4584-69eb-4eb4-bbbf-5be02fe9e214 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:48.604858 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 547/1109] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:22:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:48.610680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3e816-4fa6-4ae2-a153-6805c6148b7a None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:48.706454 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:48.736358 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3e816-4fa6-4ae2-a153-6805c6148b7a None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:48.774714 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff702f-e51c-47b3-86d5-04e251d663d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:48.775442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff702f-e51c-47b3-86d5-04e251d663d3 None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:48.775722 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff702f-e51c-47b3-86d5-04e251d663d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:48.776002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff702f-e51c-47b3-86d5-04e251d663d3 None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:48.776750 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff702f-e51c-47b3-86d5-04e251d663d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:48.778188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff702f-e51c-47b3-86d5-04e251d663d3 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:48.862483 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 563/1110] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Jul 12 14:22:48 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:22:51.013424 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7ba95-6601-464e-b03a-ecd0a11d399c None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:51.013987 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7ba95-6601-464e-b03a-ecd0a11d399c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:51.014081 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7ba95-6601-464e-b03a-ecd0a11d399c None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:51.015515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 548/1111] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:51.021016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de7dba-9652-4bd7-8095-bc56951926e9 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:51.021497 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de7dba-9652-4bd7-8095-bc56951926e9 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:51.021613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de7dba-9652-4bd7-8095-bc56951926e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:51.041004 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-69de7dba-9652-4bd7-8095-bc56951926e9 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:51.042213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-69de7dba-9652-4bd7-8095-bc56951926e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:51.110664 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 564/1112] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:22:51.135707 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7ba95-6601-464e-b03a-ecd0a11d399c None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:51.171779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:51.238741 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7ba95-6601-464e-b03a-ecd0a11d399c None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:51.274793 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e60d4f-cd90-4e00-abf1-6e420d71ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:51.275635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e60d4f-cd90-4e00-abf1-6e420d71ac69 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:51.275920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e60d4f-cd90-4e00-abf1-6e420d71ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:51.276195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e60d4f-cd90-4e00-abf1-6e420d71ac69 None admin] PATH_INFO: `/v3/roles/6184586642114a188e13c695442669f8` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:51.277747 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e60d4f-cd90-4e00-abf1-6e420d71ac69 None admin] RBAC: Authorizing `identity:get_role(role_id=6184586642114a188e13c695442669f8)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:51.279122 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e60d4f-cd90-4e00-abf1-6e420d71ac69 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:51.280544 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 549/1113] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:22:51 2022] GET /identity/v3/roles/6184586642114a188e13c695442669f8 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:51.287146 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de7dba-9652-4bd7-8095-bc56951926e9 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:51.346980 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:51.388921 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de7dba-9652-4bd7-8095-bc56951926e9 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:51.424534 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfcc80-fc7e-457d-bcdc-1830cd722025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:51.425399 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfcc80-fc7e-457d-bcdc-1830cd722025 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:51.425681 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfcc80-fc7e-457d-bcdc-1830cd722025 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:51.425955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfcc80-fc7e-457d-bcdc-1830cd722025 None admin] PATH_INFO: `/v3/users/7b5ed70601764845a1a7033783b43e79` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:51.439503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfcc80-fc7e-457d-bcdc-1830cd722025 None admin] RBAC: Authorizing `identity:get_user(user_id=7b5ed70601764845a1a7033783b43e79)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:51.440953 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfcc80-fc7e-457d-bcdc-1830cd722025 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:51.443164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 565/1114] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:22:51 2022] GET /identity/v3/users/7b5ed70601764845a1a7033783b43e79 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:51.449115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e60d4f-cd90-4e00-abf1-6e420d71ac69 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:51.551134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e60d4f-cd90-4e00-abf1-6e420d71ac69 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:51.552720 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:51.587637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2d751-e691-4bac-a2c2-c70c8c6c1456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:51.588305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2d751-e691-4bac-a2c2-c70c8c6c1456 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:51.588592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2d751-e691-4bac-a2c2-c70c8c6c1456 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:51.588875 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2d751-e691-4bac-a2c2-c70c8c6c1456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:51.659828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2d751-e691-4bac-a2c2-c70c8c6c1456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:51.661286 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2d751-e691-4bac-a2c2-c70c8c6c1456 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:51.762398 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 550/1115] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:22:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:22:51.768548 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfcc80-fc7e-457d-bcdc-1830cd722025 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:51.929397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfcc80-fc7e-457d-bcdc-1830cd722025 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:51.963424 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:51.994589 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67917634-7c7e-4ed6-8763-d4d26cf81483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:51.996479 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67917634-7c7e-4ed6-8763-d4d26cf81483 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:51.997014 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67917634-7c7e-4ed6-8763-d4d26cf81483 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:51.997532 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67917634-7c7e-4ed6-8763-d4d26cf81483 None admin] PATH_INFO: `/v3/projects/65363303aff946ab969bc4a46b3e63e8` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:51.999957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67917634-7c7e-4ed6-8763-d4d26cf81483 None admin] RBAC: Authorizing `identity:get_project(project_id=65363303aff946ab969bc4a46b3e63e8)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:52.002858 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67917634-7c7e-4ed6-8763-d4d26cf81483 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:52.006212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 566/1116] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:22:51 2022] GET /identity/v3/projects/65363303aff946ab969bc4a46b3e63e8 => generated 311 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:52.012670 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2d751-e691-4bac-a2c2-c70c8c6c1456 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:52.015342 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:52.115053 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2d751-e691-4bac-a2c2-c70c8c6c1456 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:52.149716 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacfd44-905b-4728-9ef1-ba1bbe48510b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:52.150383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacfd44-905b-4728-9ef1-ba1bbe48510b None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:52.150672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacfd44-905b-4728-9ef1-ba1bbe48510b None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:52.150955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacfd44-905b-4728-9ef1-ba1bbe48510b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:52.151828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacfd44-905b-4728-9ef1-ba1bbe48510b None admin] RBAC: Adding query filter params (role.id=6184586642114a188e13c695442669f8, scope.project.id=65363303aff946ab969bc4a46b3e63e8, user.id=7b5ed70601764845a1a7033783b43e79) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:52.152147 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacfd44-905b-4728-9ef1-ba1bbe48510b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:52.153579 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacfd44-905b-4728-9ef1-ba1bbe48510b None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:52.159117 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 551/1117] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:22:52 2022] GET /identity/v3/role_assignments?user.id=7b5ed70601764845a1a7033783b43e79&scope.project.id=65363303aff946ab969bc4a46b3e63e8&role.id=6184586642114a188e13c695442669f8 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:54.346771 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e31ac-ce5b-4f0f-959c-05415d71f821 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:54.347383 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e31ac-ce5b-4f0f-959c-05415d71f821 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:54.347383 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e31ac-ce5b-4f0f-959c-05415d71f821 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:54.348710 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 567/1118] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:54.354348 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264510d-dad5-4e98-8ca0-5bbbd5b53ee7 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:54.354834 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264510d-dad5-4e98-8ca0-5bbbd5b53ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:54.354937 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264510d-dad5-4e98-8ca0-5bbbd5b53ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:54.372890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-9264510d-dad5-4e98-8ca0-5bbbd5b53ee7 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:54.374086 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-9264510d-dad5-4e98-8ca0-5bbbd5b53ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:54.435177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:54.443255 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 552/1119] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:22:54.466312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e31ac-ce5b-4f0f-959c-05415d71f821 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:54.570004 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e31ac-ce5b-4f0f-959c-05415d71f821 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:54.604372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb74bd4-ceb6-466e-9110-f14cc2b671b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:54.605228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb74bd4-ceb6-466e-9110-f14cc2b671b3 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:54.605509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb74bd4-ceb6-466e-9110-f14cc2b671b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:54.605783 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb74bd4-ceb6-466e-9110-f14cc2b671b3 None admin] PATH_INFO: `/v3/roles/6184586642114a188e13c695442669f8` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:54.607253 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb74bd4-ceb6-466e-9110-f14cc2b671b3 None admin] RBAC: Authorizing `identity:get_role(role_id=6184586642114a188e13c695442669f8)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:54.608657 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb74bd4-ceb6-466e-9110-f14cc2b671b3 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:54.610111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 568/1120] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:22:54 2022] GET /identity/v3/roles/6184586642114a188e13c695442669f8 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:54.616952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264510d-dad5-4e98-8ca0-5bbbd5b53ee7 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:54.716996 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264510d-dad5-4e98-8ca0-5bbbd5b53ee7 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:54.752782 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90fa55-ec46-463e-8f46-687f9d0f4b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:54.753689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90fa55-ec46-463e-8f46-687f9d0f4b8e None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:54.753971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90fa55-ec46-463e-8f46-687f9d0f4b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:54.754243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90fa55-ec46-463e-8f46-687f9d0f4b8e None admin] PATH_INFO: `/v3/users/7b5ed70601764845a1a7033783b43e79` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:54.756001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90fa55-ec46-463e-8f46-687f9d0f4b8e None admin] RBAC: Authorizing `identity:get_user(user_id=7b5ed70601764845a1a7033783b43e79)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:54.757436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90fa55-ec46-463e-8f46-687f9d0f4b8e None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:54.759080 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 553/1121] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:22:54 2022] GET /identity/v3/users/7b5ed70601764845a1a7033783b43e79 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:54.765234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb74bd4-ceb6-466e-9110-f14cc2b671b3 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:54.823182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:54.867208 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb74bd4-ceb6-466e-9110-f14cc2b671b3 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:54.904513 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da004fa2-f79b-4969-8ada-df28f78d61d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:54.905380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da004fa2-f79b-4969-8ada-df28f78d61d1 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:54.905666 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da004fa2-f79b-4969-8ada-df28f78d61d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:54.905943 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da004fa2-f79b-4969-8ada-df28f78d61d1 None admin] PATH_INFO: `/v3/projects/65363303aff946ab969bc4a46b3e63e8` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:54.907141 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da004fa2-f79b-4969-8ada-df28f78d61d1 None admin] RBAC: Authorizing `identity:get_project(project_id=65363303aff946ab969bc4a46b3e63e8)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:54.908620 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da004fa2-f79b-4969-8ada-df28f78d61d1 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:54.910351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 569/1122] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:22:54 2022] GET /identity/v3/projects/65363303aff946ab969bc4a46b3e63e8 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:54.916941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90fa55-ec46-463e-8f46-687f9d0f4b8e None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:54.979551 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:55.017897 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90fa55-ec46-463e-8f46-687f9d0f4b8e None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:55.051942 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a05177-772f-43c0-b8ab-435f0fb4ee4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:55.052833 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a05177-772f-43c0-b8ab-435f0fb4ee4c None admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:55.053110 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a05177-772f-43c0-b8ab-435f0fb4ee4c None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:55.053382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a05177-772f-43c0-b8ab-435f0fb4ee4c None admin] PATH_INFO: `/v3/projects/65363303aff946ab969bc4a46b3e63e8/users/7b5ed70601764845a1a7033783b43e79/roles/6184586642114a188e13c695442669f8` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:55.055606 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a05177-772f-43c0-b8ab-435f0fb4ee4c None admin] RBAC: Authorizing `identity:create_grant(project_id=65363303aff946ab969bc4a46b3e63e8, user_id=7b5ed70601764845a1a7033783b43e79, role_id=6184586642114a188e13c695442669f8)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:55.057028 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a05177-772f-43c0-b8ab-435f0fb4ee4c None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:55.130369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 554/1123] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:22:54 2022] PUT /identity/v3/projects/65363303aff946ab969bc4a46b3e63e8/users/7b5ed70601764845a1a7033783b43e79/roles/6184586642114a188e13c695442669f8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:22:57.154174 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a203b-bef2-4386-8209-958f515589db None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:57.154743 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a203b-bef2-4386-8209-958f515589db None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:57.154743 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a203b-bef2-4386-8209-958f515589db None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:57.156177 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 570/1124] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:22:57.161757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c4129-34c0-4501-9dc9-e83e17023f44 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:57.162377 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c4129-34c0-4501-9dc9-e83e17023f44 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:57.162377 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c4129-34c0-4501-9dc9-e83e17023f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:57.180554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-0d6c4129-34c0-4501-9dc9-e83e17023f44 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:22:57.181775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0d6c4129-34c0-4501-9dc9-e83e17023f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:22:57.255775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 555/1125] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:22:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:22:57.279208 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a203b-bef2-4386-8209-958f515589db None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:57.376671 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a203b-bef2-4386-8209-958f515589db None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:57.399321 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:57.417493 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6c8db-7727-4840-a481-c256cbf18078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:57.417493 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6c8db-7727-4840-a481-c256cbf18078 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:57.417493 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6c8db-7727-4840-a481-c256cbf18078 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:57.417493 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6c8db-7727-4840-a481-c256cbf18078 None admin] PATH_INFO: `/v3/roles/6184586642114a188e13c695442669f8` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:57.417908 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6c8db-7727-4840-a481-c256cbf18078 None admin] RBAC: Authorizing `identity:get_role(role_id=6184586642114a188e13c695442669f8)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:57.417908 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6c8db-7727-4840-a481-c256cbf18078 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:57.417908 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 571/1126] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:22:57 2022] GET /identity/v3/roles/6184586642114a188e13c695442669f8 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:57.422352 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c4129-34c0-4501-9dc9-e83e17023f44 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:57.477055 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:57.524187 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c4129-34c0-4501-9dc9-e83e17023f44 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:57.561173 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a0729-1478-4689-abcd-f53efd19fb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:57.562083 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a0729-1478-4689-abcd-f53efd19fb72 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:57.562373 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a0729-1478-4689-abcd-f53efd19fb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:57.562651 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a0729-1478-4689-abcd-f53efd19fb72 None admin] PATH_INFO: `/v3/users/7b5ed70601764845a1a7033783b43e79` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:57.563889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a0729-1478-4689-abcd-f53efd19fb72 None admin] RBAC: Authorizing `identity:get_user(user_id=7b5ed70601764845a1a7033783b43e79)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:57.565339 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a0729-1478-4689-abcd-f53efd19fb72 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:57.566976 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 556/1127] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:22:57 2022] GET /identity/v3/users/7b5ed70601764845a1a7033783b43e79 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:57.573258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6c8db-7727-4840-a481-c256cbf18078 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:57.676947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6c8db-7727-4840-a481-c256cbf18078 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:57.712026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee796545-8e58-4b49-8599-45bb6ca70233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:57.712686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796545-8e58-4b49-8599-45bb6ca70233 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:57.712971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796545-8e58-4b49-8599-45bb6ca70233 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:57.713248 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796545-8e58-4b49-8599-45bb6ca70233 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:57.794642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:57.805545 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee796545-8e58-4b49-8599-45bb6ca70233 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:57.806996 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee796545-8e58-4b49-8599-45bb6ca70233 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:57.906948 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 572/1128] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:22:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:22:57.912966 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a0729-1478-4689-abcd-f53efd19fb72 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:58.014181 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a0729-1478-4689-abcd-f53efd19fb72 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:58.037104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:58.049075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b140d-6711-46bb-a1de-65010f025dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:58.049941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b140d-6711-46bb-a1de-65010f025dcc None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:58.051172 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b140d-6711-46bb-a1de-65010f025dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:58.051172 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b140d-6711-46bb-a1de-65010f025dcc None admin] PATH_INFO: `/v3/projects/65363303aff946ab969bc4a46b3e63e8` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:58.052359 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b140d-6711-46bb-a1de-65010f025dcc None admin] RBAC: Authorizing `identity:get_project(project_id=65363303aff946ab969bc4a46b3e63e8)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:58.053808 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b140d-6711-46bb-a1de-65010f025dcc None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:58.055586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 557/1129] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:22:57 2022] GET /identity/v3/projects/65363303aff946ab969bc4a46b3e63e8 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:22:58.061745 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee796545-8e58-4b49-8599-45bb6ca70233 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:22:58.150945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:22:58.160074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee796545-8e58-4b49-8599-45bb6ca70233 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:22:58.194419 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6626e-2807-42a7-8f00-2c8203be701b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:22:58.195063 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6626e-2807-42a7-8f00-2c8203be701b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:22:58.195371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6626e-2807-42a7-8f00-2c8203be701b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:22:58.195646 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6626e-2807-42a7-8f00-2c8203be701b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:22:58.196473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6626e-2807-42a7-8f00-2c8203be701b None admin] RBAC: Adding query filter params (role.id=6184586642114a188e13c695442669f8, scope.project.id=65363303aff946ab969bc4a46b3e63e8, user.id=7b5ed70601764845a1a7033783b43e79) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:22:58.196781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6626e-2807-42a7-8f00-2c8203be701b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:22:58.198197 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6626e-2807-42a7-8f00-2c8203be701b None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:22:58.204181 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 573/1130] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:22:58 2022] GET /identity/v3/role_assignments?user.id=7b5ed70601764845a1a7033783b43e79&scope.project.id=65363303aff946ab969bc4a46b3e63e8&role.id=6184586642114a188e13c695442669f8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:23:00.270410 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f12bfc-4762-4582-8816-10063f8e3e8b None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:00.270923 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f12bfc-4762-4582-8816-10063f8e3e8b None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:00.271149 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f12bfc-4762-4582-8816-10063f8e3e8b None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:00.272543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 558/1131] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:00.277826 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a1575-7435-4bab-a06e-98aabf76070f None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:00.278223 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a1575-7435-4bab-a06e-98aabf76070f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:00.278370 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a1575-7435-4bab-a06e-98aabf76070f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:00.294831 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-319a1575-7435-4bab-a06e-98aabf76070f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:00.296052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-319a1575-7435-4bab-a06e-98aabf76070f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:00.361660 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 574/1132] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:00.386466 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f12bfc-4762-4582-8816-10063f8e3e8b None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:00.485467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f12bfc-4762-4582-8816-10063f8e3e8b None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:00.519779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b96937-3d74-4ca8-a13b-bc1b7d95ab83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:00.520512 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b96937-3d74-4ca8-a13b-bc1b7d95ab83 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:00.521312 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b96937-3d74-4ca8-a13b-bc1b7d95ab83 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:00.521587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b96937-3d74-4ca8-a13b-bc1b7d95ab83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:00.522790 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b96937-3d74-4ca8-a13b-bc1b7d95ab83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:00.525550 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b96937-3d74-4ca8-a13b-bc1b7d95ab83 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:00.525877 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 559/1133] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:00.531723 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a1575-7435-4bab-a06e-98aabf76070f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:00.612254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:00.627844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a1575-7435-4bab-a06e-98aabf76070f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:00.661641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa621ea3-e092-4dcc-86d6-a46c9056a19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:00.662290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa621ea3-e092-4dcc-86d6-a46c9056a19c None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:00.662574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa621ea3-e092-4dcc-86d6-a46c9056a19c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:00.662846 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa621ea3-e092-4dcc-86d6-a46c9056a19c None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:00.663588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa621ea3-e092-4dcc-86d6-a46c9056a19c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:00.665075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa621ea3-e092-4dcc-86d6-a46c9056a19c None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:00.748619 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 575/1134] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Jul 12 14:23:00 2022] POST /identity/v3/projects => generated 311 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:23:02.887251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8a7f7-ba94-4495-bfef-11cfdfca020a None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:02.887837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8a7f7-ba94-4495-bfef-11cfdfca020a None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:02.887953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8a7f7-ba94-4495-bfef-11cfdfca020a None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:02.889220 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 560/1135] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:02.894737 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68b465-7b1b-4beb-8c63-fee1743e892e None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:02.895168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68b465-7b1b-4beb-8c63-fee1743e892e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:02.895302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68b465-7b1b-4beb-8c63-fee1743e892e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:02.913329 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-8c68b465-7b1b-4beb-8c63-fee1743e892e None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:02.914534 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-8c68b465-7b1b-4beb-8c63-fee1743e892e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:02.982966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 576/1136] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:03.008403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8a7f7-ba94-4495-bfef-11cfdfca020a None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:03.068040 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:03.113404 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8a7f7-ba94-4495-bfef-11cfdfca020a None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:03.150630 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2cc9d-fc6c-499f-8a4f-87b48f625312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:03.151383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2cc9d-fc6c-499f-8a4f-87b48f625312 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:03.151679 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2cc9d-fc6c-499f-8a4f-87b48f625312 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:03.151956 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2cc9d-fc6c-499f-8a4f-87b48f625312 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:03.153149 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2cc9d-fc6c-499f-8a4f-87b48f625312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:03.154581 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2cc9d-fc6c-499f-8a4f-87b48f625312 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:03.156241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 561/1137] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:23:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:03.162883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68b465-7b1b-4beb-8c63-fee1743e892e None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:03.230501 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:03.267490 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68b465-7b1b-4beb-8c63-fee1743e892e None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:03.303136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154ed0e-6825-4eb0-8d86-3acee00bc79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:03.303842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154ed0e-6825-4eb0-8d86-3acee00bc79c None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:03.304127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154ed0e-6825-4eb0-8d86-3acee00bc79c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:03.304405 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154ed0e-6825-4eb0-8d86-3acee00bc79c None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:03.305130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154ed0e-6825-4eb0-8d86-3acee00bc79c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:03.306572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154ed0e-6825-4eb0-8d86-3acee00bc79c None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:03.416942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 577/1138] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Jul 12 14:23:03 2022] POST /identity/v3/users => generated 286 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:23:05.505673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586ab23-54bb-4be6-84ab-fb7163df2ae2 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:05.506194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586ab23-54bb-4be6-84ab-fb7163df2ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:05.506194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586ab23-54bb-4be6-84ab-fb7163df2ae2 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:05.507678 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 562/1139] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:05.512839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc353bd-31fa-4981-a595-13c9488e5674 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:05.513265 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc353bd-31fa-4981-a595-13c9488e5674 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:05.513391 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc353bd-31fa-4981-a595-13c9488e5674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:05.530341 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-ccc353bd-31fa-4981-a595-13c9488e5674 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:05.531565 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ccc353bd-31fa-4981-a595-13c9488e5674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:05.596049 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 578/1140] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:05.620197 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586ab23-54bb-4be6-84ab-fb7163df2ae2 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:05.722584 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586ab23-54bb-4be6-84ab-fb7163df2ae2 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:05.748197 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:05.762257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3915474-02bd-4e54-beb3-74188815410b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:05.762257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3915474-02bd-4e54-beb3-74188815410b None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:05.762257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3915474-02bd-4e54-beb3-74188815410b None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:05.762257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3915474-02bd-4e54-beb3-74188815410b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:05.768826 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3915474-02bd-4e54-beb3-74188815410b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:23:05.777018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-b3915474-02bd-4e54-beb3-74188815410b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:23:05.777018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:05.777018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:05.777018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:05.777018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:05.777018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:05.777018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:05.777018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:05.777018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:05.777018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:05.777018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:05.777018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:05.777018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:23:05.777018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:23:05.777018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:23:05.777018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:23:05.778094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:23:05.778094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:23:05.778094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:23:05.778094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:23:05.778094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:05.778094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:05.778094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:05.778094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:05.778094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:05.778094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:05.778094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:05.778094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:05.778094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:05.778094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:05.778094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:05.778094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:05.779130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:05.779130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:05.779130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:05.779130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:05.779130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:23:05.779130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:23:05.779130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:23:05.779130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:23:05.779130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:23:05.779130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:23:05.779130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:23:05.779130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:23:05.779130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 563/1141] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:23:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:05.784565 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc353bd-31fa-4981-a595-13c9488e5674 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:05.846338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:05.899453 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc353bd-31fa-4981-a595-13c9488e5674 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:05.932691 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8493a43-c59c-4f8a-aba9-bf961b099de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:05.933357 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8493a43-c59c-4f8a-aba9-bf961b099de6 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:05.933640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8493a43-c59c-4f8a-aba9-bf961b099de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:05.933913 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8493a43-c59c-4f8a-aba9-bf961b099de6 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:05.934656 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8493a43-c59c-4f8a-aba9-bf961b099de6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:05.934960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8493a43-c59c-4f8a-aba9-bf961b099de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:05.936343 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8493a43-c59c-4f8a-aba9-bf961b099de6 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:05.944864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 579/1142] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:23:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:05.950676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3915474-02bd-4e54-beb3-74188815410b None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:06.053493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3915474-02bd-4e54-beb3-74188815410b None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:06.087937 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd7c11-21a0-45cc-88d7-724939cd5385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:06.088819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd7c11-21a0-45cc-88d7-724939cd5385 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:06.089105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd7c11-21a0-45cc-88d7-724939cd5385 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:06.089383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd7c11-21a0-45cc-88d7-724939cd5385 None admin] PATH_INFO: `/v3/users/d32a6d3f54d9424ab1413d14b5427f88` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:06.103523 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd7c11-21a0-45cc-88d7-724939cd5385 None admin] RBAC: Authorizing `identity:get_user(user_id=d32a6d3f54d9424ab1413d14b5427f88)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:06.104979 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd7c11-21a0-45cc-88d7-724939cd5385 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:06.106672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 564/1143] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:23:05 2022] GET /identity/v3/users/d32a6d3f54d9424ab1413d14b5427f88 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:06.112497 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8493a43-c59c-4f8a-aba9-bf961b099de6 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:06.213560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8493a43-c59c-4f8a-aba9-bf961b099de6 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:06.227145 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:06.248667 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07c2a7-1080-487c-9297-f1e718a26331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:06.249524 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07c2a7-1080-487c-9297-f1e718a26331 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:06.249982 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07c2a7-1080-487c-9297-f1e718a26331 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:06.250513 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07c2a7-1080-487c-9297-f1e718a26331 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:06.316963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07c2a7-1080-487c-9297-f1e718a26331 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:06.318695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07c2a7-1080-487c-9297-f1e718a26331 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:06.416326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 580/1144] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:23:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:23:06.422170 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd7c11-21a0-45cc-88d7-724939cd5385 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:06.471668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:06.525981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd7c11-21a0-45cc-88d7-724939cd5385 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:06.562703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe893ad-fcaf-4cb8-a2b2-55d7c8ecd998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:06.563612 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe893ad-fcaf-4cb8-a2b2-55d7c8ecd998 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:06.563894 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe893ad-fcaf-4cb8-a2b2-55d7c8ecd998 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:06.564169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe893ad-fcaf-4cb8-a2b2-55d7c8ecd998 None admin] PATH_INFO: `/v3/projects/24c64e4744e046f6bc2d382df4e6552f` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:06.565399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe893ad-fcaf-4cb8-a2b2-55d7c8ecd998 None admin] RBAC: Authorizing `identity:get_project(project_id=24c64e4744e046f6bc2d382df4e6552f)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:06.566856 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe893ad-fcaf-4cb8-a2b2-55d7c8ecd998 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:06.569285 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 565/1145] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:23:06 2022] GET /identity/v3/projects/24c64e4744e046f6bc2d382df4e6552f => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:06.575572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07c2a7-1080-487c-9297-f1e718a26331 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:06.591566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:06.681710 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07c2a7-1080-487c-9297-f1e718a26331 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:06.715669 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a33fc7-e03e-4675-bcf6-8f23ed7e0f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:06.716321 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a33fc7-e03e-4675-bcf6-8f23ed7e0f69 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:06.716600 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a33fc7-e03e-4675-bcf6-8f23ed7e0f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:06.716873 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a33fc7-e03e-4675-bcf6-8f23ed7e0f69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:06.717694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a33fc7-e03e-4675-bcf6-8f23ed7e0f69 None admin] RBAC: Adding query filter params (role.id=ae530119fc5c42358179521ce865b5d7, scope.project.id=24c64e4744e046f6bc2d382df4e6552f, user.id=d32a6d3f54d9424ab1413d14b5427f88) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:06.718004 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a33fc7-e03e-4675-bcf6-8f23ed7e0f69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:06.719443 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a33fc7-e03e-4675-bcf6-8f23ed7e0f69 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:06.725005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 581/1146] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:23:06 2022] GET /identity/v3/role_assignments?user.id=d32a6d3f54d9424ab1413d14b5427f88&scope.project.id=24c64e4744e046f6bc2d382df4e6552f&role.id=ae530119fc5c42358179521ce865b5d7 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:08.736455 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6b05f-1467-47a2-bc2f-03470fdef16f None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:08.737021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6b05f-1467-47a2-bc2f-03470fdef16f None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:08.737021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6b05f-1467-47a2-bc2f-03470fdef16f None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:08.738354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 566/1147] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:08.744281 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa89516-380c-4ea6-a650-d0328e982ea7 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:08.744732 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa89516-380c-4ea6-a650-d0328e982ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:08.744849 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa89516-380c-4ea6-a650-d0328e982ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:08.762316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-aaa89516-380c-4ea6-a650-d0328e982ea7 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:08.763556 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-aaa89516-380c-4ea6-a650-d0328e982ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:08.830997 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 582/1148] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:08.853626 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6b05f-1467-47a2-bc2f-03470fdef16f None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:08.953142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6b05f-1467-47a2-bc2f-03470fdef16f None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:08.966571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:08.987922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31189c35-3b3f-4092-ba75-731ace0066c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:08.988646 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31189c35-3b3f-4092-ba75-731ace0066c7 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:08.989530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31189c35-3b3f-4092-ba75-731ace0066c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:08.990009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31189c35-3b3f-4092-ba75-731ace0066c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:09.000342 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31189c35-3b3f-4092-ba75-731ace0066c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:23:09.007885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-31189c35-3b3f-4092-ba75-731ace0066c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:23:09.007885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:09.007885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:09.007885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:09.007885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:09.007885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:09.007885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:09.007885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:09.007885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:09.007885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:09.007885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:09.007885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:09.007885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:23:09.007885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:23:09.007885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:23:09.007885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:23:09.009014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:23:09.009014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:23:09.009014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:23:09.009014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:23:09.009014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:09.009014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:09.009014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:09.009014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:09.009014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:09.009014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:09.009014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:09.009014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:09.009014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:09.009014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:09.009014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:09.009014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:09.010029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:09.010029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:09.010029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:09.010029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:09.010029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:23:09.010029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:23:09.010029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:23:09.010029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:23:09.010029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:23:09.010029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:23:09.010029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:23:09.010029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:23:09.010029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 567/1149] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:23:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:09.015203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa89516-380c-4ea6-a650-d0328e982ea7 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:09.025403 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:09.113802 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa89516-380c-4ea6-a650-d0328e982ea7 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:09.146955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c34d4f-41a3-405b-95ce-f0021382366e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:09.147642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c34d4f-41a3-405b-95ce-f0021382366e None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:09.147925 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c34d4f-41a3-405b-95ce-f0021382366e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:09.148200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c34d4f-41a3-405b-95ce-f0021382366e None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:09.148944 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c34d4f-41a3-405b-95ce-f0021382366e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:09.149249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c34d4f-41a3-405b-95ce-f0021382366e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:09.150612 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c34d4f-41a3-405b-95ce-f0021382366e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:09.158476 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 583/1150] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:23:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:09.164986 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31189c35-3b3f-4092-ba75-731ace0066c7 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:09.266169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31189c35-3b3f-4092-ba75-731ace0066c7 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:09.300088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9fa6d-9d24-466c-adfc-ccb7ceb286e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:09.300959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9fa6d-9d24-466c-adfc-ccb7ceb286e5 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:09.301246 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9fa6d-9d24-466c-adfc-ccb7ceb286e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:09.301546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9fa6d-9d24-466c-adfc-ccb7ceb286e5 None admin] PATH_INFO: `/v3/users/d32a6d3f54d9424ab1413d14b5427f88` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:09.302943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9fa6d-9d24-466c-adfc-ccb7ceb286e5 None admin] RBAC: Authorizing `identity:get_user(user_id=d32a6d3f54d9424ab1413d14b5427f88)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:09.304400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9fa6d-9d24-466c-adfc-ccb7ceb286e5 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:09.306012 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 568/1151] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:23:09 2022] GET /identity/v3/users/d32a6d3f54d9424ab1413d14b5427f88 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:09.311881 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c34d4f-41a3-405b-95ce-f0021382366e None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:09.380055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:09.412286 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c34d4f-41a3-405b-95ce-f0021382366e None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:09.447504 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6d724-2f94-41eb-a284-2a30489fab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:09.448360 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6d724-2f94-41eb-a284-2a30489fab3c None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:09.448641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6d724-2f94-41eb-a284-2a30489fab3c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:09.448916 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6d724-2f94-41eb-a284-2a30489fab3c None admin] PATH_INFO: `/v3/projects/24c64e4744e046f6bc2d382df4e6552f` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:09.450085 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6d724-2f94-41eb-a284-2a30489fab3c None admin] RBAC: Authorizing `identity:get_project(project_id=24c64e4744e046f6bc2d382df4e6552f)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:09.451529 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6d724-2f94-41eb-a284-2a30489fab3c None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:09.453212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 584/1152] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:23:09 2022] GET /identity/v3/projects/24c64e4744e046f6bc2d382df4e6552f => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:09.459625 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9fa6d-9d24-466c-adfc-ccb7ceb286e5 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:09.501908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:09.561006 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9fa6d-9d24-466c-adfc-ccb7ceb286e5 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:09.593121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041bac8-27bb-491c-82fb-c3a21e36a4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:09.594007 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041bac8-27bb-491c-82fb-c3a21e36a4a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:09.594293 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041bac8-27bb-491c-82fb-c3a21e36a4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:09.594572 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041bac8-27bb-491c-82fb-c3a21e36a4a7 None admin] PATH_INFO: `/v3/projects/24c64e4744e046f6bc2d382df4e6552f/users/d32a6d3f54d9424ab1413d14b5427f88/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:09.596533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041bac8-27bb-491c-82fb-c3a21e36a4a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=24c64e4744e046f6bc2d382df4e6552f, user_id=d32a6d3f54d9424ab1413d14b5427f88, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:09.597976 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041bac8-27bb-491c-82fb-c3a21e36a4a7 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:09.672793 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 569/1153] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:23:09 2022] PUT /identity/v3/projects/24c64e4744e046f6bc2d382df4e6552f/users/d32a6d3f54d9424ab1413d14b5427f88/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:23:11.701597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716f65f-86bb-47e7-8b82-e406e81de243 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:11.702128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716f65f-86bb-47e7-8b82-e406e81de243 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:11.702128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716f65f-86bb-47e7-8b82-e406e81de243 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:11.703539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 585/1154] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:11.709493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a0f8e-4b93-46dc-8939-94427ee7382a None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:11.709879 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a0f8e-4b93-46dc-8939-94427ee7382a None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:11.710050 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a0f8e-4b93-46dc-8939-94427ee7382a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:11.726622 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-542a0f8e-4b93-46dc-8939-94427ee7382a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:11.727823 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-542a0f8e-4b93-46dc-8939-94427ee7382a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:11.792985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 570/1155] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:11.816656 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716f65f-86bb-47e7-8b82-e406e81de243 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:11.918929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716f65f-86bb-47e7-8b82-e406e81de243 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:11.951965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a38000-cc89-4820-9e86-49dfaa218715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:11.952684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a38000-cc89-4820-9e86-49dfaa218715 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:11.952972 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a38000-cc89-4820-9e86-49dfaa218715 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:11.953254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a38000-cc89-4820-9e86-49dfaa218715 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:11.960930 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:11.965156 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a38000-cc89-4820-9e86-49dfaa218715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:23:11.973351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-31a38000-cc89-4820-9e86-49dfaa218715 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:23:11.973351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:11.973351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:11.973351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:11.973351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:11.973351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:11.973351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:11.973351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:11.973351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:11.973351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:11.973351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:11.973351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:11.973351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:23:11.973351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:23:11.973351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:23:11.973351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:23:11.974340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:23:11.974340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:23:11.974340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:23:11.974340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:23:11.974340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:11.974340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:11.974340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:11.974340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:11.974340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:11.974340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:11.974340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:11.974340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:11.974340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:11.974340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:11.974340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:11.974340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:11.975210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:11.975210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:11.975210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:11.975210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:11.975210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:23:11.975210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:23:11.975210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:23:11.975210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:23:11.975210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:23:11.975210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:23:11.975210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:23:11.975210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:23:11.975210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 586/1156] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:23:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:11.980666 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a0f8e-4b93-46dc-8939-94427ee7382a None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:12.010551 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:12.078609 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a0f8e-4b93-46dc-8939-94427ee7382a None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:12.112268 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebf04d-abcf-4506-a4ae-fabfe05bb5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:12.112930 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebf04d-abcf-4506-a4ae-fabfe05bb5bf None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:12.113211 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebf04d-abcf-4506-a4ae-fabfe05bb5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:12.113485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebf04d-abcf-4506-a4ae-fabfe05bb5bf None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:12.114731 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebf04d-abcf-4506-a4ae-fabfe05bb5bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:12.115036 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebf04d-abcf-4506-a4ae-fabfe05bb5bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:12.116427 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebf04d-abcf-4506-a4ae-fabfe05bb5bf None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:12.124933 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 571/1157] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:23:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:12.131377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a38000-cc89-4820-9e86-49dfaa218715 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:12.229034 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a38000-cc89-4820-9e86-49dfaa218715 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:12.263993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb2454-2f9b-4c37-986c-4fef8d7398b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:12.264868 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb2454-2f9b-4c37-986c-4fef8d7398b3 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:12.265148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb2454-2f9b-4c37-986c-4fef8d7398b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:12.265424 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb2454-2f9b-4c37-986c-4fef8d7398b3 None admin] PATH_INFO: `/v3/users/d32a6d3f54d9424ab1413d14b5427f88` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:12.266598 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb2454-2f9b-4c37-986c-4fef8d7398b3 None admin] RBAC: Authorizing `identity:get_user(user_id=d32a6d3f54d9424ab1413d14b5427f88)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:12.268049 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb2454-2f9b-4c37-986c-4fef8d7398b3 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:12.269663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 587/1158] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:23:12 2022] GET /identity/v3/users/d32a6d3f54d9424ab1413d14b5427f88 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:12.275703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebf04d-abcf-4506-a4ae-fabfe05bb5bf None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:12.373135 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:12.382494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebf04d-abcf-4506-a4ae-fabfe05bb5bf None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:12.415396 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab1122-05b6-4939-9b63-d697c138f40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:12.416035 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab1122-05b6-4939-9b63-d697c138f40b None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:12.416321 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab1122-05b6-4939-9b63-d697c138f40b None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:12.416600 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab1122-05b6-4939-9b63-d697c138f40b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:12.483498 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab1122-05b6-4939-9b63-d697c138f40b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:12.484865 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab1122-05b6-4939-9b63-d697c138f40b None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:12.573406 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:12.582527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 572/1159] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:23:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:23:12.588735 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb2454-2f9b-4c37-986c-4fef8d7398b3 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:12.653168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:12.686847 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb2454-2f9b-4c37-986c-4fef8d7398b3 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:12.720716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54423cce-4a76-43be-bd36-18bdda96981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:12.721574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54423cce-4a76-43be-bd36-18bdda96981e None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:12.721856 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54423cce-4a76-43be-bd36-18bdda96981e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:12.722134 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54423cce-4a76-43be-bd36-18bdda96981e None admin] PATH_INFO: `/v3/projects/24c64e4744e046f6bc2d382df4e6552f` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:12.723972 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54423cce-4a76-43be-bd36-18bdda96981e None admin] RBAC: Authorizing `identity:get_project(project_id=24c64e4744e046f6bc2d382df4e6552f)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:12.725580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54423cce-4a76-43be-bd36-18bdda96981e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:12.727259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 588/1160] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:23:12 2022] GET /identity/v3/projects/24c64e4744e046f6bc2d382df4e6552f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:12.733389 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab1122-05b6-4939-9b63-d697c138f40b None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:12.833496 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab1122-05b6-4939-9b63-d697c138f40b None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:12.867177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c513915-8cd8-4a4b-a07e-d8b153d90cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:12.867872 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c513915-8cd8-4a4b-a07e-d8b153d90cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:12.868150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c513915-8cd8-4a4b-a07e-d8b153d90cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:12.868419 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c513915-8cd8-4a4b-a07e-d8b153d90cc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:12.869238 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c513915-8cd8-4a4b-a07e-d8b153d90cc8 None admin] RBAC: Adding query filter params (role.id=ae530119fc5c42358179521ce865b5d7, scope.project.id=24c64e4744e046f6bc2d382df4e6552f, user.id=d32a6d3f54d9424ab1413d14b5427f88) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:12.869545 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c513915-8cd8-4a4b-a07e-d8b153d90cc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:12.871206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c513915-8cd8-4a4b-a07e-d8b153d90cc8 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:12.877021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 573/1161] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:23:12 2022] GET /identity/v3/role_assignments?user.id=d32a6d3f54d9424ab1413d14b5427f88&scope.project.id=24c64e4744e046f6bc2d382df4e6552f&role.id=ae530119fc5c42358179521ce865b5d7 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:14.960208 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc426-ede0-447d-b106-f311d058415d None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:14.960741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc426-ede0-447d-b106-f311d058415d None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:14.960829 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bc426-ede0-447d-b106-f311d058415d None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:14.962144 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 589/1162] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:14.967496 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e38fb-40f3-490b-abf3-8eb4457d4d33 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:14.968022 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e38fb-40f3-490b-abf3-8eb4457d4d33 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:14.968164 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e38fb-40f3-490b-abf3-8eb4457d4d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:14.985497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-965e38fb-40f3-490b-abf3-8eb4457d4d33 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:14.986696 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-965e38fb-40f3-490b-abf3-8eb4457d4d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:15.041207 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:15.058433 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 574/1163] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:15.083524 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bc426-ede0-447d-b106-f311d058415d None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:15.189327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bc426-ede0-447d-b106-f311d058415d None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:15.224575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecdc76-9167-4ad9-a40f-67b279a5a898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:15.225148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecdc76-9167-4ad9-a40f-67b279a5a898 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:15.225435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecdc76-9167-4ad9-a40f-67b279a5a898 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:15.225711 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecdc76-9167-4ad9-a40f-67b279a5a898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:15.228459 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:15.295669 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ecdc76-9167-4ad9-a40f-67b279a5a898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:15.297115 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ecdc76-9167-4ad9-a40f-67b279a5a898 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:15.412795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 590/1164] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:23:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:23:15.419024 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e38fb-40f3-490b-abf3-8eb4457d4d33 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:15.519457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e38fb-40f3-490b-abf3-8eb4457d4d33 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:15.553566 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669de324-a542-4f95-a5a8-347e720ef7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:15.554374 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669de324-a542-4f95-a5a8-347e720ef7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:15.554656 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669de324-a542-4f95-a5a8-347e720ef7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:15.554933 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669de324-a542-4f95-a5a8-347e720ef7a3 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:15.561557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669de324-a542-4f95-a5a8-347e720ef7a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:15.562999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669de324-a542-4f95-a5a8-347e720ef7a3 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:15.577009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-669de324-a542-4f95-a5a8-347e720ef7a3 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 14:23:15.577009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:15.577009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 12 14:23:15.577009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 12 14:23:15.577009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:23:15.577009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:23:15.577009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:23:15.577009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:23:15.577009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 12 14:23:15.577009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:23:15.577009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:23:15.577009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:23:15.577009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:15.577009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:15.577009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:15.577009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:15.577009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:15.578367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:15.578367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:15.578367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:15.578367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:15.578367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:15.578367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:15.578367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:23:15.578367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:23:15.578367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:23:15.578367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:23:15.578367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:15.578367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:15.578367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:15.578367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:15.578367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:15.578367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:15.579603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:15.579603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:15.579603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:15.579603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:15.579603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:15.579603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:15.579603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:15.579603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:15.579603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:15.579603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:15.579603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 12 14:23:15.579603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:23:15.579603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 14:23:15.579603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:23:15.579603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 575/1165] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Jul 12 14:23:15 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:15.584909 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecdc76-9167-4ad9-a40f-67b279a5a898 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:15.620174 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:15.687302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecdc76-9167-4ad9-a40f-67b279a5a898 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:15.722222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab18f6-3236-4de2-b06e-3663eb47dcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:15.722885 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab18f6-3236-4de2-b06e-3663eb47dcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:15.723911 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab18f6-3236-4de2-b06e-3663eb47dcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:15.724668 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab18f6-3236-4de2-b06e-3663eb47dcc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:15.725398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab18f6-3236-4de2-b06e-3663eb47dcc5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:15.725711 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab18f6-3236-4de2-b06e-3663eb47dcc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:15.727088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab18f6-3236-4de2-b06e-3663eb47dcc5 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:15.734478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 591/1166] 10.222.0.40 () {56 vars in 1115 bytes} [Tue Jul 12 14:23:15 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:17.835937 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2422b-b035-44dc-ab70-17715a34e35b None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:17.836496 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2422b-b035-44dc-ab70-17715a34e35b None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:17.836496 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2422b-b035-44dc-ab70-17715a34e35b None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:17.837874 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 576/1167] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:17.843241 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d952c-d0b4-44a1-af0a-d2dc2c709f3b None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:17.843698 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d952c-d0b4-44a1-af0a-d2dc2c709f3b None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:17.843836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d952c-d0b4-44a1-af0a-d2dc2c709f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:17.862356 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-f00d952c-d0b4-44a1-af0a-d2dc2c709f3b None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:17.863633 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f00d952c-d0b4-44a1-af0a-d2dc2c709f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:17.929953 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 592/1168] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:23:17.953258 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2422b-b035-44dc-ab70-17715a34e35b None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:18.007118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:18.062123 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2422b-b035-44dc-ab70-17715a34e35b None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:18.095559 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5b722-3884-42d8-86e8-f1552449dc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:18.096132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5b722-3884-42d8-86e8-f1552449dc89 None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:18.096415 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5b722-3884-42d8-86e8-f1552449dc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:18.096690 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5b722-3884-42d8-86e8-f1552449dc89 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:18.097442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5b722-3884-42d8-86e8-f1552449dc89 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:18.099453 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5b722-3884-42d8-86e8-f1552449dc89 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:18.159501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 577/1169] 10.222.0.40 () {60 vars in 1138 bytes} [Tue Jul 12 14:23:17 2022] POST /identity/v3/domains => generated 267 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:23:20.234185 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad3ac4-0407-47b9-aef3-c914132336cb None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:20.234750 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad3ac4-0407-47b9-aef3-c914132336cb None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:20.234750 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad3ac4-0407-47b9-aef3-c914132336cb None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:20.236172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 593/1170] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:20.241916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0fad-a69d-45bf-82a4-0a52736c0bf9 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:20.242299 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0fad-a69d-45bf-82a4-0a52736c0bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:20.242483 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0fad-a69d-45bf-82a4-0a52736c0bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:20.261066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-3dca0fad-a69d-45bf-82a4-0a52736c0bf9 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:20.262264 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-3dca0fad-a69d-45bf-82a4-0a52736c0bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:20.330478 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 578/1171] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:20.355888 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad3ac4-0407-47b9-aef3-c914132336cb None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:20.387180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:20.462376 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad3ac4-0407-47b9-aef3-c914132336cb None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:20.497744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87d867-4fe1-44b6-b9cf-abf4f2a4ca40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:20.498517 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87d867-4fe1-44b6-b9cf-abf4f2a4ca40 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:20.498795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87d867-4fe1-44b6-b9cf-abf4f2a4ca40 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:20.499065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87d867-4fe1-44b6-b9cf-abf4f2a4ca40 None admin] PATH_INFO: `/v3/domains/93543e2db64a4525b85dac49fca2f526` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:20.509552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87d867-4fe1-44b6-b9cf-abf4f2a4ca40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=93543e2db64a4525b85dac49fca2f526)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:20.510984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87d867-4fe1-44b6-b9cf-abf4f2a4ca40 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:20.512664 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 594/1172] 10.222.0.40 () {56 vars in 1183 bytes} [Tue Jul 12 14:23:20 2022] GET /identity/v3/domains/93543e2db64a4525b85dac49fca2f526 => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:20.518857 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca0fad-a69d-45bf-82a4-0a52736c0bf9 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:20.556076 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:20.624995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca0fad-a69d-45bf-82a4-0a52736c0bf9 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:20.662902 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565ba4c-497f-47f2-a24f-d41d874ef19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:20.663593 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565ba4c-497f-47f2-a24f-d41d874ef19f None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:20.663874 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565ba4c-497f-47f2-a24f-d41d874ef19f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:20.664146 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565ba4c-497f-47f2-a24f-d41d874ef19f None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:20.664856 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565ba4c-497f-47f2-a24f-d41d874ef19f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:20.666277 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565ba4c-497f-47f2-a24f-d41d874ef19f None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:20.747640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 579/1173] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Jul 12 14:23:20 2022] POST /identity/v3/projects => generated 361 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:23:22.933867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec739c-78df-4f36-857f-62439aa145c0 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:22.934432 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec739c-78df-4f36-857f-62439aa145c0 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:22.934432 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec739c-78df-4f36-857f-62439aa145c0 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:22.935828 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 595/1174] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:22.941193 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cd0c1-1f66-4998-bc91-8e4ac4635e02 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:22.942218 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cd0c1-1f66-4998-bc91-8e4ac4635e02 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:22.942387 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cd0c1-1f66-4998-bc91-8e4ac4635e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:22.958840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-c95cd0c1-1f66-4998-bc91-8e4ac4635e02 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:22.960069 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-c95cd0c1-1f66-4998-bc91-8e4ac4635e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:23.025440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 580/1175] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:23.050627 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec739c-78df-4f36-857f-62439aa145c0 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:23.138800 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:23.151761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec739c-78df-4f36-857f-62439aa145c0 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:23.185676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09ad1e-c85e-4955-9d2b-7bf0530a2f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:23.186463 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09ad1e-c85e-4955-9d2b-7bf0530a2f07 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:23.186753 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09ad1e-c85e-4955-9d2b-7bf0530a2f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:23.187034 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09ad1e-c85e-4955-9d2b-7bf0530a2f07 None admin] PATH_INFO: `/v3/domains/93543e2db64a4525b85dac49fca2f526` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:23.188262 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09ad1e-c85e-4955-9d2b-7bf0530a2f07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=93543e2db64a4525b85dac49fca2f526)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:23.189690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09ad1e-c85e-4955-9d2b-7bf0530a2f07 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:23.191336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 596/1176] 10.222.0.40 () {56 vars in 1183 bytes} [Tue Jul 12 14:23:23 2022] GET /identity/v3/domains/93543e2db64a4525b85dac49fca2f526 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:23.197358 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95cd0c1-1f66-4998-bc91-8e4ac4635e02 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:23.216308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:23.296593 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95cd0c1-1f66-4998-bc91-8e4ac4635e02 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:23.330084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ba97f-5115-4e52-bbbb-a13dcc56e809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:23.330749 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ba97f-5115-4e52-bbbb-a13dcc56e809 None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:23.331032 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ba97f-5115-4e52-bbbb-a13dcc56e809 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:23.331447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ba97f-5115-4e52-bbbb-a13dcc56e809 None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:23.332689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ba97f-5115-4e52-bbbb-a13dcc56e809 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:23.334152 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ba97f-5115-4e52-bbbb-a13dcc56e809 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:23.426564 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 581/1177] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Jul 12 14:23:23 2022] POST /identity/v3/users => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:23:25.564566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf07bf-a89b-4dbc-80e7-63058c3f52bf None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:25.565106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf07bf-a89b-4dbc-80e7-63058c3f52bf None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:25.565106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf07bf-a89b-4dbc-80e7-63058c3f52bf None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:25.566989 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 597/1178] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:25.572435 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a2815-0b9f-42af-aacc-a9472b6e9b3f None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:25.572849 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a2815-0b9f-42af-aacc-a9472b6e9b3f None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:25.572999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a2815-0b9f-42af-aacc-a9472b6e9b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:25.590257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-cb6a2815-0b9f-42af-aacc-a9472b6e9b3f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:25.591473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-cb6a2815-0b9f-42af-aacc-a9472b6e9b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:25.657721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 582/1179] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:25.681836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf07bf-a89b-4dbc-80e7-63058c3f52bf None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:25.783528 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf07bf-a89b-4dbc-80e7-63058c3f52bf None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:25.818321 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f8d39-fa97-4bd4-b6d0-787ecaa0237b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:25.819173 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f8d39-fa97-4bd4-b6d0-787ecaa0237b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:25.819380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f8d39-fa97-4bd4-b6d0-787ecaa0237b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:25.819692 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f8d39-fa97-4bd4-b6d0-787ecaa0237b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:25.829656 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f8d39-fa97-4bd4-b6d0-787ecaa0237b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:23:25.837851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-851f8d39-fa97-4bd4-b6d0-787ecaa0237b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:23:25.837851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:25.837851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:25.837851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:25.837851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:25.837851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:25.837851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:25.837851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:25.837851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:25.837851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:25.837851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:25.837851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:25.837851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:23:25.837851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:23:25.837851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:23:25.837851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:23:25.838947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:23:25.838947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:23:25.838947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:23:25.838947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:23:25.838947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:25.838947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:25.838947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:25.838947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:25.838947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:25.838947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:25.838947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:25.838947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:25.838947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:25.838947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:25.838947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:25.838947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:25.840106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:25.840106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:25.840106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:25.840106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:25.840106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:23:25.840106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:23:25.840106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:23:25.840106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:23:25.840106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:23:25.840106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:23:25.840106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:23:25.840106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:23:25.840106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 598/1180] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:23:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:25.845248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a2815-0b9f-42af-aacc-a9472b6e9b3f None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:25.848898 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:25.951920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a2815-0b9f-42af-aacc-a9472b6e9b3f None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:25.986324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0584c-55dc-41d8-8091-a2265462096d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:25.986989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0584c-55dc-41d8-8091-a2265462096d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:25.987267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0584c-55dc-41d8-8091-a2265462096d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:25.987571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0584c-55dc-41d8-8091-a2265462096d None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:25.988343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0584c-55dc-41d8-8091-a2265462096d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:25.989822 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0584c-55dc-41d8-8091-a2265462096d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:25.991269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0584c-55dc-41d8-8091-a2265462096d None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:25.999645 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 583/1181] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:23:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:26.005634 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f8d39-fa97-4bd4-b6d0-787ecaa0237b None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:26.024311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:26.112620 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f8d39-fa97-4bd4-b6d0-787ecaa0237b None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:26.147843 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723aeab-0102-473a-b818-6ee49c733e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:26.148707 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723aeab-0102-473a-b818-6ee49c733e48 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:26.148987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723aeab-0102-473a-b818-6ee49c733e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:26.149261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723aeab-0102-473a-b818-6ee49c733e48 None admin] PATH_INFO: `/v3/users/a0a324bfee774f52b47ce7be38107a00` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:26.162354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723aeab-0102-473a-b818-6ee49c733e48 None admin] RBAC: Authorizing `identity:get_user(user_id=a0a324bfee774f52b47ce7be38107a00)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:26.163823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723aeab-0102-473a-b818-6ee49c733e48 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:26.165498 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 599/1182] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:23:26 2022] GET /identity/v3/users/a0a324bfee774f52b47ce7be38107a00 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:26.171541 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0584c-55dc-41d8-8091-a2265462096d None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:26.235514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:26.271555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0584c-55dc-41d8-8091-a2265462096d None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:26.304722 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471eb250-5287-47e7-8f56-5d8397819827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:26.305383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471eb250-5287-47e7-8f56-5d8397819827 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:26.305667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471eb250-5287-47e7-8f56-5d8397819827 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:26.305948 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471eb250-5287-47e7-8f56-5d8397819827 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:26.374465 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471eb250-5287-47e7-8f56-5d8397819827 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:26.375861 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471eb250-5287-47e7-8f56-5d8397819827 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:26.439058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:26.475204 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 584/1183] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:23:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:23:26.481218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723aeab-0102-473a-b818-6ee49c733e48 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:26.555269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:26.578564 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723aeab-0102-473a-b818-6ee49c733e48 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:26.613153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17c5ab-8c5e-4699-a901-38f88077f0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:26.614040 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17c5ab-8c5e-4699-a901-38f88077f0cf None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:26.614318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17c5ab-8c5e-4699-a901-38f88077f0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:26.614597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17c5ab-8c5e-4699-a901-38f88077f0cf None admin] PATH_INFO: `/v3/projects/e1bd08dac7e94fc581f033097b357ede` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:26.615790 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17c5ab-8c5e-4699-a901-38f88077f0cf None admin] RBAC: Authorizing `identity:get_project(project_id=e1bd08dac7e94fc581f033097b357ede)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:26.617213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17c5ab-8c5e-4699-a901-38f88077f0cf None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:26.618896 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 600/1184] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:23:26 2022] GET /identity/v3/projects/e1bd08dac7e94fc581f033097b357ede => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:26.625331 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471eb250-5287-47e7-8f56-5d8397819827 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:26.722395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471eb250-5287-47e7-8f56-5d8397819827 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:26.756185 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a8886-ed6e-42a5-b5a3-b159ce25890c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:26.756828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a8886-ed6e-42a5-b5a3-b159ce25890c None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:26.757111 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a8886-ed6e-42a5-b5a3-b159ce25890c None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:26.757387 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a8886-ed6e-42a5-b5a3-b159ce25890c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:26.758205 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a8886-ed6e-42a5-b5a3-b159ce25890c None admin] RBAC: Adding query filter params (role.id=ae530119fc5c42358179521ce865b5d7, scope.project.id=e1bd08dac7e94fc581f033097b357ede, user.id=a0a324bfee774f52b47ce7be38107a00) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:26.758513 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a8886-ed6e-42a5-b5a3-b159ce25890c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:26.759957 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a8886-ed6e-42a5-b5a3-b159ce25890c None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:26.765312 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 585/1185] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:23:26 2022] GET /identity/v3/role_assignments?user.id=a0a324bfee774f52b47ce7be38107a00&scope.project.id=e1bd08dac7e94fc581f033097b357ede&role.id=ae530119fc5c42358179521ce865b5d7 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:28.779346 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6ceea-124d-48b8-bc6d-d71d54ab5dd4 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:28.779909 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6ceea-124d-48b8-bc6d-d71d54ab5dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:28.779909 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6ceea-124d-48b8-bc6d-d71d54ab5dd4 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:28.781285 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 601/1186] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:28.786741 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70d6e3-384a-467d-8de5-4ae405799a71 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:28.787129 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70d6e3-384a-467d-8de5-4ae405799a71 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:28.787313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70d6e3-384a-467d-8de5-4ae405799a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:28.804413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-ed70d6e3-384a-467d-8de5-4ae405799a71 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:28.805580 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ed70d6e3-384a-467d-8de5-4ae405799a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:28.830060 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:28.873151 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 586/1187] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:28.896666 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6ceea-124d-48b8-bc6d-d71d54ab5dd4 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:28.997188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6ceea-124d-48b8-bc6d-d71d54ab5dd4 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:29.029700 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f6faf-ce9f-426e-b6aa-7a17409cb34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:29.030405 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f6faf-ce9f-426e-b6aa-7a17409cb34a None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:29.030685 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f6faf-ce9f-426e-b6aa-7a17409cb34a None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:29.030960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f6faf-ce9f-426e-b6aa-7a17409cb34a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:29.042449 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f6faf-ce9f-426e-b6aa-7a17409cb34a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:23:29.050073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-ea6f6faf-ce9f-426e-b6aa-7a17409cb34a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:23:29.050073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:29.050073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:29.050073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:29.050073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:29.050073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:29.050073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:29.050073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:29.050073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:29.050073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:29.050073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:29.050073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:29.050073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:23:29.050073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:23:29.050073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:23:29.050073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:23:29.051694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:23:29.051694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:23:29.051694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:23:29.051694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:23:29.051694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:29.051694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:29.051694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:29.051694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:29.051694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:29.051694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:29.051694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:29.051694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:29.051694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:29.051694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:29.051694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:29.051694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:29.052724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:29.052724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:29.052724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:29.052724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:29.052724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:23:29.052724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:23:29.052724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:23:29.052724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:23:29.052724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:23:29.052724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:23:29.052724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:23:29.052724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:23:29.052724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 602/1188] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:23:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:29.058243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70d6e3-384a-467d-8de5-4ae405799a71 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:29.155026 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70d6e3-384a-467d-8de5-4ae405799a71 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:29.188054 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8748b3-9abf-4c65-ba88-b6c2feb221a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:29.188718 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8748b3-9abf-4c65-ba88-b6c2feb221a4 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:29.189047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8748b3-9abf-4c65-ba88-b6c2feb221a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:29.189323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8748b3-9abf-4c65-ba88-b6c2feb221a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:29.190182 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8748b3-9abf-4c65-ba88-b6c2feb221a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:29.190488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8748b3-9abf-4c65-ba88-b6c2feb221a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:29.192614 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8748b3-9abf-4c65-ba88-b6c2feb221a4 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:29.200582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 587/1189] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:23:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:29.206339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f6faf-ce9f-426e-b6aa-7a17409cb34a None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:29.209804 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:29.304912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f6faf-ce9f-426e-b6aa-7a17409cb34a None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:29.339388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0df5a-e048-45bd-ba93-35524c964235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:29.340259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0df5a-e048-45bd-ba93-35524c964235 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:29.340541 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0df5a-e048-45bd-ba93-35524c964235 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:29.340816 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0df5a-e048-45bd-ba93-35524c964235 None admin] PATH_INFO: `/v3/users/a0a324bfee774f52b47ce7be38107a00` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:29.342018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0df5a-e048-45bd-ba93-35524c964235 None admin] RBAC: Authorizing `identity:get_user(user_id=a0a324bfee774f52b47ce7be38107a00)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:29.343501 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0df5a-e048-45bd-ba93-35524c964235 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:29.345139 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 603/1190] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:23:29 2022] GET /identity/v3/users/a0a324bfee774f52b47ce7be38107a00 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:29.351080 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8748b3-9abf-4c65-ba88-b6c2feb221a4 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:29.376455 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:29.452467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8748b3-9abf-4c65-ba88-b6c2feb221a4 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:29.487846 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f999725-ffdd-40ae-9039-c5b12dd2ca84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:29.489259 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f999725-ffdd-40ae-9039-c5b12dd2ca84 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:29.489541 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f999725-ffdd-40ae-9039-c5b12dd2ca84 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:29.489818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f999725-ffdd-40ae-9039-c5b12dd2ca84 None admin] PATH_INFO: `/v3/projects/e1bd08dac7e94fc581f033097b357ede` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:29.491008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f999725-ffdd-40ae-9039-c5b12dd2ca84 None admin] RBAC: Authorizing `identity:get_project(project_id=e1bd08dac7e94fc581f033097b357ede)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:29.492508 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f999725-ffdd-40ae-9039-c5b12dd2ca84 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:29.494197 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 588/1191] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:23:29 2022] GET /identity/v3/projects/e1bd08dac7e94fc581f033097b357ede => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:29.500511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0df5a-e048-45bd-ba93-35524c964235 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:29.570102 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:29.601257 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0df5a-e048-45bd-ba93-35524c964235 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:29.636382 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b83d33-de48-4aaf-bafc-b443d2542157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:29.637273 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b83d33-de48-4aaf-bafc-b443d2542157 None admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:29.637561 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b83d33-de48-4aaf-bafc-b443d2542157 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:29.637843 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b83d33-de48-4aaf-bafc-b443d2542157 None admin] PATH_INFO: `/v3/projects/e1bd08dac7e94fc581f033097b357ede/users/a0a324bfee774f52b47ce7be38107a00/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:29.639828 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b83d33-de48-4aaf-bafc-b443d2542157 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1bd08dac7e94fc581f033097b357ede, user_id=a0a324bfee774f52b47ce7be38107a00, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:29.641270 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b83d33-de48-4aaf-bafc-b443d2542157 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:29.742288 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 604/1192] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:23:29 2022] PUT /identity/v3/projects/e1bd08dac7e94fc581f033097b357ede/users/a0a324bfee774f52b47ce7be38107a00/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:23:31.757354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae975f-7201-4e1c-9448-92e24aa8732e None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:31.757922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae975f-7201-4e1c-9448-92e24aa8732e None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:31.757922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae975f-7201-4e1c-9448-92e24aa8732e None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:31.759243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 589/1193] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:23:31.764605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaa131-9e79-428f-ac64-7f8aac668010 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:31.765029 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaa131-9e79-428f-ac64-7f8aac668010 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:31.765167 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaa131-9e79-428f-ac64-7f8aac668010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:31.782388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-dcaaa131-9e79-428f-ac64-7f8aac668010 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:23:31.783635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-dcaaa131-9e79-428f-ac64-7f8aac668010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:23:31.851858 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 605/1194] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:23:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:23:31.876767 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae975f-7201-4e1c-9448-92e24aa8732e None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:31.967444 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:31.978094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae975f-7201-4e1c-9448-92e24aa8732e None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:32.012734 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74209b-58d4-4dd0-9167-da1f9dd166c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:32.013473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74209b-58d4-4dd0-9167-da1f9dd166c9 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:32.013950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74209b-58d4-4dd0-9167-da1f9dd166c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:32.014396 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74209b-58d4-4dd0-9167-da1f9dd166c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:32.024871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74209b-58d4-4dd0-9167-da1f9dd166c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:23:32.032497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-ac74209b-58d4-4dd0-9167-da1f9dd166c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:23:32.032497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:23:32.032497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:23:32.032497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:23:32.032497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:23:32.032497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:23:32.032497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:23:32.032497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:23:32.032497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:23:32.032497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:23:32.032497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:23:32.032497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:23:32.032497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:23:32.032497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:23:32.032497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:23:32.032497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:23:32.033591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:23:32.033591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:23:32.033591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:23:32.033591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:23:32.033591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:23:32.033591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:23:32.033591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:23:32.033591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:23:32.033591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:23:32.033591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:23:32.033591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:23:32.033591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:23:32.033591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:23:32.033591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:23:32.033591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:23:32.033591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:23:32.034602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:23:32.034602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:23:32.034602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:23:32.034602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:23:32.034602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:23:32.034602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:23:32.034602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:23:32.034602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:23:32.034602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:23:32.034602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:23:32.034602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:23:32.034602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:23:32.034602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 590/1195] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:23:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:23:32.042135 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaa131-9e79-428f-ac64-7f8aac668010 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:32.102042 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:32.145403 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaa131-9e79-428f-ac64-7f8aac668010 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:32.180765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef048d-4964-4d61-887d-8d4ffed4ad2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:32.181431 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef048d-4964-4d61-887d-8d4ffed4ad2b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:32.181716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef048d-4964-4d61-887d-8d4ffed4ad2b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:32.181995 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef048d-4964-4d61-887d-8d4ffed4ad2b None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:32.182746 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef048d-4964-4d61-887d-8d4ffed4ad2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:32.183054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef048d-4964-4d61-887d-8d4ffed4ad2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:32.184453 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef048d-4964-4d61-887d-8d4ffed4ad2b None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:32.193247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 606/1196] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:23:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:32.198860 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74209b-58d4-4dd0-9167-da1f9dd166c9 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:32.300416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74209b-58d4-4dd0-9167-da1f9dd166c9 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:32.334351 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389695b-bd3d-46e9-a107-d20eae99bba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:32.335212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389695b-bd3d-46e9-a107-d20eae99bba4 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:32.335518 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389695b-bd3d-46e9-a107-d20eae99bba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:32.335792 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389695b-bd3d-46e9-a107-d20eae99bba4 None admin] PATH_INFO: `/v3/users/a0a324bfee774f52b47ce7be38107a00` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:32.336974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389695b-bd3d-46e9-a107-d20eae99bba4 None admin] RBAC: Authorizing `identity:get_user(user_id=a0a324bfee774f52b47ce7be38107a00)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:32.338378 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389695b-bd3d-46e9-a107-d20eae99bba4 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:32.340019 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 591/1197] 10.222.0.40 () {56 vars in 1177 bytes} [Tue Jul 12 14:23:32 2022] GET /identity/v3/users/a0a324bfee774f52b47ce7be38107a00 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:32.345832 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef048d-4964-4d61-887d-8d4ffed4ad2b None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:32.443352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef048d-4964-4d61-887d-8d4ffed4ad2b None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:32.466022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:32.479482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22dd4a-4688-43a5-9147-52cccd348139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:32.480164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22dd4a-4688-43a5-9147-52cccd348139 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:32.480452 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22dd4a-4688-43a5-9147-52cccd348139 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:32.480733 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22dd4a-4688-43a5-9147-52cccd348139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:32.553279 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22dd4a-4688-43a5-9147-52cccd348139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:32.554629 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22dd4a-4688-43a5-9147-52cccd348139 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:32.653100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 607/1198] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:23:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:23:32.659335 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389695b-bd3d-46e9-a107-d20eae99bba4 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:32.679869 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:32.762403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389695b-bd3d-46e9-a107-d20eae99bba4 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:32.797025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a0425-489c-4fa0-a0c8-7523b59c6e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:32.797887 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a0425-489c-4fa0-a0c8-7523b59c6e9d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:32.798173 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a0425-489c-4fa0-a0c8-7523b59c6e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:32.798451 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a0425-489c-4fa0-a0c8-7523b59c6e9d None admin] PATH_INFO: `/v3/projects/e1bd08dac7e94fc581f033097b357ede` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:32.799672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a0425-489c-4fa0-a0c8-7523b59c6e9d None admin] RBAC: Authorizing `identity:get_project(project_id=e1bd08dac7e94fc581f033097b357ede)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:32.801724 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a0425-489c-4fa0-a0c8-7523b59c6e9d None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:32.803515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 592/1199] 10.222.0.40 () {56 vars in 1186 bytes} [Tue Jul 12 14:23:32 2022] GET /identity/v3/projects/e1bd08dac7e94fc581f033097b357ede => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:32.809572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22dd4a-4688-43a5-9147-52cccd348139 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:23:32.834684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:32.909302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22dd4a-4688-43a5-9147-52cccd348139 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:23:32.942700 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934b512-f4f4-441d-9849-115c8e7e2980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:23:32.943368 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934b512-f4f4-441d-9849-115c8e7e2980 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:23:32.943653 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934b512-f4f4-441d-9849-115c8e7e2980 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:23:32.944120 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934b512-f4f4-441d-9849-115c8e7e2980 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:23:32.945357 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934b512-f4f4-441d-9849-115c8e7e2980 None admin] RBAC: Adding query filter params (role.id=ae530119fc5c42358179521ce865b5d7, scope.project.id=e1bd08dac7e94fc581f033097b357ede, user.id=a0a324bfee774f52b47ce7be38107a00) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:23:32.945903 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934b512-f4f4-441d-9849-115c8e7e2980 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:23:32.947342 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934b512-f4f4-441d-9849-115c8e7e2980 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:23:32.953252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 608/1200] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:23:32 2022] GET /identity/v3/role_assignments?user.id=a0a324bfee774f52b47ce7be38107a00&scope.project.id=e1bd08dac7e94fc581f033097b357ede&role.id=ae530119fc5c42358179521ce865b5d7 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:23:42.792610 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=57 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:23:42.950488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=57 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:48.150912 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0198f-b081-42f7-a700-24dddfdc7c72 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:48.151832 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0198f-b081-42f7-a700-24dddfdc7c72 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:48.151998 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0198f-b081-42f7-a700-24dddfdc7c72 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:48.153396 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 593/1201] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:24:48.158986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51fe58-83c4-41de-bb7f-309a8cec7385 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:48.159560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51fe58-83c4-41de-bb7f-309a8cec7385 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:48.159560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51fe58-83c4-41de-bb7f-309a8cec7385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:48.177331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-0a51fe58-83c4-41de-bb7f-309a8cec7385 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:24:48.178839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0a51fe58-83c4-41de-bb7f-309a8cec7385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:24:48.253795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 609/1202] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:24:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:24:48.281163 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0198f-b081-42f7-a700-24dddfdc7c72 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:48.403381 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0198f-b081-42f7-a700-24dddfdc7c72 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:48.440656 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f854fe-4a6e-4789-8014-f84c20be4edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:48.441461 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f854fe-4a6e-4789-8014-f84c20be4edf None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:48.441745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f854fe-4a6e-4789-8014-f84c20be4edf None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:48.442020 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f854fe-4a6e-4789-8014-f84c20be4edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:48.454276 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f854fe-4a6e-4789-8014-f84c20be4edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:48.455827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f854fe-4a6e-4789-8014-f84c20be4edf None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:48.474487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-43f854fe-4a6e-4789-8014-f84c20be4edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:24:48.474487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:24:48.474487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:24:48.474487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:24:48.474487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:24:48.474487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:24:48.474487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:24:48.474487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:24:48.474487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:24:48.474487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:24:48.474487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:24:48.474487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:24:48.474487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:24:48.474487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:24:48.474487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:24:48.475803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:24:48.475803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:24:48.475803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:24:48.475803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:24:48.475803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:24:48.475803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:24:48.475803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:24:48.475803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:24:48.475803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:24:48.475803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:24:48.475803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:24:48.475803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:24:48.475803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:24:48.475803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:24:48.475803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:24:48.475803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:24:48.475803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:24:48.476781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:24:48.476781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:24:48.476781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:24:48.476781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:24:48.476781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 594/1203] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:24:48.481966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51fe58-83c4-41de-bb7f-309a8cec7385 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:48.592304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51fe58-83c4-41de-bb7f-309a8cec7385 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:48.624571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:48.630378 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6450a-0f38-49eb-b044-3b13471596ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:48.634967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6450a-0f38-49eb-b044-3b13471596ac None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:48.634967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6450a-0f38-49eb-b044-3b13471596ac None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:48.634967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6450a-0f38-49eb-b044-3b13471596ac None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:48.634967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6450a-0f38-49eb-b044-3b13471596ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:24:48.634967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6450a-0f38-49eb-b044-3b13471596ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:48.634967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6450a-0f38-49eb-b044-3b13471596ac None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:48.647517 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 610/1204] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:24:48.653852 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f854fe-4a6e-4789-8014-f84c20be4edf None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:48.714114 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:48.786096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f854fe-4a6e-4789-8014-f84c20be4edf None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:48.835708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2c8f1-7c7a-4f6e-a19a-fffe54f32def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:48.836397 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2c8f1-7c7a-4f6e-a19a-fffe54f32def None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:48.836690 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2c8f1-7c7a-4f6e-a19a-fffe54f32def None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:48.836976 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2c8f1-7c7a-4f6e-a19a-fffe54f32def None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:48.837693 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2c8f1-7c7a-4f6e-a19a-fffe54f32def None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:48.839150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2c8f1-7c7a-4f6e-a19a-fffe54f32def None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:48.934361 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 595/1205] 10.222.0.40 () {60 vars in 1132 bytes} [Tue Jul 12 14:24:48 2022] POST /identity/v3/users => generated 251 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:24:51.059817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a68d5b-15c1-4b7a-bf89-aa65e75ec159 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:51.060459 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a68d5b-15c1-4b7a-bf89-aa65e75ec159 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:51.060661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a68d5b-15c1-4b7a-bf89-aa65e75ec159 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:51.063451 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 611/1206] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:24:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:24:51.069899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6ae92-5cd7-4f7a-8afc-b705817687b5 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:51.070699 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6ae92-5cd7-4f7a-8afc-b705817687b5 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:51.070870 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6ae92-5cd7-4f7a-8afc-b705817687b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:51.094927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-52d6ae92-5cd7-4f7a-8afc-b705817687b5 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:24:51.096300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-52d6ae92-5cd7-4f7a-8afc-b705817687b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:24:51.179188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 596/1207] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:24:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:24:51.205158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a68d5b-15c1-4b7a-bf89-aa65e75ec159 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:51.324643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a68d5b-15c1-4b7a-bf89-aa65e75ec159 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:51.362450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bb5d4-5472-417b-9d44-c8780318a172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:51.363331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bb5d4-5472-417b-9d44-c8780318a172 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:51.363645 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bb5d4-5472-417b-9d44-c8780318a172 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:51.363959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bb5d4-5472-417b-9d44-c8780318a172 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:51.376134 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bb5d4-5472-417b-9d44-c8780318a172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:24:51.384764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-591bb5d4-5472-417b-9d44-c8780318a172 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:24:51.384764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:24:51.384764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:24:51.384764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:24:51.384764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:24:51.384764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:24:51.384764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:24:51.384764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:24:51.384764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:24:51.384764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:24:51.384764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:24:51.384764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:24:51.384764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:24:51.384764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:24:51.384764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:24:51.384764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:24:51.386221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:24:51.386221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:24:51.386221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:24:51.386221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:24:51.386221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:24:51.386221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:24:51.386221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:24:51.386221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:24:51.386221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:24:51.386221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:24:51.386221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:24:51.386221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:24:51.386221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:24:51.386221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:24:51.386221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:24:51.386221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:24:51.387684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:24:51.387684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:24:51.387684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:24:51.387684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:24:51.387684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:24:51.387684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:24:51.387684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:24:51.387684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:24:51.387684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:24:51.387684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:24:51.387684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:24:51.387684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:24:51.387684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 612/1208] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:24:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:24:51.393933 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6ae92-5cd7-4f7a-8afc-b705817687b5 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:51.439078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:51.504037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6ae92-5cd7-4f7a-8afc-b705817687b5 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:51.541831 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac421a-7490-439b-bda8-00f0d4651748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:51.542641 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac421a-7490-439b-bda8-00f0d4651748 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:51.543073 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac421a-7490-439b-bda8-00f0d4651748 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:51.543477 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac421a-7490-439b-bda8-00f0d4651748 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:51.544332 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac421a-7490-439b-bda8-00f0d4651748 None admin] RBAC: Adding query filter params (name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:24:51.544745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac421a-7490-439b-bda8-00f0d4651748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:51.546237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac421a-7490-439b-bda8-00f0d4651748 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:51.556381 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 597/1209] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:24:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:24:51.565235 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bb5d4-5472-417b-9d44-c8780318a172 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:51.618845 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:51.671623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bb5d4-5472-417b-9d44-c8780318a172 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:51.712454 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543de30-c65b-4f20-9c8e-8416909dbbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:51.713288 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543de30-c65b-4f20-9c8e-8416909dbbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:51.713572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543de30-c65b-4f20-9c8e-8416909dbbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:51.713850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543de30-c65b-4f20-9c8e-8416909dbbe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:51.724866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543de30-c65b-4f20-9c8e-8416909dbbe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:51.726330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543de30-c65b-4f20-9c8e-8416909dbbe4 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:51.745246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-c543de30-c65b-4f20-9c8e-8416909dbbe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:24:51.745246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:24:51.745246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:24:51.745246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:24:51.745246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:24:51.745246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:24:51.745246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:24:51.745246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:24:51.745246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:24:51.745246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:24:51.745246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:24:51.745246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:24:51.745246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:24:51.745246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:24:51.745246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:24:51.747182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:24:51.747182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:24:51.747182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:24:51.747182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:24:51.747182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:24:51.747182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:24:51.747182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:24:51.747182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:24:51.747182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:24:51.747182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:24:51.747182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:24:51.747182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:24:51.747182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:24:51.747182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:24:51.747182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:24:51.747182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:24:51.747182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:24:51.748497 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:24:51.748497 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:24:51.748497 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:24:51.748497 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:24:51.748497 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 613/1210] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:24:51.752893 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac421a-7490-439b-bda8-00f0d4651748 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:51.855388 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:51.859470 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac421a-7490-439b-bda8-00f0d4651748 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:51.900870 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79593d4b-fc71-4d04-97b0-115f21cc7a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:51.901522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79593d4b-fc71-4d04-97b0-115f21cc7a47 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:51.901848 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79593d4b-fc71-4d04-97b0-115f21cc7a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:51.902168 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79593d4b-fc71-4d04-97b0-115f21cc7a47 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:51.903185 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79593d4b-fc71-4d04-97b0-115f21cc7a47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:24:51.903573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79593d4b-fc71-4d04-97b0-115f21cc7a47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:51.905092 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79593d4b-fc71-4d04-97b0-115f21cc7a47 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:51.920619 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 598/1211] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:24:51.927139 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543de30-c65b-4f20-9c8e-8416909dbbe4 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:52.039645 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543de30-c65b-4f20-9c8e-8416909dbbe4 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:52.041364 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:52.076388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61ee84-02c6-4893-92ec-8530011c086b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:52.077592 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61ee84-02c6-4893-92ec-8530011c086b None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:52.077995 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61ee84-02c6-4893-92ec-8530011c086b None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:52.078380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61ee84-02c6-4893-92ec-8530011c086b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:52.089718 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61ee84-02c6-4893-92ec-8530011c086b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:52.091370 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61ee84-02c6-4893-92ec-8530011c086b None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:52.107022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-9a61ee84-02c6-4893-92ec-8530011c086b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:24:52.107022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:24:52.107022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:24:52.107022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:24:52.107022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:24:52.107022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:24:52.107022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:24:52.107022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:24:52.107022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:24:52.107022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:24:52.107022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:24:52.107022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:24:52.107022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:24:52.107022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:24:52.107022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:24:52.107022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:24:52.109055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:24:52.109055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:24:52.109055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:24:52.109055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:24:52.109055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:24:52.109055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:24:52.109055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:24:52.109055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:24:52.109055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:24:52.109055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:24:52.109055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:24:52.109055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:24:52.109055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:24:52.109055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:24:52.109055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:24:52.109055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:24:52.109055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:24:52.109055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:24:52.111330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:24:52.111330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:24:52.111330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:24:52.111330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:24:52.111330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:24:52.111330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:24:52.111330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:24:52.111330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:24:52.111330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:24:52.111330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:24:52.111330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 614/1212] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:24:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:24:52.117789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79593d4b-fc71-4d04-97b0-115f21cc7a47 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:52.262871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79593d4b-fc71-4d04-97b0-115f21cc7a47 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:52.305544 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff1506-9acd-4154-981d-5ecfde3792c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:52.306267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff1506-9acd-4154-981d-5ecfde3792c0 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:52.306611 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff1506-9acd-4154-981d-5ecfde3792c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:52.306948 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff1506-9acd-4154-981d-5ecfde3792c0 None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:52.307946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff1506-9acd-4154-981d-5ecfde3792c0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:24:52.308297 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff1506-9acd-4154-981d-5ecfde3792c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:52.309784 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff1506-9acd-4154-981d-5ecfde3792c0 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:52.329200 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 599/1213] 10.222.0.40 () {56 vars in 1143 bytes} [Tue Jul 12 14:24:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:24:52.336272 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61ee84-02c6-4893-92ec-8530011c086b None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:52.447552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61ee84-02c6-4893-92ec-8530011c086b None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:52.486655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae67f45-4f83-467f-bbee-56440284d2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:52.487450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae67f45-4f83-467f-bbee-56440284d2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:52.487772 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae67f45-4f83-467f-bbee-56440284d2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:52.488096 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae67f45-4f83-467f-bbee-56440284d2d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:52.530592 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:52.573855 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae67f45-4f83-467f-bbee-56440284d2d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:52.575357 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae67f45-4f83-467f-bbee-56440284d2d2 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:52.684612 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 615/1214] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:24:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:24:52.690930 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff1506-9acd-4154-981d-5ecfde3792c0 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:52.711594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:52.804805 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff1506-9acd-4154-981d-5ecfde3792c0 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:52.848751 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ac69d-9cdb-4705-8e16-f72221c74c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:52.850669 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ac69d-9cdb-4705-8e16-f72221c74c48 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:52.851081 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ac69d-9cdb-4705-8e16-f72221c74c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:52.851593 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ac69d-9cdb-4705-8e16-f72221c74c48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:52.870800 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ac69d-9cdb-4705-8e16-f72221c74c48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:52.876116 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ac69d-9cdb-4705-8e16-f72221c74c48 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:52.906372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-296ac69d-9cdb-4705-8e16-f72221c74c48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:24:52.906372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:24:52.906372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:24:52.906372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:24:52.906372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:24:52.906372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:24:52.906372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:24:52.906372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:24:52.906372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:24:52.906372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:24:52.906372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:24:52.906372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:24:52.906372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:24:52.906372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:24:52.906372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:24:52.907538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:24:52.907538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:24:52.907538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:24:52.907538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:24:52.907538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:24:52.907538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:24:52.907538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:24:52.907538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:24:52.907538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:24:52.907538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:24:52.907538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:24:52.907538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:24:52.907538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:24:52.907538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:24:52.907538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:24:52.907538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:24:52.907538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:24:52.908618 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:24:52.908618 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:24:52.908618 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:24:52.908618 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:24:52.908868 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 600/1215] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:24:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:24:52.918259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae67f45-4f83-467f-bbee-56440284d2d2 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:52.985882 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:53.025806 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae67f45-4f83-467f-bbee-56440284d2d2 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:53.064317 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c4f3f-3e08-4f17-89a6-342f87eeb13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:53.064995 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c4f3f-3e08-4f17-89a6-342f87eeb13a None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:53.065279 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c4f3f-3e08-4f17-89a6-342f87eeb13a None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:53.065557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c4f3f-3e08-4f17-89a6-342f87eeb13a None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:53.066292 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c4f3f-3e08-4f17-89a6-342f87eeb13a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:24:53.066609 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c4f3f-3e08-4f17-89a6-342f87eeb13a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:53.068729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c4f3f-3e08-4f17-89a6-342f87eeb13a None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:53.081138 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 616/1216] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:24:53.087641 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ac69d-9cdb-4705-8e16-f72221c74c48 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:53.166360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:53.198368 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ac69d-9cdb-4705-8e16-f72221c74c48 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:53.237381 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f06c5-3ee5-481b-95e1-bf343693c738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:53.238195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f06c5-3ee5-481b-95e1-bf343693c738 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:53.238480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f06c5-3ee5-481b-95e1-bf343693c738 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:53.238757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f06c5-3ee5-481b-95e1-bf343693c738 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:53.247662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f06c5-3ee5-481b-95e1-bf343693c738 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:53.252500 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f06c5-3ee5-481b-95e1-bf343693c738 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:53.265367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-3d9f06c5-3ee5-481b-95e1-bf343693c738 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:24:53.265367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:24:53.265367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:24:53.265367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:24:53.265367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:24:53.265367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:24:53.265367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:24:53.265367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:24:53.265367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:24:53.265367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:24:53.265367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:24:53.265367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:24:53.265367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:24:53.265367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:24:53.265367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:24:53.267038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:24:53.267038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:24:53.267038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:24:53.267038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:24:53.267038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:24:53.267038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:24:53.267038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:24:53.267038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:24:53.267038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:24:53.267038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:24:53.267038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:24:53.267038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:24:53.267038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:24:53.267038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:24:53.267038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:24:53.267038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:24:53.267038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:24:53.269106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:24:53.269106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:24:53.269106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:24:53.269106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:24:53.269106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:24:53.269106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:24:53.269106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:24:53.269106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:24:53.269106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 601/1217] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:24:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:24:53.274815 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c4f3f-3e08-4f17-89a6-342f87eeb13a None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:53.391090 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c4f3f-3e08-4f17-89a6-342f87eeb13a None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:53.432120 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:53.450464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140730e-3b2c-4a9f-b287-defe632852a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:53.451628 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140730e-3b2c-4a9f-b287-defe632852a7 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:53.452140 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140730e-3b2c-4a9f-b287-defe632852a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:53.452641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140730e-3b2c-4a9f-b287-defe632852a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:53.454177 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140730e-3b2c-4a9f-b287-defe632852a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:24:53.454730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140730e-3b2c-4a9f-b287-defe632852a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:53.457153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140730e-3b2c-4a9f-b287-defe632852a7 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:53.479087 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 617/1218] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:24:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:24:53.485937 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f06c5-3ee5-481b-95e1-bf343693c738 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:53.600526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f06c5-3ee5-481b-95e1-bf343693c738 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:53.634323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:53.641880 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c6d53-cf2d-4522-b67c-b3ecca1f2dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:53.642667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c6d53-cf2d-4522-b67c-b3ecca1f2dfc None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:53.643045 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c6d53-cf2d-4522-b67c-b3ecca1f2dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:53.643497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c6d53-cf2d-4522-b67c-b3ecca1f2dfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:53.644535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c6d53-cf2d-4522-b67c-b3ecca1f2dfc None admin] RBAC: Adding query filter params (role.id=c6f0b65d6ea5449ca79744ac52243ba2, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=0a3704fdba154f13ad3bf8ac00c916c1) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:24:53.644893 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c6d53-cf2d-4522-b67c-b3ecca1f2dfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:53.646463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c6d53-cf2d-4522-b67c-b3ecca1f2dfc None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:53.653064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 602/1219] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:24:53 2022] GET /identity/v3/role_assignments?user.id=0a3704fdba154f13ad3bf8ac00c916c1&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=c6f0b65d6ea5449ca79744ac52243ba2 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:24:55.868507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287b994-6460-4cde-bb83-0d567134c561 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:55.869061 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287b994-6460-4cde-bb83-0d567134c561 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:55.869221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287b994-6460-4cde-bb83-0d567134c561 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:55.870875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 618/1220] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:24:55.877030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2bb32-2522-4e4b-a97f-9a2deed70358 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:55.877618 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2bb32-2522-4e4b-a97f-9a2deed70358 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:55.877618 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2bb32-2522-4e4b-a97f-9a2deed70358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:55.898052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-60c2bb32-2522-4e4b-a97f-9a2deed70358 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:24:55.902453 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-60c2bb32-2522-4e4b-a97f-9a2deed70358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:24:55.979197 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 603/1221] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:24:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:24:56.002881 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287b994-6460-4cde-bb83-0d567134c561 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:56.126648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287b994-6460-4cde-bb83-0d567134c561 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:56.167467 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1f56b-2cb4-4ee5-ae40-28d95da15b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:56.168281 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1f56b-2cb4-4ee5-ae40-28d95da15b30 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:56.168567 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1f56b-2cb4-4ee5-ae40-28d95da15b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:56.168845 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1f56b-2cb4-4ee5-ae40-28d95da15b30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:56.181127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1f56b-2cb4-4ee5-ae40-28d95da15b30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:24:56.189388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-eaa1f56b-2cb4-4ee5-ae40-28d95da15b30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:24:56.189388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:24:56.189388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:24:56.189388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:24:56.189388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:24:56.189388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:24:56.189388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:24:56.189388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:24:56.189388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:24:56.189388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:24:56.189388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:24:56.189388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:24:56.189388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:24:56.189388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:24:56.189388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:24:56.189388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:24:56.191104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:24:56.191104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:24:56.191104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:24:56.191104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:24:56.191104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:24:56.191104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:24:56.191104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:24:56.191104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:24:56.191104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:24:56.191104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:24:56.191104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:24:56.191104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:24:56.191104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:24:56.191104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:24:56.191104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:24:56.191104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:24:56.193219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:24:56.193219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:24:56.193219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:24:56.193219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:24:56.193219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:24:56.193219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:24:56.193219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:24:56.193219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:24:56.193219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:24:56.193219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:24:56.193219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:24:56.193219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:24:56.193219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 619/1222] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:24:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:24:56.198514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2bb32-2522-4e4b-a97f-9a2deed70358 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:56.317488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2bb32-2522-4e4b-a97f-9a2deed70358 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:56.344133 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:56.355592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0c396-7b60-408c-a89b-20c77c4cf34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:56.356388 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0c396-7b60-408c-a89b-20c77c4cf34b None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:56.356776 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0c396-7b60-408c-a89b-20c77c4cf34b None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:56.357147 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0c396-7b60-408c-a89b-20c77c4cf34b None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:56.358045 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0c396-7b60-408c-a89b-20c77c4cf34b None admin] RBAC: Adding query filter params (name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:24:56.358453 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0c396-7b60-408c-a89b-20c77c4cf34b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:56.359952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0c396-7b60-408c-a89b-20c77c4cf34b None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:56.370045 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 604/1223] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:24:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:24:56.376343 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1f56b-2cb4-4ee5-ae40-28d95da15b30 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:56.425712 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:56.498681 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1f56b-2cb4-4ee5-ae40-28d95da15b30 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:56.537019 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc40f44-f07b-4fc0-8a0d-3e924dd17720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:56.537860 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc40f44-f07b-4fc0-8a0d-3e924dd17720 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:56.538152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc40f44-f07b-4fc0-8a0d-3e924dd17720 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:56.538435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc40f44-f07b-4fc0-8a0d-3e924dd17720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:56.554862 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc40f44-f07b-4fc0-8a0d-3e924dd17720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:56.556487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc40f44-f07b-4fc0-8a0d-3e924dd17720 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:56.576210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-4fc40f44-f07b-4fc0-8a0d-3e924dd17720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:24:56.576210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:24:56.576210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:24:56.576210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:24:56.576210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:24:56.576210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:24:56.576210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:24:56.576210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:24:56.576210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:24:56.576210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:24:56.576210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:24:56.576210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:24:56.576210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:24:56.576210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:24:56.576210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:24:56.577955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:24:56.577955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:24:56.577955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:24:56.577955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:24:56.577955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:24:56.577955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:24:56.577955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:24:56.577955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:24:56.577955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:24:56.577955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:24:56.577955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:24:56.577955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:24:56.577955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:24:56.577955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:24:56.577955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:24:56.577955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:24:56.577955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:24:56.584255 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:24:56.584255 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:24:56.584255 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:24:56.584255 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:24:56.584255 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 620/1224] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:24:56.587567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0c396-7b60-408c-a89b-20c77c4cf34b None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:56.716166 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0c396-7b60-408c-a89b-20c77c4cf34b None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:56.758593 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e6a00-08c5-4736-9693-0b3dca5f9448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:56.759369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e6a00-08c5-4736-9693-0b3dca5f9448 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:56.759708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e6a00-08c5-4736-9693-0b3dca5f9448 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:56.760045 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e6a00-08c5-4736-9693-0b3dca5f9448 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:56.760978 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e6a00-08c5-4736-9693-0b3dca5f9448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:24:56.761334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e6a00-08c5-4736-9693-0b3dca5f9448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:56.762857 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e6a00-08c5-4736-9693-0b3dca5f9448 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:56.779077 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 605/1225] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:24:56.785666 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc40f44-f07b-4fc0-8a0d-3e924dd17720 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:56.896674 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:56.904080 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc40f44-f07b-4fc0-8a0d-3e924dd17720 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:56.941873 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ada02a-e70b-43da-8a55-05974875d8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:56.943450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ada02a-e70b-43da-8a55-05974875d8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:56.943914 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ada02a-e70b-43da-8a55-05974875d8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:56.944429 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ada02a-e70b-43da-8a55-05974875d8b7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:56.953712 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ada02a-e70b-43da-8a55-05974875d8b7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:56.955244 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ada02a-e70b-43da-8a55-05974875d8b7 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:56.972817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-88ada02a-e70b-43da-8a55-05974875d8b7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:24:56.972817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:24:56.972817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:24:56.972817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:24:56.972817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:24:56.972817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:24:56.972817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:24:56.972817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:24:56.972817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:24:56.972817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:24:56.972817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:24:56.972817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:24:56.972817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:24:56.972817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:24:56.972817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:24:56.972817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:24:56.974590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:24:56.974590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:24:56.974590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:24:56.974590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:24:56.974590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:24:56.974590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:24:56.974590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:24:56.974590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:24:56.974590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:24:56.974590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:24:56.974590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:24:56.974590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:24:56.974590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:24:56.974590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:24:56.974590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:24:56.974590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:24:56.974590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:24:56.974590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:24:56.975716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:24:56.975716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:24:56.975716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:24:56.975716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:24:56.975716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:24:56.975716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:24:56.975716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:24:56.975716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:24:56.975716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:24:56.975716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:24:56.975716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 621/1226] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:24:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:24:56.981279 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e6a00-08c5-4736-9693-0b3dca5f9448 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:57.052366 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:57.144466 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e6a00-08c5-4736-9693-0b3dca5f9448 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:57.206169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b652b-86c3-4e46-8756-ecf181b4feea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:57.207416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b652b-86c3-4e46-8756-ecf181b4feea None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:57.207913 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b652b-86c3-4e46-8756-ecf181b4feea None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:57.208837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b652b-86c3-4e46-8756-ecf181b4feea None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:57.210416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b652b-86c3-4e46-8756-ecf181b4feea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:24:57.211107 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b652b-86c3-4e46-8756-ecf181b4feea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:57.213950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b652b-86c3-4e46-8756-ecf181b4feea None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:57.251689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 606/1227] 10.222.0.40 () {56 vars in 1143 bytes} [Tue Jul 12 14:24:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:24:57.258051 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ada02a-e70b-43da-8a55-05974875d8b7 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:57.381753 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ada02a-e70b-43da-8a55-05974875d8b7 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:57.420737 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01af68-6ddb-4df6-bfef-67e33aa44d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:57.421574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01af68-6ddb-4df6-bfef-67e33aa44d9e None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:57.421859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01af68-6ddb-4df6-bfef-67e33aa44d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:57.422133 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01af68-6ddb-4df6-bfef-67e33aa44d9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:57.434813 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01af68-6ddb-4df6-bfef-67e33aa44d9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:57.436379 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01af68-6ddb-4df6-bfef-67e33aa44d9e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:57.456142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-ee01af68-6ddb-4df6-bfef-67e33aa44d9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:24:57.456142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:24:57.456142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:24:57.456142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:24:57.456142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:24:57.456142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:24:57.456142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:24:57.456142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:24:57.456142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:24:57.456142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:24:57.456142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:24:57.456142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:24:57.456142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:24:57.456142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:24:57.456142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:24:57.463163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:24:57.463163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:24:57.463163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:24:57.463163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:24:57.463163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:24:57.463163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:24:57.463163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:24:57.463163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:24:57.463163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:24:57.463163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:24:57.463163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:24:57.463163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:24:57.463163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:24:57.463163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:24:57.463163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:24:57.463163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:24:57.463163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:24:57.465205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:24:57.465205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:24:57.465205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:24:57.465205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:24:57.465205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 622/1228] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:24:57.466014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b652b-86c3-4e46-8756-ecf181b4feea None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:57.575903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b652b-86c3-4e46-8756-ecf181b4feea None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:57.578386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:57.613210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f839b4-6e0a-48c2-b960-26e4ab289eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:57.614097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f839b4-6e0a-48c2-b960-26e4ab289eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:57.614505 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f839b4-6e0a-48c2-b960-26e4ab289eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:57.615010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f839b4-6e0a-48c2-b960-26e4ab289eb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:57.616421 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f839b4-6e0a-48c2-b960-26e4ab289eb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:24:57.616741 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f839b4-6e0a-48c2-b960-26e4ab289eb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:57.622905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f839b4-6e0a-48c2-b960-26e4ab289eb2 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:57.632433 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 607/1229] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:24:57.641864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01af68-6ddb-4df6-bfef-67e33aa44d9e None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:57.654731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:57.758810 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01af68-6ddb-4df6-bfef-67e33aa44d9e None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:57.810345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc7bb4-a308-49c1-9134-21939f3264fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:57.811617 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc7bb4-a308-49c1-9134-21939f3264fa None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:57.812054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc7bb4-a308-49c1-9134-21939f3264fa None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:57.812523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc7bb4-a308-49c1-9134-21939f3264fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:57.825375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc7bb4-a308-49c1-9134-21939f3264fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:57.827984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc7bb4-a308-49c1-9134-21939f3264fa None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:57.854807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-19cc7bb4-a308-49c1-9134-21939f3264fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:24:57.854807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:24:57.854807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:24:57.854807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:24:57.854807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:24:57.854807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:24:57.854807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:24:57.854807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:24:57.854807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:24:57.854807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:24:57.854807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:24:57.854807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:24:57.854807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:24:57.854807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:24:57.854807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:24:57.856448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:24:57.856448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:24:57.856448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:24:57.856448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:24:57.856448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:24:57.856448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:24:57.856448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:24:57.856448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:24:57.856448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:24:57.856448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:24:57.856448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:24:57.856448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:24:57.856448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:24:57.856448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:24:57.856448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:24:57.856448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:24:57.856448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:24:57.858132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:24:57.858132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:24:57.858132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:24:57.858132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:24:57.858132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:24:57.858132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:24:57.858132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:24:57.858132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:24:57.858132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 623/1230] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:24:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:24:57.863081 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f839b4-6e0a-48c2-b960-26e4ab289eb2 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:57.980728 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f839b4-6e0a-48c2-b960-26e4ab289eb2 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:58.017744 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a66b7c-a314-41c3-a544-48f8198742c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:58.018495 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a66b7c-a314-41c3-a544-48f8198742c3 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:58.018681 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a66b7c-a314-41c3-a544-48f8198742c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:58.018960 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a66b7c-a314-41c3-a544-48f8198742c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:58.019794 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a66b7c-a314-41c3-a544-48f8198742c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:24:58.020103 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a66b7c-a314-41c3-a544-48f8198742c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:58.021582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a66b7c-a314-41c3-a544-48f8198742c3 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:58.034380 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 608/1231] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:24:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:24:58.040901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc7bb4-a308-49c1-9134-21939f3264fa None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:24:58.128073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:24:58.173930 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc7bb4-a308-49c1-9134-21939f3264fa None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:24:58.234608 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb27f6-62da-4c02-aeb1-db35502a0200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:24:58.236227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb27f6-62da-4c02-aeb1-db35502a0200 None admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:24:58.236738 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb27f6-62da-4c02-aeb1-db35502a0200 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:24:58.237229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb27f6-62da-4c02-aeb1-db35502a0200 None admin] PATH_INFO: `/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/0a3704fdba154f13ad3bf8ac00c916c1/roles/c6f0b65d6ea5449ca79744ac52243ba2` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:24:58.265172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb27f6-62da-4c02-aeb1-db35502a0200 None admin] RBAC: Authorizing `identity:create_grant(project_id=00424b6950d14cd4854e4add3e3d7705, user_id=0a3704fdba154f13ad3bf8ac00c916c1, role_id=c6f0b65d6ea5449ca79744ac52243ba2)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:24:58.267834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb27f6-62da-4c02-aeb1-db35502a0200 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:24:58.378745 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 624/1232] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:24:58 2022] PUT /identity/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/0a3704fdba154f13ad3bf8ac00c916c1/roles/c6f0b65d6ea5449ca79744ac52243ba2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:25:00.551573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4283e3-387c-4f9a-b32d-07051974ad40 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:00.553004 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4283e3-387c-4f9a-b32d-07051974ad40 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:00.553620 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4283e3-387c-4f9a-b32d-07051974ad40 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:00.555910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 609/1233] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:25:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:25:00.561731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e875a-4e6a-465a-bff1-ee9322f0dffe None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:00.562246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e875a-4e6a-465a-bff1-ee9322f0dffe None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:00.562380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e875a-4e6a-465a-bff1-ee9322f0dffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:00.581062 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-0f0e875a-4e6a-465a-bff1-ee9322f0dffe None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:00.582332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0f0e875a-4e6a-465a-bff1-ee9322f0dffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:00.660102 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 625/1234] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:25:00.684833 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4283e3-387c-4f9a-b32d-07051974ad40 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:00.714464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:00.812554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4283e3-387c-4f9a-b32d-07051974ad40 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:00.852847 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406b24b-3527-4cb0-ba25-4a4d0fb2c38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:00.853659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406b24b-3527-4cb0-ba25-4a4d0fb2c38a None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:00.854017 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406b24b-3527-4cb0-ba25-4a4d0fb2c38a None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:00.854329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406b24b-3527-4cb0-ba25-4a4d0fb2c38a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:00.866423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406b24b-3527-4cb0-ba25-4a4d0fb2c38a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:25:00.875257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-2406b24b-3527-4cb0-ba25-4a4d0fb2c38a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:25:00.875257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:00.875257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:00.875257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:00.875257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:00.875257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:00.875257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:00.875257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:00.875257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:00.875257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:00.875257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:00.875257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:00.875257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:25:00.875257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:25:00.875257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:25:00.875257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:25:00.878225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:25:00.878225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:25:00.878225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:25:00.878225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:25:00.878225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:00.878225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:00.878225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:00.878225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:00.878225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:00.878225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:00.878225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:00.878225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:00.878225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:00.878225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:00.878225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:00.878225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:00.880827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:00.880827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:00.880827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:00.880827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:00.880827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:25:00.880827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:25:00.880827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:25:00.880827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:25:00.880827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:25:00.880827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:25:00.880827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 14:25:00.880827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:25:00.882801 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 610/1235] 10.222.0.40 () {56 vars in 1102 bytes} [Tue Jul 12 14:25:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:25:00.884451 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e875a-4e6a-465a-bff1-ee9322f0dffe None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:00.967690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:01.028976 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e875a-4e6a-465a-bff1-ee9322f0dffe None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:01.068758 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d55127-f24c-44c1-b087-2626ffd27e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:01.069425 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d55127-f24c-44c1-b087-2626ffd27e83 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:01.069748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d55127-f24c-44c1-b087-2626ffd27e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:01.072057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d55127-f24c-44c1-b087-2626ffd27e83 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:01.072865 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d55127-f24c-44c1-b087-2626ffd27e83 None admin] RBAC: Adding query filter params (name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:01.073173 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d55127-f24c-44c1-b087-2626ffd27e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:01.076993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d55127-f24c-44c1-b087-2626ffd27e83 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:01.086753 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 626/1236] 10.222.0.40 () {56 vars in 1103 bytes} [Tue Jul 12 14:25:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:01.095742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406b24b-3527-4cb0-ba25-4a4d0fb2c38a None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:01.193047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:01.220608 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406b24b-3527-4cb0-ba25-4a4d0fb2c38a None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:01.281956 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734abffd-b058-41dc-8893-809c025a61ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:01.283166 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734abffd-b058-41dc-8893-809c025a61ba None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:01.283638 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734abffd-b058-41dc-8893-809c025a61ba None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:01.284081 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734abffd-b058-41dc-8893-809c025a61ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:01.299411 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734abffd-b058-41dc-8893-809c025a61ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:01.300971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734abffd-b058-41dc-8893-809c025a61ba None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:01.324287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-734abffd-b058-41dc-8893-809c025a61ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:25:01.324287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:01.324287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:01.324287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:01.324287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:01.324287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:01.324287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:01.324287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:01.324287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:01.324287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:01.324287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:01.324287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:01.324287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:25:01.324287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:25:01.324287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:25:01.325951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:25:01.325951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:01.325951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:01.325951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:01.325951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:01.325951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:01.325951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:01.325951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:01.325951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:01.325951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:01.325951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:01.325951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:01.325951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:01.325951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:01.325951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:01.325951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:01.325951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:01.327436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:25:01.327436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:25:01.327436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:25:01.327436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:25:01.327436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 611/1237] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:25:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:25:01.330123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d55127-f24c-44c1-b087-2626ffd27e83 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:01.467742 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d55127-f24c-44c1-b087-2626ffd27e83 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:01.479684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:01.509894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159adae2-bef2-448f-86aa-4d37ad5e0e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:01.510644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159adae2-bef2-448f-86aa-4d37ad5e0e2e None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:01.510968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159adae2-bef2-448f-86aa-4d37ad5e0e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:01.511302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159adae2-bef2-448f-86aa-4d37ad5e0e2e None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:01.512181 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159adae2-bef2-448f-86aa-4d37ad5e0e2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:01.512528 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159adae2-bef2-448f-86aa-4d37ad5e0e2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:01.513943 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159adae2-bef2-448f-86aa-4d37ad5e0e2e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:01.528100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 627/1238] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:01.534117 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734abffd-b058-41dc-8893-809c025a61ba None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:01.650738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734abffd-b058-41dc-8893-809c025a61ba None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:01.692348 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b041d6-2c45-40df-a443-968c9487f333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:01.694316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b041d6-2c45-40df-a443-968c9487f333 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:01.694818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b041d6-2c45-40df-a443-968c9487f333 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:01.695333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b041d6-2c45-40df-a443-968c9487f333 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:01.700320 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:01.706340 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b041d6-2c45-40df-a443-968c9487f333 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:01.707959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b041d6-2c45-40df-a443-968c9487f333 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:01.724134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-72b041d6-2c45-40df-a443-968c9487f333 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:25:01.724134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:01.724134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:01.724134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:01.724134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:01.724134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:01.724134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:01.724134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:01.724134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:01.724134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:01.724134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:01.724134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:01.724134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:25:01.724134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:25:01.724134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:25:01.724134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:25:01.725504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:01.725504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:01.725504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:25:01.725504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:25:01.725504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:25:01.725504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:25:01.725504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:01.725504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:01.725504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:01.725504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:01.725504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:01.725504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:01.725504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:01.725504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:01.725504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:01.725504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:01.725504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:01.725504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:01.726582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:01.726582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:01.726582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:25:01.726582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:25:01.726582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:25:01.726582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:25:01.726582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:25:01.726582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:25:01.726582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:25:01.726582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:25:01.726582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 612/1239] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:25:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:25:01.732089 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159adae2-bef2-448f-86aa-4d37ad5e0e2e None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:01.851563 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159adae2-bef2-448f-86aa-4d37ad5e0e2e None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:01.897264 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356a390-962f-4e98-a6e3-d114521eabfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:01.897962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356a390-962f-4e98-a6e3-d114521eabfa None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:01.898249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356a390-962f-4e98-a6e3-d114521eabfa None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:01.898532 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356a390-962f-4e98-a6e3-d114521eabfa None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:01.899425 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356a390-962f-4e98-a6e3-d114521eabfa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:01.899790 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356a390-962f-4e98-a6e3-d114521eabfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:01.901272 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356a390-962f-4e98-a6e3-d114521eabfa None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:01.922506 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 628/1240] 10.222.0.40 () {56 vars in 1143 bytes} [Tue Jul 12 14:25:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:25:01.928602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b041d6-2c45-40df-a443-968c9487f333 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:02.079494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b041d6-2c45-40df-a443-968c9487f333 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:02.117469 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbae90-82e2-4712-a434-a339493d21dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:02.118187 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbae90-82e2-4712-a434-a339493d21dd None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:02.118547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbae90-82e2-4712-a434-a339493d21dd None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:02.118869 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbae90-82e2-4712-a434-a339493d21dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:02.199550 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:02.212158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbae90-82e2-4712-a434-a339493d21dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:02.217185 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbae90-82e2-4712-a434-a339493d21dd None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:02.349743 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 613/1241] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:25:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 14:25:02.356710 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356a390-962f-4e98-a6e3-d114521eabfa None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:02.392648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:02.477879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356a390-962f-4e98-a6e3-d114521eabfa None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:02.519990 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae35750-c1a1-490b-bebb-4e307c072092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:02.521176 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae35750-c1a1-490b-bebb-4e307c072092 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:02.522050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae35750-c1a1-490b-bebb-4e307c072092 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:02.522050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae35750-c1a1-490b-bebb-4e307c072092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:02.533901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae35750-c1a1-490b-bebb-4e307c072092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:02.535406 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae35750-c1a1-490b-bebb-4e307c072092 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:02.555713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-cae35750-c1a1-490b-bebb-4e307c072092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:25:02.555713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:02.555713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:02.555713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:02.555713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:02.555713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:02.555713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:02.555713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:02.555713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:02.555713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:02.555713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:02.555713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:02.555713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:25:02.555713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:25:02.555713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:25:02.560836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:25:02.560836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:02.560836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:02.560836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:02.560836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:02.560836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:02.560836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:02.560836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:02.560836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:02.560836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:02.560836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:02.560836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:02.560836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:02.560836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:02.560836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:02.560836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:02.560836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:02.562784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:25:02.562784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:25:02.562784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:25:02.562784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:25:02.562784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 629/1242] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:25:02.565030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbae90-82e2-4712-a434-a339493d21dd None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:02.717709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:02.725292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbae90-82e2-4712-a434-a339493d21dd None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:02.763734 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c74c1-1263-4f24-aa32-4fd633d657be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:02.764346 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c74c1-1263-4f24-aa32-4fd633d657be None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:02.764653 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c74c1-1263-4f24-aa32-4fd633d657be None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:02.764935 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c74c1-1263-4f24-aa32-4fd633d657be None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:02.765676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c74c1-1263-4f24-aa32-4fd633d657be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:02.765990 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c74c1-1263-4f24-aa32-4fd633d657be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:02.767423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c74c1-1263-4f24-aa32-4fd633d657be None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:02.780397 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 614/1243] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:02.787225 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae35750-c1a1-490b-bebb-4e307c072092 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:02.884052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:02.908745 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae35750-c1a1-490b-bebb-4e307c072092 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:02.947659 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e49ac6-0502-488f-b13e-45ff884c53d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:02.948534 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e49ac6-0502-488f-b13e-45ff884c53d6 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:02.948805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e49ac6-0502-488f-b13e-45ff884c53d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:02.949135 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e49ac6-0502-488f-b13e-45ff884c53d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:02.956540 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e49ac6-0502-488f-b13e-45ff884c53d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:02.965948 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e49ac6-0502-488f-b13e-45ff884c53d6 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:02.973863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-73e49ac6-0502-488f-b13e-45ff884c53d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:25:02.973863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:02.973863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:02.973863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:02.973863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:02.973863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:02.973863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:02.973863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:02.973863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:02.973863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:02.973863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:02.973863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:02.973863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:25:02.973863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:25:02.973863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:25:02.976161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:25:02.976161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:02.976161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:02.976161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:02.976161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:02.976161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:02.976161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:02.976161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:02.976161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:02.976161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:02.976161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:02.976161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:02.976161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:02.976161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:02.976161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:02.976161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:02.976161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:02.978203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:25:02.978203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:25:02.978203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:25:02.978203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:25:02.978203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:25:02.978203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:25:02.978203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:25:02.978203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:25:02.978203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 630/1244] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:25:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:25:02.983099 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c74c1-1263-4f24-aa32-4fd633d657be None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:03.102933 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c74c1-1263-4f24-aa32-4fd633d657be None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:03.141173 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016867f-e20f-45c6-a509-00ca02049684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:03.141848 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016867f-e20f-45c6-a509-00ca02049684 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:03.142135 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016867f-e20f-45c6-a509-00ca02049684 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:03.142415 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016867f-e20f-45c6-a509-00ca02049684 None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:03.143223 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016867f-e20f-45c6-a509-00ca02049684 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:03.143571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016867f-e20f-45c6-a509-00ca02049684 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:03.145018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016867f-e20f-45c6-a509-00ca02049684 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:03.158899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 615/1245] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:25:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:25:03.166458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e49ac6-0502-488f-b13e-45ff884c53d6 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:03.301184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e49ac6-0502-488f-b13e-45ff884c53d6 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:03.341158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402682d-eff8-4867-b10a-579e4f0c262e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:03.341821 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402682d-eff8-4867-b10a-579e4f0c262e None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:03.342104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402682d-eff8-4867-b10a-579e4f0c262e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:03.342417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402682d-eff8-4867-b10a-579e4f0c262e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:03.343262 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402682d-eff8-4867-b10a-579e4f0c262e None admin] RBAC: Adding query filter params (role.id=c6f0b65d6ea5449ca79744ac52243ba2, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=0a3704fdba154f13ad3bf8ac00c916c1) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:03.343603 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402682d-eff8-4867-b10a-579e4f0c262e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:03.345034 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402682d-eff8-4867-b10a-579e4f0c262e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:03.351520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 631/1246] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:25:03 2022] GET /identity/v3/role_assignments?user.id=0a3704fdba154f13ad3bf8ac00c916c1&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=c6f0b65d6ea5449ca79744ac52243ba2 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:05.566356 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d301b-5516-4767-9018-65add33851a4 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:05.566984 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d301b-5516-4767-9018-65add33851a4 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:05.567087 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d301b-5516-4767-9018-65add33851a4 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:05.569423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 616/1247] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:25:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:25:05.575726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0b13c-9c6d-49c1-8927-198d40eabaf8 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:05.576490 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0b13c-9c6d-49c1-8927-198d40eabaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:05.576490 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0b13c-9c6d-49c1-8927-198d40eabaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:05.581623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:05.596492 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-5ee0b13c-9c6d-49c1-8927-198d40eabaf8 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:05.598554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-5ee0b13c-9c6d-49c1-8927-198d40eabaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:05.675433 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 632/1248] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:25:05.699687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d301b-5516-4767-9018-65add33851a4 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:05.720672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:05.838901 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d301b-5516-4767-9018-65add33851a4 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:05.901677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9007dd8-f9fa-420a-a4b4-d8c9a1a1b159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:05.902800 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9007dd8-f9fa-420a-a4b4-d8c9a1a1b159 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:05.903339 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9007dd8-f9fa-420a-a4b4-d8c9a1a1b159 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:05.903824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9007dd8-f9fa-420a-a4b4-d8c9a1a1b159 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:05.923452 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9007dd8-f9fa-420a-a4b4-d8c9a1a1b159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:25:05.931493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-e9007dd8-f9fa-420a-a4b4-d8c9a1a1b159 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:25:05.931493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:05.931493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:05.931493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:05.931493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:05.931493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:05.931493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:05.931493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:05.931493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:05.931493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:05.931493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:05.931493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:05.931493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:25:05.931493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:25:05.931493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:25:05.931493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:25:05.933236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:25:05.933236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:25:05.933236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:25:05.933236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:25:05.933236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:05.933236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:05.933236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:05.933236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:05.933236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:05.933236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:05.933236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:05.933236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:05.933236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:05.933236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:05.933236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:05.933236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:05.934885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:05.934885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:05.934885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:05.934885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:05.934885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:25:05.934885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:25:05.934885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:25:05.934885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:25:05.934885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:25:05.934885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:25:05.934885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:25:05.934885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:25:05.934885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 617/1249] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:25:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:25:05.946785 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0b13c-9c6d-49c1-8927-198d40eabaf8 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:06.066636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0b13c-9c6d-49c1-8927-198d40eabaf8 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:06.123444 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:06.131781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bef7b-0ff1-4c74-9436-c94ee824f5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:06.132492 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bef7b-0ff1-4c74-9436-c94ee824f5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:06.133756 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bef7b-0ff1-4c74-9436-c94ee824f5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:06.133756 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bef7b-0ff1-4c74-9436-c94ee824f5f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:06.133987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bef7b-0ff1-4c74-9436-c94ee824f5f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:06.134154 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bef7b-0ff1-4c74-9436-c94ee824f5f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:06.135606 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bef7b-0ff1-4c74-9436-c94ee824f5f9 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:06.145233 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 633/1250] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:25:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:06.152497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9007dd8-f9fa-420a-a4b4-d8c9a1a1b159 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:06.246980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:06.276461 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9007dd8-f9fa-420a-a4b4-d8c9a1a1b159 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:06.320821 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16306611-0e9c-477d-9d62-b014c5b4e9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:06.321819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16306611-0e9c-477d-9d62-b014c5b4e9ce None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:06.322217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16306611-0e9c-477d-9d62-b014c5b4e9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:06.322406 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16306611-0e9c-477d-9d62-b014c5b4e9ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:06.336746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16306611-0e9c-477d-9d62-b014c5b4e9ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:06.338285 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16306611-0e9c-477d-9d62-b014c5b4e9ce None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:06.361120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-16306611-0e9c-477d-9d62-b014c5b4e9ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:25:06.361120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:06.361120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:06.361120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:06.361120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:06.361120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:06.361120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:06.361120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:06.361120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:06.361120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:06.361120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:06.361120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:06.361120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:25:06.361120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:25:06.361120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:25:06.362891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:25:06.362891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:06.362891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:06.362891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:06.362891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:06.362891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:06.362891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:06.362891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:06.362891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:06.362891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:06.362891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:06.362891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:06.362891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:06.362891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:06.362891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:06.362891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:06.362891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:06.364114 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:25:06.364114 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:25:06.364114 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:25:06.364114 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:25:06.364114 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 618/1251] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:25:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:25:06.369821 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bef7b-0ff1-4c74-9436-c94ee824f5f9 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:06.502310 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bef7b-0ff1-4c74-9436-c94ee824f5f9 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:06.562016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0af78-47fd-4438-a7ec-bf3751dbd78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:06.563189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0af78-47fd-4438-a7ec-bf3751dbd78c None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:06.563808 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0af78-47fd-4438-a7ec-bf3751dbd78c None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:06.564307 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0af78-47fd-4438-a7ec-bf3751dbd78c None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:06.565655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d0af78-47fd-4438-a7ec-bf3751dbd78c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:06.566220 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d0af78-47fd-4438-a7ec-bf3751dbd78c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:06.569466 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d0af78-47fd-4438-a7ec-bf3751dbd78c None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:06.593042 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 634/1252] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:25:06.599683 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16306611-0e9c-477d-9d62-b014c5b4e9ce None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:06.732191 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16306611-0e9c-477d-9d62-b014c5b4e9ce None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:06.767640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:06.779766 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851bec8-0476-4561-aee9-edf80d1a9982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:06.780814 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851bec8-0476-4561-aee9-edf80d1a9982 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:06.781174 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851bec8-0476-4561-aee9-edf80d1a9982 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:06.781549 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851bec8-0476-4561-aee9-edf80d1a9982 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:06.791862 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851bec8-0476-4561-aee9-edf80d1a9982 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:06.793238 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851bec8-0476-4561-aee9-edf80d1a9982 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:06.811015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-1851bec8-0476-4561-aee9-edf80d1a9982 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:25:06.811015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:06.811015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:06.811015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:06.811015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:06.811015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:06.811015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:06.811015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:06.811015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:06.811015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:06.811015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:06.811015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:06.811015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:25:06.811015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:25:06.811015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:25:06.811015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:25:06.812900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:06.812900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:06.812900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:25:06.812900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:25:06.812900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:25:06.812900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:25:06.812900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:06.812900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:06.812900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:06.812900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:06.812900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:06.812900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:06.812900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:06.812900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:06.812900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:06.812900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:06.812900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:06.812900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:06.814649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:06.814649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:06.814649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:25:06.814649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:25:06.814649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:25:06.814649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:25:06.814649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:25:06.814649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:25:06.814649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:25:06.814649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:25:06.814649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 619/1253] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:25:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:25:06.819232 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0af78-47fd-4438-a7ec-bf3751dbd78c None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:06.891367 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:06.966266 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0af78-47fd-4438-a7ec-bf3751dbd78c None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:07.021988 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece08161-25a7-4398-a83f-25f74bba8dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:07.022595 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece08161-25a7-4398-a83f-25f74bba8dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:07.022879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece08161-25a7-4398-a83f-25f74bba8dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:07.023157 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece08161-25a7-4398-a83f-25f74bba8dd6 None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:07.024046 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece08161-25a7-4398-a83f-25f74bba8dd6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:07.024365 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece08161-25a7-4398-a83f-25f74bba8dd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:07.025815 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece08161-25a7-4398-a83f-25f74bba8dd6 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:07.046146 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 635/1254] 10.222.0.40 () {56 vars in 1143 bytes} [Tue Jul 12 14:25:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:25:07.052857 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851bec8-0476-4561-aee9-edf80d1a9982 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:07.166859 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851bec8-0476-4561-aee9-edf80d1a9982 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:07.208954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fb80b-8bd6-4c22-b1cf-5a73a77c08e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:07.209738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fb80b-8bd6-4c22-b1cf-5a73a77c08e3 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:07.210074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fb80b-8bd6-4c22-b1cf-5a73a77c08e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:07.210415 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fb80b-8bd6-4c22-b1cf-5a73a77c08e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:07.279468 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:07.293206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fb80b-8bd6-4c22-b1cf-5a73a77c08e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:07.294679 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fb80b-8bd6-4c22-b1cf-5a73a77c08e3 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:07.404064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 620/1255] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:25:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 14:25:07.413066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece08161-25a7-4398-a83f-25f74bba8dd6 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:07.573791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece08161-25a7-4398-a83f-25f74bba8dd6 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:07.589538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:07.612332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab1a78-1c91-48db-82d4-5161bcb36593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:07.613200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab1a78-1c91-48db-82d4-5161bcb36593 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:07.613521 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab1a78-1c91-48db-82d4-5161bcb36593 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:07.613859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab1a78-1c91-48db-82d4-5161bcb36593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:07.626368 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab1a78-1c91-48db-82d4-5161bcb36593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:07.627889 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab1a78-1c91-48db-82d4-5161bcb36593 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:07.650247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-dfab1a78-1c91-48db-82d4-5161bcb36593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:25:07.650247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:07.650247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:07.650247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:07.650247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:07.650247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:07.650247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:07.650247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:07.650247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:07.650247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:07.650247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:07.650247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:07.650247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:25:07.650247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:25:07.650247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:25:07.651971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:25:07.651971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:07.651971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:07.651971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:07.651971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:07.651971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:07.651971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:07.651971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:07.651971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:07.651971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:07.651971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:07.651971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:07.651971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:07.651971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:07.651971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:07.651971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:07.651971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:07.653748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:25:07.653748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:25:07.653748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:25:07.653748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:25:07.653748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 636/1256] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:25:07.658715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fb80b-8bd6-4c22-b1cf-5a73a77c08e3 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:07.757715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:07.771524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fb80b-8bd6-4c22-b1cf-5a73a77c08e3 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:07.808309 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7a1ac-2d4c-4d71-8eba-b446b4bb7c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:07.809108 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7a1ac-2d4c-4d71-8eba-b446b4bb7c2f None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:07.809537 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7a1ac-2d4c-4d71-8eba-b446b4bb7c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:07.809960 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7a1ac-2d4c-4d71-8eba-b446b4bb7c2f None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:07.810836 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7a1ac-2d4c-4d71-8eba-b446b4bb7c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:07.811247 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7a1ac-2d4c-4d71-8eba-b446b4bb7c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:07.812804 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7a1ac-2d4c-4d71-8eba-b446b4bb7c2f None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:07.834633 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 621/1257] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:07.834871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab1a78-1c91-48db-82d4-5161bcb36593 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:07.941878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab1a78-1c91-48db-82d4-5161bcb36593 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:07.979249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95441d-a959-48fd-b92d-0ed00d62f374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:07.980067 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95441d-a959-48fd-b92d-0ed00d62f374 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:07.980351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95441d-a959-48fd-b92d-0ed00d62f374 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:07.980628 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95441d-a959-48fd-b92d-0ed00d62f374 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:07.988352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95441d-a959-48fd-b92d-0ed00d62f374 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:07.989837 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95441d-a959-48fd-b92d-0ed00d62f374 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:08.006021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-7b95441d-a959-48fd-b92d-0ed00d62f374 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:25:08.006021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:08.006021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:08.006021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:08.006021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:08.006021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:08.006021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:08.006021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:08.006021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:08.006021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:08.006021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:08.006021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:08.006021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:25:08.006021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:25:08.006021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:25:08.008199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:25:08.008199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:08.008199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:08.008199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:08.008199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:08.008199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:08.008199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:08.008199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:08.008199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:08.008199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:08.008199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:08.008199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:08.008199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:08.008199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:08.008199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:08.008199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:08.008199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:08.010352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:25:08.010352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:25:08.010352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:25:08.010352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:25:08.010352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:25:08.010352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:25:08.010352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:25:08.010352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:25:08.010352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 637/1258] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:25:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:25:08.013721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7a1ac-2d4c-4d71-8eba-b446b4bb7c2f None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:08.136978 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7a1ac-2d4c-4d71-8eba-b446b4bb7c2f None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:08.177624 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80271e-8b7f-4185-9776-7a6cdc43e8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:08.178311 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80271e-8b7f-4185-9776-7a6cdc43e8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:08.178599 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80271e-8b7f-4185-9776-7a6cdc43e8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:08.178876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80271e-8b7f-4185-9776-7a6cdc43e8c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:08.179733 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80271e-8b7f-4185-9776-7a6cdc43e8c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:08.180048 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80271e-8b7f-4185-9776-7a6cdc43e8c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:08.181543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80271e-8b7f-4185-9776-7a6cdc43e8c4 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:08.197859 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 622/1259] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:25:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:08.205071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95441d-a959-48fd-b92d-0ed00d62f374 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:08.245289 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:08.329013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95441d-a959-48fd-b92d-0ed00d62f374 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:08.369029 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e44ca-46fa-4fda-a8b5-34088ea8fe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:08.369773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e44ca-46fa-4fda-a8b5-34088ea8fe93 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:08.370107 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e44ca-46fa-4fda-a8b5-34088ea8fe93 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:08.370686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e44ca-46fa-4fda-a8b5-34088ea8fe93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:08.371676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e44ca-46fa-4fda-a8b5-34088ea8fe93 None admin] RBAC: Adding query filter params (role.id=ae530119fc5c42358179521ce865b5d7, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=0a3704fdba154f13ad3bf8ac00c916c1) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:08.372044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e44ca-46fa-4fda-a8b5-34088ea8fe93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:08.373554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e44ca-46fa-4fda-a8b5-34088ea8fe93 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:08.381718 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 638/1260] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:25:08 2022] GET /identity/v3/role_assignments?user.id=0a3704fdba154f13ad3bf8ac00c916c1&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=ae530119fc5c42358179521ce865b5d7 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:10.584619 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540014f-334f-4d01-84d9-597aeee40fc4 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:10.585171 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540014f-334f-4d01-84d9-597aeee40fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:10.585171 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540014f-334f-4d01-84d9-597aeee40fc4 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:10.586559 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 623/1261] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:10.592493 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d0c2a-0822-4d72-8022-48983a1c758d None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:10.593145 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d0c2a-0822-4d72-8022-48983a1c758d None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:10.593145 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d0c2a-0822-4d72-8022-48983a1c758d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:10.611875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-4a7d0c2a-0822-4d72-8022-48983a1c758d None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:10.613097 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-4a7d0c2a-0822-4d72-8022-48983a1c758d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:10.719183 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 639/1262] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:25:10.742708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540014f-334f-4d01-84d9-597aeee40fc4 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:10.756314 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:10.865275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540014f-334f-4d01-84d9-597aeee40fc4 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:10.903403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68f2ce-fa14-4269-a526-72ece5837fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:10.904304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68f2ce-fa14-4269-a526-72ece5837fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:10.904647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68f2ce-fa14-4269-a526-72ece5837fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:10.904965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68f2ce-fa14-4269-a526-72ece5837fe1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:10.917415 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68f2ce-fa14-4269-a526-72ece5837fe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:25:10.925742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-7f68f2ce-fa14-4269-a526-72ece5837fe1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:25:10.925742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:10.925742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:10.925742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:10.925742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:10.925742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:10.925742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:10.925742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:10.925742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:10.925742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:10.925742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:10.925742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:10.925742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:25:10.925742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:25:10.925742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:25:10.925742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:25:10.930827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:25:10.930827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:25:10.930827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:25:10.930827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:25:10.930827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:10.930827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:10.930827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:10.930827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:10.930827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:10.930827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:10.930827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:10.930827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:10.930827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:10.930827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:10.930827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:10.930827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:10.932462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:10.932462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:10.932462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:10.932462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:10.932462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:25:10.932462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:25:10.932462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:25:10.932462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:25:10.932462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:25:10.932462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:25:10.932462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:25:10.932462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:25:10.932462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 624/1263] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:25:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:25:10.934710 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d0c2a-0822-4d72-8022-48983a1c758d None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:10.954503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:11.052686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d0c2a-0822-4d72-8022-48983a1c758d None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:11.093129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cae08e-1201-49b9-a899-482b4229fea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:11.093787 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cae08e-1201-49b9-a899-482b4229fea7 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:11.094075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cae08e-1201-49b9-a899-482b4229fea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:11.094363 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cae08e-1201-49b9-a899-482b4229fea7 None admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:11.095182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cae08e-1201-49b9-a899-482b4229fea7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:11.095525 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cae08e-1201-49b9-a899-482b4229fea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:11.096941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cae08e-1201-49b9-a899-482b4229fea7 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:11.106917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 640/1264] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:25:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:11.113460 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68f2ce-fa14-4269-a526-72ece5837fe1 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:11.189529 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:11.229765 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68f2ce-fa14-4269-a526-72ece5837fe1 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:11.275756 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dfd3b-80bb-45d3-b2ec-ba20e04bf073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:11.276640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dfd3b-80bb-45d3-b2ec-ba20e04bf073 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:11.276973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dfd3b-80bb-45d3-b2ec-ba20e04bf073 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:11.277303 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dfd3b-80bb-45d3-b2ec-ba20e04bf073 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:11.293782 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165dfd3b-80bb-45d3-b2ec-ba20e04bf073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:11.295309 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165dfd3b-80bb-45d3-b2ec-ba20e04bf073 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:11.315647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-165dfd3b-80bb-45d3-b2ec-ba20e04bf073 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:25:11.315647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:11.315647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:11.315647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:11.315647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:11.315647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:11.315647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:11.315647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:11.315647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:11.315647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:11.315647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:11.315647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:11.315647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:25:11.315647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:25:11.315647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:25:11.317595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:25:11.317595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:11.317595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:11.317595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:11.317595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:11.317595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:11.317595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:11.317595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:11.317595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:11.317595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:11.317595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:11.317595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:11.317595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:11.317595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:11.317595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:11.317595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:11.317595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:11.320335 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:25:11.320335 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:25:11.320335 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:25:11.320335 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:25:11.320335 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 625/1265] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:25:11.324874 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cae08e-1201-49b9-a899-482b4229fea7 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:11.424738 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:11.446718 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cae08e-1201-49b9-a899-482b4229fea7 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:11.481152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfc00e-be51-471c-84ae-d4b1a9947b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:11.482917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfc00e-be51-471c-84ae-d4b1a9947b65 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:11.482917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfc00e-be51-471c-84ae-d4b1a9947b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:11.482917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfc00e-be51-471c-84ae-d4b1a9947b65 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:11.483325 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfc00e-be51-471c-84ae-d4b1a9947b65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:11.483448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfc00e-be51-471c-84ae-d4b1a9947b65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:11.484748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfc00e-be51-471c-84ae-d4b1a9947b65 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:11.503395 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 641/1266] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:11.510919 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dfd3b-80bb-45d3-b2ec-ba20e04bf073 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:11.637381 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dfd3b-80bb-45d3-b2ec-ba20e04bf073 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:11.678091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:11.701509 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c3fbc-9f2a-4a7c-a543-81a019320179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:11.702327 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c3fbc-9f2a-4a7c-a543-81a019320179 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:11.702608 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c3fbc-9f2a-4a7c-a543-81a019320179 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:11.702973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c3fbc-9f2a-4a7c-a543-81a019320179 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:11.713919 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c3fbc-9f2a-4a7c-a543-81a019320179 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:11.715532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c3fbc-9f2a-4a7c-a543-81a019320179 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:11.731595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-b31c3fbc-9f2a-4a7c-a543-81a019320179 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:25:11.731595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:11.731595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:11.731595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:11.731595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:11.731595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:11.731595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:11.731595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:11.731595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:11.731595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:11.731595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:11.731595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:11.731595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:25:11.731595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:25:11.731595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:25:11.731595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:25:11.732964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:11.732964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:11.732964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:25:11.732964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:25:11.732964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:25:11.732964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:25:11.732964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:11.732964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:11.732964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:11.732964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:11.732964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:11.732964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:11.732964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:11.732964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:11.732964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:11.732964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:11.732964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:11.732964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:11.734585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:11.734585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:11.734585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:25:11.734585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:25:11.734585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:25:11.734585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:25:11.734585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:25:11.734585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:25:11.734585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:25:11.734585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:25:11.734585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 626/1267] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:25:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:25:11.739317 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfc00e-be51-471c-84ae-d4b1a9947b65 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:11.855343 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfc00e-be51-471c-84ae-d4b1a9947b65 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:11.899111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee32263-4872-42f5-90fc-65a4fb8e583e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:11.899829 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee32263-4872-42f5-90fc-65a4fb8e583e None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:11.900115 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee32263-4872-42f5-90fc-65a4fb8e583e None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:11.900398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee32263-4872-42f5-90fc-65a4fb8e583e None admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:11.901393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee32263-4872-42f5-90fc-65a4fb8e583e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:11.901712 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee32263-4872-42f5-90fc-65a4fb8e583e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:11.903234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee32263-4872-42f5-90fc-65a4fb8e583e None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:11.914274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:11.926325 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 642/1268] 10.222.0.40 () {56 vars in 1143 bytes} [Tue Jul 12 14:25:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:25:11.932536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c3fbc-9f2a-4a7c-a543-81a019320179 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:12.049251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c3fbc-9f2a-4a7c-a543-81a019320179 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:12.088038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692bc92-6f3b-40b1-a06a-85ff1248e140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:12.088897 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692bc92-6f3b-40b1-a06a-85ff1248e140 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:12.089181 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692bc92-6f3b-40b1-a06a-85ff1248e140 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:12.089480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692bc92-6f3b-40b1-a06a-85ff1248e140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:12.101604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692bc92-6f3b-40b1-a06a-85ff1248e140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:12.103060 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692bc92-6f3b-40b1-a06a-85ff1248e140 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:12.131471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-7692bc92-6f3b-40b1-a06a-85ff1248e140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:25:12.131471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:12.131471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:12.131471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:12.131471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:12.131471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:12.131471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:12.131471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:12.131471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:12.131471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:12.131471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:12.131471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:12.131471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:25:12.131471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:25:12.131471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:25:12.132668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:25:12.132668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:12.132668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:12.132668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:12.132668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:12.132668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:12.132668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:12.132668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:12.132668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:12.132668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:12.132668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:12.132668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:12.132668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:12.132668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:12.132668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:12.132668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:12.132668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:12.133578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:25:12.133578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:25:12.133578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:25:12.133578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:25:12.135397 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 627/1269] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:25:12.140637 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee32263-4872-42f5-90fc-65a4fb8e583e None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:12.272557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee32263-4872-42f5-90fc-65a4fb8e583e None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:12.314847 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b5b4f-1bfb-40bf-bd6a-222d1aae0e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:12.315649 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5b4f-1bfb-40bf-bd6a-222d1aae0e55 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:12.316018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5b4f-1bfb-40bf-bd6a-222d1aae0e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:12.316346 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5b4f-1bfb-40bf-bd6a-222d1aae0e55 None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:12.317920 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b5b4f-1bfb-40bf-bd6a-222d1aae0e55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:12.318212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b5b4f-1bfb-40bf-bd6a-222d1aae0e55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:12.319605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b5b4f-1bfb-40bf-bd6a-222d1aae0e55 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:12.332776 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 643/1270] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:12.339579 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692bc92-6f3b-40b1-a06a-85ff1248e140 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:12.376995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:12.456502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692bc92-6f3b-40b1-a06a-85ff1248e140 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:12.494769 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b479b-6a2d-4d6d-86d4-9a4d8fb2a7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:12.495968 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b479b-6a2d-4d6d-86d4-9a4d8fb2a7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:12.496250 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b479b-6a2d-4d6d-86d4-9a4d8fb2a7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:12.496526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b479b-6a2d-4d6d-86d4-9a4d8fb2a7a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:12.505620 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b479b-6a2d-4d6d-86d4-9a4d8fb2a7a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:12.507145 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b479b-6a2d-4d6d-86d4-9a4d8fb2a7a7 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:12.523333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-847b479b-6a2d-4d6d-86d4-9a4d8fb2a7a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:25:12.523333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:12.523333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:12.523333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:12.523333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:12.523333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:12.523333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:12.523333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:12.523333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:12.523333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:12.523333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:12.523333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:12.523333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:25:12.523333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:25:12.523333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:25:12.531354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:25:12.531354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:12.531354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:12.531354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:12.531354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:12.531354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:12.531354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:12.531354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:12.531354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:12.531354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:12.531354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:12.531354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:12.531354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:12.531354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:12.531354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:12.531354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:12.531354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:12.532269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:25:12.532269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:25:12.532269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:25:12.532269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:25:12.532269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:25:12.532269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:25:12.532269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:25:12.532269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:25:12.532269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 628/1271] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:25:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:25:12.534409 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b5b4f-1bfb-40bf-bd6a-222d1aae0e55 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:12.600967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:12.647308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b5b4f-1bfb-40bf-bd6a-222d1aae0e55 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:12.693507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc0109-8364-4610-aef8-873b0dc28bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:12.694251 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc0109-8364-4610-aef8-873b0dc28bfd None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:12.694596 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc0109-8364-4610-aef8-873b0dc28bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:12.694913 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc0109-8364-4610-aef8-873b0dc28bfd None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:12.695878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc0109-8364-4610-aef8-873b0dc28bfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:12.697069 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc0109-8364-4610-aef8-873b0dc28bfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:12.699061 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc0109-8364-4610-aef8-873b0dc28bfd None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:12.714265 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 644/1272] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:25:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:12.720519 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b479b-6a2d-4d6d-86d4-9a4d8fb2a7a7 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:12.822225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:12.832104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b479b-6a2d-4d6d-86d4-9a4d8fb2a7a7 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:12.873747 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2054553-d675-40fc-b08f-3ccd798260c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:12.874557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2054553-d675-40fc-b08f-3ccd798260c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:12.874840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2054553-d675-40fc-b08f-3ccd798260c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:12.875115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2054553-d675-40fc-b08f-3ccd798260c0 None admin] PATH_INFO: `/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/0a3704fdba154f13ad3bf8ac00c916c1/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:12.877423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2054553-d675-40fc-b08f-3ccd798260c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=00424b6950d14cd4854e4add3e3d7705, user_id=0a3704fdba154f13ad3bf8ac00c916c1, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:12.878875 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2054553-d675-40fc-b08f-3ccd798260c0 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:13.011666 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 629/1273] 10.222.0.40 () {58 vars in 1439 bytes} [Tue Jul 12 14:25:12 2022] PUT /identity/v3/projects/00424b6950d14cd4854e4add3e3d7705/users/0a3704fdba154f13ad3bf8ac00c916c1/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:25:15.131690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564ec34-9864-4908-bab1-a7662fb923a8 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:15.132296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564ec34-9864-4908-bab1-a7662fb923a8 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:15.132296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564ec34-9864-4908-bab1-a7662fb923a8 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:15.133611 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 645/1274] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:15.140163 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61111807-3319-4b4f-8987-30f98fc3f360 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:15.145804 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61111807-3319-4b4f-8987-30f98fc3f360 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:15.145804 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61111807-3319-4b4f-8987-30f98fc3f360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:15.159165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-61111807-3319-4b4f-8987-30f98fc3f360 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:15.160433 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-61111807-3319-4b4f-8987-30f98fc3f360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:15.240841 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 630/1275] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 14:25:15.264684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564ec34-9864-4908-bab1-a7662fb923a8 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:15.376411 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564ec34-9864-4908-bab1-a7662fb923a8 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:15.396965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:15.414776 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38b60e-a71a-48cf-b108-1da6b5538eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:15.415749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38b60e-a71a-48cf-b108-1da6b5538eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:15.416171 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38b60e-a71a-48cf-b108-1da6b5538eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:15.416554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38b60e-a71a-48cf-b108-1da6b5538eb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:15.428775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38b60e-a71a-48cf-b108-1da6b5538eb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 14:25:15.436695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-1e38b60e-a71a-48cf-b108-1da6b5538eb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:25:15.436695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:15.436695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:15.436695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:15.436695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:15.436695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:15.436695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:15.436695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:15.436695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:15.436695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:15.436695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:15.436695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:15.436695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 14:25:15.436695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 14:25:15.436695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 14:25:15.436695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 14:25:15.443261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 14:25:15.443261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 14:25:15.443261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 14:25:15.443261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 14:25:15.443261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:15.443261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:15.443261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:15.443261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:15.443261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:15.443261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:15.443261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:15.443261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:15.443261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:15.443261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:15.443261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:15.443261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:15.444304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:15.444304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:15.444304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:15.444304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:15.444304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 14:25:15.444304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 14:25:15.444304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 14:25:15.444304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 14:25:15.444304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 14:25:15.444304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 14:25:15.444304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 14:25:15.444304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:25:15.444304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 646/1276] 10.222.0.40 () {56 vars in 1096 bytes} [Tue Jul 12 14:25:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:25:15.448641 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61111807-3319-4b4f-8987-30f98fc3f360 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:15.542623 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:15.561878 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61111807-3319-4b4f-8987-30f98fc3f360 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:15.600718 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5793f5-760c-450b-8106-c82066fa8604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:15.601488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5793f5-760c-450b-8106-c82066fa8604 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:15.601775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5793f5-760c-450b-8106-c82066fa8604 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:15.602052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5793f5-760c-450b-8106-c82066fa8604 None admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:15.602826 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5793f5-760c-450b-8106-c82066fa8604 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:15.603111 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5793f5-760c-450b-8106-c82066fa8604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:15.604560 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5793f5-760c-450b-8106-c82066fa8604 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:15.613784 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 631/1277] 10.222.0.40 () {56 vars in 1099 bytes} [Tue Jul 12 14:25:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:15.620216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38b60e-a71a-48cf-b108-1da6b5538eb9 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:15.746418 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38b60e-a71a-48cf-b108-1da6b5538eb9 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:15.789556 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380d998-f400-40e0-8752-50445fc11dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:15.790389 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380d998-f400-40e0-8752-50445fc11dcb None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:15.790671 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380d998-f400-40e0-8752-50445fc11dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:15.790946 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380d998-f400-40e0-8752-50445fc11dcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:15.806269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380d998-f400-40e0-8752-50445fc11dcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:15.808975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380d998-f400-40e0-8752-50445fc11dcb None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:15.831642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-5380d998-f400-40e0-8752-50445fc11dcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:25:15.831642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:15.831642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:15.831642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:15.831642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:15.831642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:15.831642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:15.831642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:15.831642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:15.831642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:15.831642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:15.831642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:15.831642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:25:15.831642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:25:15.831642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:25:15.833327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:25:15.833327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:15.833327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:15.833327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:15.833327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:15.833327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:15.833327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:15.833327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:15.833327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:15.833327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:15.833327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:15.833327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:15.833327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:15.833327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:15.833327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:15.833327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:15.833327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:15.835482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:25:15.835482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:25:15.835482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:25:15.835482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:25:15.835482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 647/1278] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:25:15.839842 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5793f5-760c-450b-8106-c82066fa8604 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:16.019638 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5793f5-760c-450b-8106-c82066fa8604 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:16.080900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af688666-97b7-4373-a784-0bb65c588f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:16.081946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af688666-97b7-4373-a784-0bb65c588f38 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:16.083249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af688666-97b7-4373-a784-0bb65c588f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:16.083778 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af688666-97b7-4373-a784-0bb65c588f38 None admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:16.085053 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af688666-97b7-4373-a784-0bb65c588f38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:16.085536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af688666-97b7-4373-a784-0bb65c588f38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:16.087841 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af688666-97b7-4373-a784-0bb65c588f38 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:16.110698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 632/1279] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:16.117665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380d998-f400-40e0-8752-50445fc11dcb None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:16.155293 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:16.242804 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380d998-f400-40e0-8752-50445fc11dcb None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:16.290827 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf665a-1eb9-4f4e-8d8c-714827eb6d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:16.291665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf665a-1eb9-4f4e-8d8c-714827eb6d5d None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:16.291998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf665a-1eb9-4f4e-8d8c-714827eb6d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:16.292322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf665a-1eb9-4f4e-8d8c-714827eb6d5d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:16.301774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf665a-1eb9-4f4e-8d8c-714827eb6d5d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:16.303375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf665a-1eb9-4f4e-8d8c-714827eb6d5d None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:16.320375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-becf665a-1eb9-4f4e-8d8c-714827eb6d5d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:25:16.320375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:16.320375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:16.320375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:16.320375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:16.320375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:16.320375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:16.320375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:16.320375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:16.320375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:16.320375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:16.320375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:16.320375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 14:25:16.320375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 14:25:16.320375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 14:25:16.320375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 14:25:16.322009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:16.322009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:16.322009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 14:25:16.322009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:25:16.322009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 14:25:16.322009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 14:25:16.322009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:16.322009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:16.322009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:16.322009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:16.322009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:16.322009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:16.322009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:16.322009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:16.322009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:16.322009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:16.322009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:16.322009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:16.323842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:16.323842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:16.323842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 14:25:16.323842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 14:25:16.323842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 14:25:16.323842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 14:25:16.323842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 14:25:16.323842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 14:25:16.323842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 14:25:16.323842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:25:16.323842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 648/1280] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:25:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:25:16.327921 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af688666-97b7-4373-a784-0bb65c588f38 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:16.332415 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:16.448235 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af688666-97b7-4373-a784-0bb65c588f38 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:16.509247 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dce30-df62-4029-bd18-53c7c1879e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:16.509976 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dce30-df62-4029-bd18-53c7c1879e57 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:16.510284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dce30-df62-4029-bd18-53c7c1879e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:16.510564 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dce30-df62-4029-bd18-53c7c1879e57 None admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:16.512120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dce30-df62-4029-bd18-53c7c1879e57 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:16.512614 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dce30-df62-4029-bd18-53c7c1879e57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:16.515218 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dce30-df62-4029-bd18-53c7c1879e57 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:16.540743 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 633/1281] 10.222.0.40 () {56 vars in 1143 bytes} [Tue Jul 12 14:25:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:16.548145 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf665a-1eb9-4f4e-8d8c-714827eb6d5d None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:16.713127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:16.725745 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf665a-1eb9-4f4e-8d8c-714827eb6d5d None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:16.768772 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff1848-a9e6-4be9-bd3e-0bdc5c126fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:16.769538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff1848-a9e6-4be9-bd3e-0bdc5c126fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:16.769886 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff1848-a9e6-4be9-bd3e-0bdc5c126fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:16.770232 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff1848-a9e6-4be9-bd3e-0bdc5c126fb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:16.851559 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff1848-a9e6-4be9-bd3e-0bdc5c126fb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:16.852810 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff1848-a9e6-4be9-bd3e-0bdc5c126fb5 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:16.973923 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:16.986261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 649/1282] 10.222.0.40 () {58 vars in 1282 bytes} [Tue Jul 12 14:25:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 14:25:16.993978 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dce30-df62-4029-bd18-53c7c1879e57 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:17.068015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:17.137424 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dce30-df62-4029-bd18-53c7c1879e57 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:17.176293 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b33951-a79b-40b5-95be-c3fb2b1bcefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:17.177105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b33951-a79b-40b5-95be-c3fb2b1bcefb None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:17.177391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b33951-a79b-40b5-95be-c3fb2b1bcefb None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:17.177672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b33951-a79b-40b5-95be-c3fb2b1bcefb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:17.189177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b33951-a79b-40b5-95be-c3fb2b1bcefb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:17.190678 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b33951-a79b-40b5-95be-c3fb2b1bcefb None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:17.211570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-b1b33951-a79b-40b5-95be-c3fb2b1bcefb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:25:17.211570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:17.211570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:17.211570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:17.211570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:17.211570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:17.211570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:17.211570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:17.211570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:17.211570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:17.211570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:17.211570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:17.211570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 14:25:17.211570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 14:25:17.211570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 14:25:17.213226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 14:25:17.213226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:17.213226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:17.213226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:17.213226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:17.213226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:17.213226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:17.213226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:17.213226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:17.213226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:17.213226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:17.213226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:17.213226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:17.213226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:17.213226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:17.213226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:17.213226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:17.214778 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 14:25:17.214778 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 14:25:17.214778 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 14:25:17.214778 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:25:17.214778 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 634/1283] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:25:17.219055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff1848-a9e6-4be9-bd3e-0bdc5c126fb5 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:17.354585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff1848-a9e6-4be9-bd3e-0bdc5c126fb5 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:17.415928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b9c02-34f1-41b0-bab2-aeb751d8163d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:17.416981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b9c02-34f1-41b0-bab2-aeb751d8163d None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:17.417478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b9c02-34f1-41b0-bab2-aeb751d8163d None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:17.417961 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b9c02-34f1-41b0-bab2-aeb751d8163d None admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:17.419318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b9c02-34f1-41b0-bab2-aeb751d8163d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:17.419861 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b9c02-34f1-41b0-bab2-aeb751d8163d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:17.422378 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b9c02-34f1-41b0-bab2-aeb751d8163d None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:17.444573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 650/1284] 10.222.0.40 () {56 vars in 1109 bytes} [Tue Jul 12 14:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:25:17.451301 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b33951-a79b-40b5-95be-c3fb2b1bcefb None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:17.580414 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b33951-a79b-40b5-95be-c3fb2b1bcefb None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:17.597366 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:17.620790 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e9ceb-805c-41ca-ad1b-f61fc8691c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:17.621634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e9ceb-805c-41ca-ad1b-f61fc8691c53 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:17.621922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e9ceb-805c-41ca-ad1b-f61fc8691c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:17.622207 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e9ceb-805c-41ca-ad1b-f61fc8691c53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:17.630532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e9ceb-805c-41ca-ad1b-f61fc8691c53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:17.632155 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e9ceb-805c-41ca-ad1b-f61fc8691c53 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:17.647536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application [None req-819e9ceb-805c-41ca-ad1b-f61fc8691c53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:25:17.647536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:17.647536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:17.647536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:17.647536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:17.647536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:17.647536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:17.647536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:17.647536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:17.647536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:17.647536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:17.647536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:17.647536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 14:25:17.647536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 14:25:17.647536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 14:25:17.649334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 14:25:17.649334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:17.649334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:17.649334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:17.649334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:17.649334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:17.649334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:17.649334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:17.649334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:17.649334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:17.649334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:17.649334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:17.649334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:17.649334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:17.649334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:17.649334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:17.649334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:17.650682 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 14:25:17.650682 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 14:25:17.650682 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 14:25:17.650682 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 14:25:17.650682 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 14:25:17.650682 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 14:25:17.650682 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 14:25:17.650682 dv-cinder-820027-12-smb devstack@keystone.service[80634]: ERROR keystone.server.flask.application Jul 12 14:25:17.650682 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 635/1285] 10.222.0.40 () {56 vars in 1111 bytes} [Tue Jul 12 14:25:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:25:17.658698 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b9c02-34f1-41b0-bab2-aeb751d8163d None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:17.727406 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:17.783515 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b9c02-34f1-41b0-bab2-aeb751d8163d None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:17.844370 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e33463-63da-42be-8f4e-d04fc80b57cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:17.845487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e33463-63da-42be-8f4e-d04fc80b57cc None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:17.845954 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e33463-63da-42be-8f4e-d04fc80b57cc None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:17.846379 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e33463-63da-42be-8f4e-d04fc80b57cc None admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:17.847805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e33463-63da-42be-8f4e-d04fc80b57cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:17.848846 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e33463-63da-42be-8f4e-d04fc80b57cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:17.851692 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e33463-63da-42be-8f4e-d04fc80b57cc None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:17.876657 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 651/1286] 10.222.0.40 () {56 vars in 1148 bytes} [Tue Jul 12 14:25:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:17.883512 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e9ceb-805c-41ca-ad1b-f61fc8691c53 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:18.029099 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e9ceb-805c-41ca-ad1b-f61fc8691c53 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:18.088972 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9613fe8-053d-44b0-b106-dce69b65f197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:18.090110 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9613fe8-053d-44b0-b106-dce69b65f197 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:18.090623 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9613fe8-053d-44b0-b106-dce69b65f197 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:18.091135 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9613fe8-053d-44b0-b106-dce69b65f197 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:18.092700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9613fe8-053d-44b0-b106-dce69b65f197 None admin] RBAC: Adding query filter params (role.id=ae530119fc5c42358179521ce865b5d7, scope.project.id=00424b6950d14cd4854e4add3e3d7705, user.id=0a3704fdba154f13ad3bf8ac00c916c1) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:18.093254 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9613fe8-053d-44b0-b106-dce69b65f197 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:18.096031 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9613fe8-053d-44b0-b106-dce69b65f197 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:18.108729 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 636/1287] 10.222.0.40 () {56 vars in 1374 bytes} [Tue Jul 12 14:25:17 2022] GET /identity/v3/role_assignments?user.id=0a3704fdba154f13ad3bf8ac00c916c1&scope.project.id=00424b6950d14cd4854e4add3e3d7705&role.id=ae530119fc5c42358179521ce865b5d7 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:20.282331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8ccb9-2a81-4253-bfce-0c919ff301c0 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:20.282999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8ccb9-2a81-4253-bfce-0c919ff301c0 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:20.282999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8ccb9-2a81-4253-bfce-0c919ff301c0 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:20.284368 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 652/1288] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:20.290531 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5fa0b-e992-4d79-9858-47035b165865 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:20.291061 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5fa0b-e992-4d79-9858-47035b165865 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:20.291239 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5fa0b-e992-4d79-9858-47035b165865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:20.309799 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-08c5fa0b-e992-4d79-9858-47035b165865 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:20.311055 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-08c5fa0b-e992-4d79-9858-47035b165865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:20.346546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:20.392398 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 637/1289] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:25:20.416392 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8ccb9-2a81-4253-bfce-0c919ff301c0 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:20.546650 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8ccb9-2a81-4253-bfce-0c919ff301c0 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:20.561329 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:20.588693 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ec198-361b-4b00-865d-6c9047c4ed7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:20.589508 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ec198-361b-4b00-865d-6c9047c4ed7a None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:20.589793 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ec198-361b-4b00-865d-6c9047c4ed7a None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:20.590071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ec198-361b-4b00-865d-6c9047c4ed7a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:20.590736 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ec198-361b-4b00-865d-6c9047c4ed7a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:20.592317 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ec198-361b-4b00-865d-6c9047c4ed7a None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:20.606683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-374ec198-361b-4b00-865d-6c9047c4ed7a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 14:25:20.606683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:20.606683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:25:20.606683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:25:20.606683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:25:20.606683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:25:20.606683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:25:20.606683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:25:20.606683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 14:25:20.606683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:25:20.606683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:25:20.606683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:25:20.606683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:20.606683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:20.606683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:20.606683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:20.606683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:20.609058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:20.609058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:20.609058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:20.609058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:20.609058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:20.609058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:20.609058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:25:20.609058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:25:20.609058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:25:20.609058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:25:20.609058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:20.609058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:20.609058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:20.609058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:20.609058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:20.609058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:20.610981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:20.610981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:20.610981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:20.610981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:20.610981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:20.610981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:20.610981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:20.610981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:20.610981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:20.610981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:20.610981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:25:20.610981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:25:20.610981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 14:25:20.610981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:25:20.610981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 653/1290] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Jul 12 14:25:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:25:20.618132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5fa0b-e992-4d79-9858-47035b165865 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:20.732602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5fa0b-e992-4d79-9858-47035b165865 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:20.772193 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa0840-e587-4705-8eae-87075d0bdf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:20.772896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa0840-e587-4705-8eae-87075d0bdf11 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:20.773187 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa0840-e587-4705-8eae-87075d0bdf11 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:20.773489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa0840-e587-4705-8eae-87075d0bdf11 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:20.774296 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa0840-e587-4705-8eae-87075d0bdf11 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:20.774614 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa0840-e587-4705-8eae-87075d0bdf11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:20.776035 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa0840-e587-4705-8eae-87075d0bdf11 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:20.781539 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 638/1291] 10.222.0.40 () {56 vars in 1116 bytes} [Tue Jul 12 14:25:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:20.790906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ec198-361b-4b00-865d-6c9047c4ed7a None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:20.952055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ec198-361b-4b00-865d-6c9047c4ed7a None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:20.997762 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4c4d8-db7a-4334-bb56-7e28ba552e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:20.998569 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4c4d8-db7a-4334-bb56-7e28ba552e76 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:20.998904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4c4d8-db7a-4334-bb56-7e28ba552e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:20.999272 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4c4d8-db7a-4334-bb56-7e28ba552e76 None admin] PATH_INFO: `/v3/services` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:21.000158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4c4d8-db7a-4334-bb56-7e28ba552e76 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:21.000516 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4c4d8-db7a-4334-bb56-7e28ba552e76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:21.001994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4c4d8-db7a-4334-bb56-7e28ba552e76 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:21.007543 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 654/1292] 10.222.0.40 () {56 vars in 1116 bytes} [Tue Jul 12 14:25:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:23.124843 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d966ca-d0da-45c8-a09c-6d7a9c679922 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:23.125699 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d966ca-d0da-45c8-a09c-6d7a9c679922 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:23.125699 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d966ca-d0da-45c8-a09c-6d7a9c679922 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:23.126757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 639/1293] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:25:23.132721 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af52fd2-1bcd-493d-8bb3-fa2a3002be9a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:23.133972 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af52fd2-1bcd-493d-8bb3-fa2a3002be9a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:23.133972 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af52fd2-1bcd-493d-8bb3-fa2a3002be9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:23.151841 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-5af52fd2-1bcd-493d-8bb3-fa2a3002be9a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:23.153048 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-5af52fd2-1bcd-493d-8bb3-fa2a3002be9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:23.185798 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:23.231551 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 655/1294] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:25:23.257712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d966ca-d0da-45c8-a09c-6d7a9c679922 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:23.296310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:23.382671 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d966ca-d0da-45c8-a09c-6d7a9c679922 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:23.421140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd01aa-fb2b-4388-bbbd-7dfccdbc05fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:23.421814 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd01aa-fb2b-4388-bbbd-7dfccdbc05fa None admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:23.422095 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd01aa-fb2b-4388-bbbd-7dfccdbc05fa None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:23.422367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd01aa-fb2b-4388-bbbd-7dfccdbc05fa None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:23.423110 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd01aa-fb2b-4388-bbbd-7dfccdbc05fa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:23.424535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd01aa-fb2b-4388-bbbd-7dfccdbc05fa None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:23.522614 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 640/1295] 10.222.0.40 () {60 vars in 1141 bytes} [Tue Jul 12 14:25:23 2022] POST /identity/v3/services => generated 246 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:25:25.685055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec931f-d62c-4167-947d-125c6042533c None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:25.685647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec931f-d62c-4167-947d-125c6042533c None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:25.685647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec931f-d62c-4167-947d-125c6042533c None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:25.687305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 656/1296] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:25:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:25.694887 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff1ebc-e055-498a-b633-d0fa9cd5eb58 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:25.695523 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff1ebc-e055-498a-b633-d0fa9cd5eb58 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:25.695914 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff1ebc-e055-498a-b633-d0fa9cd5eb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:25.724751 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-ffff1ebc-e055-498a-b633-d0fa9cd5eb58 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:25.726818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ffff1ebc-e055-498a-b633-d0fa9cd5eb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:25.863074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 641/1297] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:25:25.888155 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec931f-d62c-4167-947d-125c6042533c None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:26.007993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec931f-d62c-4167-947d-125c6042533c None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:26.048638 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386db48-43a9-4dd2-bdf9-ff843619ee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:26.049460 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386db48-43a9-4dd2-bdf9-ff843619ee6f None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:26.049749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386db48-43a9-4dd2-bdf9-ff843619ee6f None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:26.050097 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386db48-43a9-4dd2-bdf9-ff843619ee6f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:26.050903 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386db48-43a9-4dd2-bdf9-ff843619ee6f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:26.055839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386db48-43a9-4dd2-bdf9-ff843619ee6f None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:26.070765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-a386db48-43a9-4dd2-bdf9-ff843619ee6f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 14:25:26.070765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:26.070765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:25:26.070765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:25:26.070765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:25:26.070765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:25:26.070765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:25:26.070765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:25:26.070765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 14:25:26.070765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:25:26.070765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:25:26.070765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:25:26.070765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:26.070765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:26.070765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:26.070765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:26.070765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:26.073013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:26.073013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:26.073013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:26.073013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:26.073013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:26.073013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:26.073013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:25:26.073013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:25:26.073013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:25:26.073013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:25:26.073013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:26.073013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:26.073013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:26.073013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:26.073013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:26.073013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:26.075116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:26.075116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:26.075116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:26.075116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:26.075116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:26.075116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:26.075116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:26.075116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:26.075116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:26.075116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:26.075116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:25:26.075116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:25:26.075116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 14:25:26.075116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:25:26.075116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 657/1298] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Jul 12 14:25:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 14:25:26.084060 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff1ebc-e055-498a-b633-d0fa9cd5eb58 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:26.102489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:26.195731 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff1ebc-e055-498a-b633-d0fa9cd5eb58 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:26.235886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143ba6a-302c-415b-ab14-46d7f13d3145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:26.236952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143ba6a-302c-415b-ab14-46d7f13d3145 None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:26.237237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143ba6a-302c-415b-ab14-46d7f13d3145 None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:26.237516 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143ba6a-302c-415b-ab14-46d7f13d3145 None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:26.238252 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143ba6a-302c-415b-ab14-46d7f13d3145 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:26.239465 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143ba6a-302c-415b-ab14-46d7f13d3145 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:26.240871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143ba6a-302c-415b-ab14-46d7f13d3145 None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:26.247502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 642/1299] 10.222.0.40 () {56 vars in 1116 bytes} [Tue Jul 12 14:25:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:26.253803 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386db48-43a9-4dd2-bdf9-ff843619ee6f None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:26.292025 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:26.369967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386db48-43a9-4dd2-bdf9-ff843619ee6f None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:26.408583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eead76d-4b48-4c94-846e-3cfad3b7b779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:26.409254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eead76d-4b48-4c94-846e-3cfad3b7b779 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:26.409542 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eead76d-4b48-4c94-846e-3cfad3b7b779 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:26.409823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eead76d-4b48-4c94-846e-3cfad3b7b779 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:26.411304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eead76d-4b48-4c94-846e-3cfad3b7b779 None admin] RBAC: Adding query filter params (interface=public, service_id=bcf24c07594c4606993aeef53e852743, region_id=RegionOne) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:26.411881 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eead76d-4b48-4c94-846e-3cfad3b7b779 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:26.413359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eead76d-4b48-4c94-846e-3cfad3b7b779 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:26.419192 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 658/1300] 10.222.0.40 () {56 vars in 1251 bytes} [Tue Jul 12 14:25:26 2022] GET /identity/v3/endpoints?service_id=bcf24c07594c4606993aeef53e852743&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:25:26.429175 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143ba6a-302c-415b-ab14-46d7f13d3145 None admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:26.542602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:26.563718 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143ba6a-302c-415b-ab14-46d7f13d3145 None admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:26.609365 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff31112-f2a4-4dc1-b9c5-0289645cc1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:26.610544 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff31112-f2a4-4dc1-b9c5-0289645cc1ae None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:26.611086 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff31112-f2a4-4dc1-b9c5-0289645cc1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:26.611585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff31112-f2a4-4dc1-b9c5-0289645cc1ae None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:26.612759 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff31112-f2a4-4dc1-b9c5-0289645cc1ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:26.616076 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff31112-f2a4-4dc1-b9c5-0289645cc1ae None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:26.630795 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 643/1301] 10.222.0.40 () {56 vars in 1087 bytes} [Tue Jul 12 14:25:26 2022] GET /identity/v3/services => generated 2191 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:25:28.801721 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e3ae0-2231-4231-947c-9678576d4a27 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:28.802354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e3ae0-2231-4231-947c-9678576d4a27 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:28.802489 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e3ae0-2231-4231-947c-9678576d4a27 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:28.803903 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 659/1302] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:25:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:25:28.809758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3feaa8-34ca-4c84-a5b1-dbed21e39e41 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:28.810304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3feaa8-34ca-4c84-a5b1-dbed21e39e41 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:28.810473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3feaa8-34ca-4c84-a5b1-dbed21e39e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:28.828942 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-2f3feaa8-34ca-4c84-a5b1-dbed21e39e41 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:25:28.830244 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2f3feaa8-34ca-4c84-a5b1-dbed21e39e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:25:28.907106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 644/1303] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:25:28 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 14:25:28.932486 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e3ae0-2231-4231-947c-9678576d4a27 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:29.040909 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:29.048879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e3ae0-2231-4231-947c-9678576d4a27 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:29.091627 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9e8f8-5ef5-493b-aaef-11e59aa09f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:29.092438 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9e8f8-5ef5-493b-aaef-11e59aa09f62 None admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:29.092719 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9e8f8-5ef5-493b-aaef-11e59aa09f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:29.093096 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9e8f8-5ef5-493b-aaef-11e59aa09f62 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:29.093759 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9e8f8-5ef5-493b-aaef-11e59aa09f62 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:29.095269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9e8f8-5ef5-493b-aaef-11e59aa09f62 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:29.118726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application [None req-5fe9e8f8-5ef5-493b-aaef-11e59aa09f62 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 14:25:29.118726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:29.118726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 14:25:29.118726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 14:25:29.118726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 14:25:29.118726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 14:25:29.118726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 14:25:29.118726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:25:29.118726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 14:25:29.118726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:25:29.118726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 14:25:29.118726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:25:29.118726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 14:25:29.118726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 14:25:29.118726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 14:25:29.118726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 14:25:29.118726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 14:25:29.120031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 14:25:29.120031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 14:25:29.120031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 14:25:29.120031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 14:25:29.120031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 14:25:29.120031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 14:25:29.120031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 14:25:29.120031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 14:25:29.120031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 14:25:29.120031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 14:25:29.120031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 14:25:29.120031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 14:25:29.120031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 14:25:29.120031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 14:25:29.120031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 14:25:29.120031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 14:25:29.121297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 14:25:29.121297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application with Lock( Jul 12 14:25:29.121297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 14:25:29.121297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self._enter() Jul 12 14:25:29.121297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 14:25:29.121297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 14:25:29.121297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 14:25:29.121297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application return self.creator() Jul 12 14:25:29.121297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 14:25:29.121297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application created_value = creator( Jul 12 14:25:29.121297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 14:25:29.121297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 14:25:29.121297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 14:25:29.121297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: ERROR keystone.server.flask.application Jul 12 14:25:29.123454 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 660/1304] 10.222.0.40 () {56 vars in 1117 bytes} [Tue Jul 12 14:25:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 14:25:29.128946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3feaa8-34ca-4c84-a5b1-dbed21e39e41 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:29.217429 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:29.250006 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3feaa8-34ca-4c84-a5b1-dbed21e39e41 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:29.284618 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c103c3-7b48-4e4b-b3d7-4702bd69825d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:29.285901 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c103c3-7b48-4e4b-b3d7-4702bd69825d None admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:29.286187 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c103c3-7b48-4e4b-b3d7-4702bd69825d None admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:29.286460 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c103c3-7b48-4e4b-b3d7-4702bd69825d None admin] PATH_INFO: `/v3/services` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:29.287185 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c103c3-7b48-4e4b-b3d7-4702bd69825d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:25:29.287532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c103c3-7b48-4e4b-b3d7-4702bd69825d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:29.288942 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c103c3-7b48-4e4b-b3d7-4702bd69825d None admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:29.294918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 645/1305] 10.222.0.40 () {56 vars in 1116 bytes} [Tue Jul 12 14:25:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:25:29.301254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9e8f8-5ef5-493b-aaef-11e59aa09f62 None admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:25:29.417836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9e8f8-5ef5-493b-aaef-11e59aa09f62 None admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:25:29.455572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026a41b-ce28-4209-9706-0a6c8634cac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:25:29.456326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026a41b-ce28-4209-9706-0a6c8634cac1 None admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:25:29.456610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026a41b-ce28-4209-9706-0a6c8634cac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:25:29.456886 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026a41b-ce28-4209-9706-0a6c8634cac1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:25:29.458172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026a41b-ce28-4209-9706-0a6c8634cac1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:25:29.459587 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026a41b-ce28-4209-9706-0a6c8634cac1 None admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:25:29.556403 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 661/1306] 10.222.0.40 () {60 vars in 1144 bytes} [Tue Jul 12 14:25:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:25:39.291448 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=30 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:25:39.551104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:24.887415 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45f410-e84c-4e49-9fcd-9f7c6bb6b328 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:24.887961 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45f410-e84c-4e49-9fcd-9f7c6bb6b328 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:24.887961 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45f410-e84c-4e49-9fcd-9f7c6bb6b328 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:24.891666 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 646/1307] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:32:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:32:24.894771 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262664d9-4e0b-4858-a7a6-e090a31d58f7 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:24.895222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262664d9-4e0b-4858-a7a6-e090a31d58f7 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:24.895358 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262664d9-4e0b-4858-a7a6-e090a31d58f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:24.984595 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-262664d9-4e0b-4858-a7a6-e090a31d58f7 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:32:24.985726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-262664d9-4e0b-4858-a7a6-e090a31d58f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:25.115728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 662/1308] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:32:25.163746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760cd1b-27fe-433d-9fd7-b6223b6735a6 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:25.164330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760cd1b-27fe-433d-9fd7-b6223b6735a6 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:25.164796 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760cd1b-27fe-433d-9fd7-b6223b6735a6 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:25.166478 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 647/1309] 10.222.0.40 () {54 vars in 964 bytes} [Tue Jul 12 14:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:32:25.174056 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b6d74-b3ae-44d9-ae82-d1fc81a47f3f None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:25.174685 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b6d74-b3ae-44d9-ae82-d1fc81a47f3f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:25.175150 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b6d74-b3ae-44d9-ae82-d1fc81a47f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:25.285151 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-847b6d74-b3ae-44d9-ae82-d1fc81a47f3f None None] MFA Rules not processed for user `2af2d348fc984ed897fd58196b433b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:32:25.286607 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-847b6d74-b3ae-44d9-ae82-d1fc81a47f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:25.318905 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:25.451045 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 663/1310] 10.222.0.40 () {58 vars in 1061 bytes} [Tue Jul 12 14:32:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:32:25.460482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760cd1b-27fe-433d-9fd7-b6223b6735a6 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:32:25.465062 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b760cd1b-27fe-433d-9fd7-b6223b6735a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:25.637194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760cd1b-27fe-433d-9fd7-b6223b6735a6 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:32:25.731900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2043f5-6447-49af-b29b-148fe81e428d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:32:25.732968 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2043f5-6447-49af-b29b-148fe81e428d service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:25.733485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2043f5-6447-49af-b29b-148fe81e428d service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:25.734066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2043f5-6447-49af-b29b-148fe81e428d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:25.736127 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-9b2043f5-6447-49af-b29b-148fe81e428d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:25.810423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:25.879261 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2043f5-6447-49af-b29b-148fe81e428d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:32:25.881177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2043f5-6447-49af-b29b-148fe81e428d service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:32:25.904223 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 648/1311] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:32:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:32:28.303729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37201d8e-8616-4c9d-bf48-a5c9d6d15c35 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:28.491837 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37201d8e-8616-4c9d-bf48-a5c9d6d15c35 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:28.491837 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37201d8e-8616-4c9d-bf48-a5c9d6d15c35 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:28.491837 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 664/1312] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:32:28.492432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f0541-5674-40b8-a134-8675a3538745 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:28.492432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f0541-5674-40b8-a134-8675a3538745 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:28.492432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f0541-5674-40b8-a134-8675a3538745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:28.492432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-7b3f0541-5674-40b8-a134-8675a3538745 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:32:28.492432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-7b3f0541-5674-40b8-a134-8675a3538745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:28.500209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 649/1313] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:32:28.553949 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c4302-2195-40be-9fa3-b87a09571233 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:28.554237 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c4302-2195-40be-9fa3-b87a09571233 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:28.554520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c4302-2195-40be-9fa3-b87a09571233 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:28.555930 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 665/1314] 10.222.0.40 () {54 vars in 964 bytes} [Tue Jul 12 14:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:32:28.562538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213173f-922f-4bdc-9ea1-1b6cfb1c2ccc None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:28.562902 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213173f-922f-4bdc-9ea1-1b6cfb1c2ccc None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:28.563253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213173f-922f-4bdc-9ea1-1b6cfb1c2ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:28.574310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:28.643448 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-8213173f-922f-4bdc-9ea1-1b6cfb1c2ccc None None] MFA Rules not processed for user `2af2d348fc984ed897fd58196b433b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:32:28.644622 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-8213173f-922f-4bdc-9ea1-1b6cfb1c2ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:28.730163 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 650/1315] 10.222.0.40 () {58 vars in 1061 bytes} [Tue Jul 12 14:32:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:32:28.746322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c4302-2195-40be-9fa3-b87a09571233 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:32:28.747918 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ab3c4302-2195-40be-9fa3-b87a09571233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:28.860367 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c4302-2195-40be-9fa3-b87a09571233 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:32:28.931144 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:28.933891 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f5fe6-0e37-4f4f-b350-648e2b207845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:32:28.934573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f5fe6-0e37-4f4f-b350-648e2b207845 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:28.934970 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f5fe6-0e37-4f4f-b350-648e2b207845 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:28.935311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f5fe6-0e37-4f4f-b350-648e2b207845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:28.937018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-2c0f5fe6-0e37-4f4f-b350-648e2b207845 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:29.056910 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f5fe6-0e37-4f4f-b350-648e2b207845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:32:29.058393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f5fe6-0e37-4f4f-b350-648e2b207845 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:32:29.077019 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 666/1316] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:32:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:32:31.835480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcb502-88b5-4eff-8180-cb58399488ce None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:31.836074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcb502-88b5-4eff-8180-cb58399488ce None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:31.836074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcb502-88b5-4eff-8180-cb58399488ce None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:31.837583 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 651/1317] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:32:31.843260 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6395eb1-401f-4e75-90b0-6d35099695c8 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:31.843682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6395eb1-401f-4e75-90b0-6d35099695c8 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:31.843833 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6395eb1-401f-4e75-90b0-6d35099695c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:31.906773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-c6395eb1-401f-4e75-90b0-6d35099695c8 None None] MFA Rules not processed for user `8c1a31a288804174b0c5662f15125f80`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:32:31.908012 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-c6395eb1-401f-4e75-90b0-6d35099695c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:31.958321 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:32.002608 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 667/1318] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:32:31 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:32:32.042500 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcb502-88b5-4eff-8180-cb58399488ce None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:32:32.044186 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-1ddcb502-88b5-4eff-8180-cb58399488ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:32.153222 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcb502-88b5-4eff-8180-cb58399488ce None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:32:32.155937 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:32.227251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ece47-6ced-4f8b-962e-16f43769dd96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:32:32.228013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ece47-6ced-4f8b-962e-16f43769dd96 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:32.228294 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ece47-6ced-4f8b-962e-16f43769dd96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:32.228567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ece47-6ced-4f8b-962e-16f43769dd96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:32.230381 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-6a8ece47-6ced-4f8b-962e-16f43769dd96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:32.337240 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ece47-6ced-4f8b-962e-16f43769dd96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:32:32.338695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ece47-6ced-4f8b-962e-16f43769dd96 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:32:32.357488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 652/1319] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:32:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:32:35.332528 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20eed1f-af7e-48c7-a9ef-a61c2991bb2f None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:35.333109 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20eed1f-af7e-48c7-a9ef-a61c2991bb2f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:35.333109 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20eed1f-af7e-48c7-a9ef-a61c2991bb2f None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:35.334503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 668/1320] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:32:35.340511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253b4ea-2ebf-469d-ab5d-10ea898d4fe4 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:35.340955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253b4ea-2ebf-469d-ab5d-10ea898d4fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:35.341058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253b4ea-2ebf-469d-ab5d-10ea898d4fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:35.379614 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:35.404659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-1253b4ea-2ebf-469d-ab5d-10ea898d4fe4 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:32:35.405840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-1253b4ea-2ebf-469d-ab5d-10ea898d4fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:35.500761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 653/1321] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:32:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:32:35.539124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20eed1f-af7e-48c7-a9ef-a61c2991bb2f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:32:35.540680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f20eed1f-af7e-48c7-a9ef-a61c2991bb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:35.644302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20eed1f-af7e-48c7-a9ef-a61c2991bb2f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:32:35.717441 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33b37f-12f4-4e43-9fe7-89935f361630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:32:35.718086 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33b37f-12f4-4e43-9fe7-89935f361630 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:35.718398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33b37f-12f4-4e43-9fe7-89935f361630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:35.718681 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33b37f-12f4-4e43-9fe7-89935f361630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:35.720379 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0a33b37f-12f4-4e43-9fe7-89935f361630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:35.727822 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:35.830703 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33b37f-12f4-4e43-9fe7-89935f361630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:32:35.832154 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33b37f-12f4-4e43-9fe7-89935f361630 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:32:35.850070 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 669/1322] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:32:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:32:39.294124 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafeb78-8e50-479f-8a5f-502585250f0b None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:39.294679 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafeb78-8e50-479f-8a5f-502585250f0b None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:39.294786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafeb78-8e50-479f-8a5f-502585250f0b None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:39.296134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 654/1323] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:32:39.301431 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054650e0-2d8e-4c6d-aeb5-d1e4ca466fa3 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:39.301942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054650e0-2d8e-4c6d-aeb5-d1e4ca466fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:39.302042 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054650e0-2d8e-4c6d-aeb5-d1e4ca466fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:39.368685 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-054650e0-2d8e-4c6d-aeb5-d1e4ca466fa3 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:32:39.369836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-054650e0-2d8e-4c6d-aeb5-d1e4ca466fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:39.429956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:39.470535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 670/1324] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:32:39.508279 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafeb78-8e50-479f-8a5f-502585250f0b None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:32:39.509857 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-edafeb78-8e50-479f-8a5f-502585250f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:39.623754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafeb78-8e50-479f-8a5f-502585250f0b None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:32:39.638278 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:39.702471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2acd4-22b0-4824-8673-dc4c5ae99ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:32:39.703065 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2acd4-22b0-4824-8673-dc4c5ae99ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:39.703361 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2acd4-22b0-4824-8673-dc4c5ae99ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:39.703641 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2acd4-22b0-4824-8673-dc4c5ae99ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:39.705323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-61f2acd4-22b0-4824-8673-dc4c5ae99ef3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:39.818772 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2acd4-22b0-4824-8673-dc4c5ae99ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:32:39.820240 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2acd4-22b0-4824-8673-dc4c5ae99ef3 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:32:39.838264 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 655/1325] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:32:41.938421 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533145cb-c516-4e0d-857c-c38cd3f217a6 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:41.938963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533145cb-c516-4e0d-857c-c38cd3f217a6 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:41.938963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533145cb-c516-4e0d-857c-c38cd3f217a6 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:41.940400 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 671/1326] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:32:41.945562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ec084-1a02-4a63-a62c-64faf021e40f None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:41.945981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ec084-1a02-4a63-a62c-64faf021e40f None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:41.946187 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ec084-1a02-4a63-a62c-64faf021e40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:41.992889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:42.012088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-129ec084-1a02-4a63-a62c-64faf021e40f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:32:42.013265 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-129ec084-1a02-4a63-a62c-64faf021e40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:42.112675 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 656/1327] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:32:42.148364 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533145cb-c516-4e0d-857c-c38cd3f217a6 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:32:42.154242 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-533145cb-c516-4e0d-857c-c38cd3f217a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:42.267036 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533145cb-c516-4e0d-857c-c38cd3f217a6 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:32:42.341522 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a6952-23a7-4883-a590-e596fa8e280d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:32:42.342171 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a6952-23a7-4883-a590-e596fa8e280d service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:42.342458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a6952-23a7-4883-a590-e596fa8e280d service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:42.342735 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a6952-23a7-4883-a590-e596fa8e280d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:42.344418 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-467a6952-23a7-4883-a590-e596fa8e280d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:42.361392 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:42.461644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a6952-23a7-4883-a590-e596fa8e280d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:32:42.463213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a6952-23a7-4883-a590-e596fa8e280d service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:32:42.486590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 672/1328] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:32:44.584993 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a939a-6cb7-4304-b366-d275b8470e5e None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:44.585624 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a939a-6cb7-4304-b366-d275b8470e5e None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:44.585624 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a939a-6cb7-4304-b366-d275b8470e5e None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:44.586915 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 657/1329] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:32:44.592194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778bf54-428a-451b-8314-88994331c4bb None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:44.592581 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778bf54-428a-451b-8314-88994331c4bb None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:44.592846 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778bf54-428a-451b-8314-88994331c4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:44.659640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-6778bf54-428a-451b-8314-88994331c4bb None None] MFA Rules not processed for user `8c1a31a288804174b0c5662f15125f80`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:32:44.660886 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-6778bf54-428a-451b-8314-88994331c4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:44.727093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:44.762785 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 673/1330] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:32:44 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:32:44.801937 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a939a-6cb7-4304-b366-d275b8470e5e None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:32:44.803516 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-771a939a-6cb7-4304-b366-d275b8470e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:44.918357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a939a-6cb7-4304-b366-d275b8470e5e None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:32:44.939001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:44.992906 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31e099-8be6-483c-be26-f85daeb91c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:32:44.993555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31e099-8be6-483c-be26-f85daeb91c82 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:44.993836 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31e099-8be6-483c-be26-f85daeb91c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:44.994110 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31e099-8be6-483c-be26-f85daeb91c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:44.996578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-6b31e099-8be6-483c-be26-f85daeb91c82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:45.112330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31e099-8be6-483c-be26-f85daeb91c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:32:45.113772 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31e099-8be6-483c-be26-f85daeb91c82 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:32:45.133768 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 658/1331] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:32:44 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:32:47.650533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da25a42-d241-4d73-94bb-dfc357172f46 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:47.651112 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da25a42-d241-4d73-94bb-dfc357172f46 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:47.651210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da25a42-d241-4d73-94bb-dfc357172f46 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:47.652800 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 674/1332] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:32:47.657911 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c8cd1-fcac-44dc-bdf2-835fa773c5b1 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:47.658317 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c8cd1-fcac-44dc-bdf2-835fa773c5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:47.658480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c8cd1-fcac-44dc-bdf2-835fa773c5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:47.720796 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:47.723478 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-925c8cd1-fcac-44dc-bdf2-835fa773c5b1 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:32:47.724692 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-925c8cd1-fcac-44dc-bdf2-835fa773c5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:47.822258 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 659/1333] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:32:47.858212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da25a42-d241-4d73-94bb-dfc357172f46 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:32:47.859803 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-2da25a42-d241-4d73-94bb-dfc357172f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:47.964966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da25a42-d241-4d73-94bb-dfc357172f46 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:32:48.037827 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ef234-31ce-480b-abe6-7a60e27ae9a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:32:48.038467 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ef234-31ce-480b-abe6-7a60e27ae9a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:48.038746 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ef234-31ce-480b-abe6-7a60e27ae9a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:48.039017 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ef234-31ce-480b-abe6-7a60e27ae9a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:48.040691 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-851ef234-31ce-480b-abe6-7a60e27ae9a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:48.067222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:48.149440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ef234-31ce-480b-abe6-7a60e27ae9a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:32:48.151595 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ef234-31ce-480b-abe6-7a60e27ae9a6 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:32:48.169431 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 675/1334] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:32:50.403681 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0747e0-c9eb-46ee-93de-6ab867253e0a None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:50.404265 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0747e0-c9eb-46ee-93de-6ab867253e0a None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:50.404265 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0747e0-c9eb-46ee-93de-6ab867253e0a None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:50.405589 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 660/1335] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:32:50.411002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56db974-849c-4d5d-ba39-1137bc5bd541 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:50.411471 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56db974-849c-4d5d-ba39-1137bc5bd541 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:50.411565 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56db974-849c-4d5d-ba39-1137bc5bd541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:50.476512 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-a56db974-849c-4d5d-ba39-1137bc5bd541 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:32:50.477730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a56db974-849c-4d5d-ba39-1137bc5bd541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:50.554276 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:50.579448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 676/1336] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:32:50.619230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0747e0-c9eb-46ee-93de-6ab867253e0a None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:32:50.621513 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-eb0747e0-c9eb-46ee-93de-6ab867253e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:50.742501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0747e0-c9eb-46ee-93de-6ab867253e0a None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:32:50.771972 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:50.817381 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925c3c0-446a-4d1f-94fb-332d99fd619e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:32:50.818040 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925c3c0-446a-4d1f-94fb-332d99fd619e service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:50.818329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925c3c0-446a-4d1f-94fb-332d99fd619e service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:50.818613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925c3c0-446a-4d1f-94fb-332d99fd619e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:50.820412 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-a925c3c0-446a-4d1f-94fb-332d99fd619e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:50.929519 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925c3c0-446a-4d1f-94fb-332d99fd619e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:32:50.930951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925c3c0-446a-4d1f-94fb-332d99fd619e service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:32:50.949461 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 661/1337] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:32:53.596687 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45061623-5919-4e6d-b346-18dd752e8b68 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:53.597257 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45061623-5919-4e6d-b346-18dd752e8b68 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:53.597257 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45061623-5919-4e6d-b346-18dd752e8b68 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:53.598627 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 677/1338] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:32:53.604790 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2722ff0-1e00-4b0c-9457-7b3e5c01f135 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:53.605224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2722ff0-1e00-4b0c-9457-7b3e5c01f135 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:53.605363 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2722ff0-1e00-4b0c-9457-7b3e5c01f135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:53.673313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-d2722ff0-1e00-4b0c-9457-7b3e5c01f135 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:32:53.674539 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-d2722ff0-1e00-4b0c-9457-7b3e5c01f135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:53.683958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:53.772019 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 662/1339] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:32:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:32:53.808911 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45061623-5919-4e6d-b346-18dd752e8b68 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:32:53.810491 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-45061623-5919-4e6d-b346-18dd752e8b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:53.921537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45061623-5919-4e6d-b346-18dd752e8b68 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:32:53.996722 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c2a05-c931-4484-9a59-943612225e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:32:53.997400 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c2a05-c931-4484-9a59-943612225e82 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:53.997679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c2a05-c931-4484-9a59-943612225e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:53.997950 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c2a05-c931-4484-9a59-943612225e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:53.999622 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-5c4c2a05-c931-4484-9a59-943612225e82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:54.036627 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:54.109915 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c2a05-c931-4484-9a59-943612225e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:32:54.111392 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c2a05-c931-4484-9a59-943612225e82 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:32:54.129760 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 678/1340] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:32:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:32:58.547421 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ca101-e520-4b5e-a843-92bee9aee6e3 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:58.547920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ca101-e520-4b5e-a843-92bee9aee6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:58.548015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ca101-e520-4b5e-a843-92bee9aee6e3 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:58.549485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 663/1341] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:32:58.555093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bcc2b-bd1a-4847-9674-8f3c0d02e923 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:58.555908 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bcc2b-bd1a-4847-9674-8f3c0d02e923 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:58.556331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bcc2b-bd1a-4847-9674-8f3c0d02e923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:58.632682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-0f8bcc2b-bd1a-4847-9674-8f3c0d02e923 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:32:58.633998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0f8bcc2b-bd1a-4847-9674-8f3c0d02e923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:58.725371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:58.736506 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 679/1342] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:32:58.776751 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ca101-e520-4b5e-a843-92bee9aee6e3 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:32:58.778290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-d55ca101-e520-4b5e-a843-92bee9aee6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:58.888925 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ca101-e520-4b5e-a843-92bee9aee6e3 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:32:58.926166 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:32:58.962729 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a18c75-dbe9-4d86-affc-8dece1b82e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:32:58.963442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a18c75-dbe9-4d86-affc-8dece1b82e05 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:32:58.963731 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a18c75-dbe9-4d86-affc-8dece1b82e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:32:58.964011 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a18c75-dbe9-4d86-affc-8dece1b82e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:32:58.966196 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-86a18c75-dbe9-4d86-affc-8dece1b82e05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:32:59.076868 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a18c75-dbe9-4d86-affc-8dece1b82e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:32:59.078313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a18c75-dbe9-4d86-affc-8dece1b82e05 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:32:59.097145 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 664/1343] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:02.386080 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24fb4d-997c-42f1-a9a5-73ebdeeddabc None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:02.386665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24fb4d-997c-42f1-a9a5-73ebdeeddabc None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:02.386665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24fb4d-997c-42f1-a9a5-73ebdeeddabc None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:02.388110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 680/1344] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:33:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:02.393658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dc123-877b-4d13-a94b-741bf0c4d12d None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:02.394118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dc123-877b-4d13-a94b-741bf0c4d12d None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:02.394218 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dc123-877b-4d13-a94b-741bf0c4d12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:02.466111 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-433dc123-877b-4d13-a94b-741bf0c4d12d None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:02.467386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-433dc123-877b-4d13-a94b-741bf0c4d12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:02.492281 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:02.592292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 665/1345] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:33:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:02.636189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24fb4d-997c-42f1-a9a5-73ebdeeddabc None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:02.637702 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-4c24fb4d-997c-42f1-a9a5-73ebdeeddabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:02.747615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24fb4d-997c-42f1-a9a5-73ebdeeddabc None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:02.826232 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd99ea-5ac1-469f-aace-3ed574929695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:02.826982 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd99ea-5ac1-469f-aace-3ed574929695 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:02.827287 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd99ea-5ac1-469f-aace-3ed574929695 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:02.827579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd99ea-5ac1-469f-aace-3ed574929695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:02.829278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-9fbd99ea-5ac1-469f-aace-3ed574929695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:02.873199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:02.941687 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd99ea-5ac1-469f-aace-3ed574929695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:02.943028 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd99ea-5ac1-469f-aace-3ed574929695 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:02.962756 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 681/1346] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:33:07.428910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74a81a-4ebe-494f-8589-0aa1c2398e12 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:07.429389 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74a81a-4ebe-494f-8589-0aa1c2398e12 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:07.429498 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74a81a-4ebe-494f-8589-0aa1c2398e12 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:07.430891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 666/1347] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:07.436734 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec014fb7-d254-4fec-b3ed-ee59ccde949e None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:07.437229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec014fb7-d254-4fec-b3ed-ee59ccde949e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:07.437328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec014fb7-d254-4fec-b3ed-ee59ccde949e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:07.508431 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-ec014fb7-d254-4fec-b3ed-ee59ccde949e None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:07.509668 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ec014fb7-d254-4fec-b3ed-ee59ccde949e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:07.615529 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:07.618220 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 682/1348] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:07.657601 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74a81a-4ebe-494f-8589-0aa1c2398e12 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:07.659195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-7e74a81a-4ebe-494f-8589-0aa1c2398e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:07.769203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74a81a-4ebe-494f-8589-0aa1c2398e12 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:07.818830 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:07.845940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79844521-f1e5-4567-9d16-c9d2c6df44ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:07.846591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79844521-f1e5-4567-9d16-c9d2c6df44ca service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:07.846870 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79844521-f1e5-4567-9d16-c9d2c6df44ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:07.847140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79844521-f1e5-4567-9d16-c9d2c6df44ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:07.848949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-79844521-f1e5-4567-9d16-c9d2c6df44ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:07.967551 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79844521-f1e5-4567-9d16-c9d2c6df44ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:07.968988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79844521-f1e5-4567-9d16-c9d2c6df44ca service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:07.988049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 667/1349] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:12.961386 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6783e9c-cb5c-4f10-babc-a3587817b778 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:12.961840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6783e9c-cb5c-4f10-babc-a3587817b778 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:12.961935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6783e9c-cb5c-4f10-babc-a3587817b778 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:12.963634 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 683/1350] 10.222.0.40 () {54 vars in 921 bytes} [Tue Jul 12 14:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:12.969068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5a480-204a-4948-83e7-52cdd9ec3c0c None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:12.969828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5a480-204a-4948-83e7-52cdd9ec3c0c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:12.970461 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5a480-204a-4948-83e7-52cdd9ec3c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:13.091310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-89e5a480-204a-4948-83e7-52cdd9ec3c0c None None] MFA Rules not processed for user `0a3704fdba154f13ad3bf8ac00c916c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:13.091310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-89e5a480-204a-4948-83e7-52cdd9ec3c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:13.114769 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:13.198932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 668/1351] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Jul 12 14:33:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:17.499583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a69de-79f5-4b14-bc97-c8748a2e6987 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:17.500130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a69de-79f5-4b14-bc97-c8748a2e6987 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:17.500130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a69de-79f5-4b14-bc97-c8748a2e6987 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:17.501596 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 684/1352] 10.222.0.40 () {54 vars in 921 bytes} [Tue Jul 12 14:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:17.506669 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca92e71-cfdf-4ab8-a333-062683b5d3d9 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:17.507154 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca92e71-cfdf-4ab8-a333-062683b5d3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:17.507478 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca92e71-cfdf-4ab8-a333-062683b5d3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:17.588249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-fca92e71-cfdf-4ab8-a333-062683b5d3d9 None None] MFA Rules not processed for user `0a3704fdba154f13ad3bf8ac00c916c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:17.590472 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fca92e71-cfdf-4ab8-a333-062683b5d3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:17.674686 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:17.715676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 669/1353] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Jul 12 14:33:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:18.870096 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25258d-4342-4157-a4e5-96ffe2d1ca47 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:18.870648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25258d-4342-4157-a4e5-96ffe2d1ca47 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:18.870648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25258d-4342-4157-a4e5-96ffe2d1ca47 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:18.872056 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 685/1354] 10.222.0.40 () {54 vars in 921 bytes} [Tue Jul 12 14:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:18.876991 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e433d5-fde9-403f-8160-e5682408b2b3 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:18.877394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e433d5-fde9-403f-8160-e5682408b2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:18.877715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e433d5-fde9-403f-8160-e5682408b2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:18.957251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-50e433d5-fde9-403f-8160-e5682408b2b3 None None] MFA Rules not processed for user `0a3704fdba154f13ad3bf8ac00c916c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:18.958444 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-50e433d5-fde9-403f-8160-e5682408b2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:19.066762 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 670/1355] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Jul 12 14:33:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:33:22.657984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c06c21-51fa-4612-9049-5afb6f041ef7 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:22.658539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c06c21-51fa-4612-9049-5afb6f041ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:22.658788 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c06c21-51fa-4612-9049-5afb6f041ef7 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:22.660605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 686/1356] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:22.666265 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3c6a2-c25f-4664-9450-465221126f28 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:22.667582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3c6a2-c25f-4664-9450-465221126f28 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:22.668016 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3c6a2-c25f-4664-9450-465221126f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:22.727357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:22.757396 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-bdb3c6a2-c25f-4664-9450-465221126f28 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:22.757814 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-bdb3c6a2-c25f-4664-9450-465221126f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:22.870144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 671/1357] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:22.923787 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e132606-40ec-4907-8f0a-3b243c340db7 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:22.924368 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e132606-40ec-4907-8f0a-3b243c340db7 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:22.924881 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e132606-40ec-4907-8f0a-3b243c340db7 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:22.926462 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 687/1358] 10.222.0.40 () {54 vars in 961 bytes} [Tue Jul 12 14:33:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:22.935053 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113cfe4-3102-431b-85a9-58ddbd988b1b None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:22.935636 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113cfe4-3102-431b-85a9-58ddbd988b1b None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:22.936152 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113cfe4-3102-431b-85a9-58ddbd988b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:23.023689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-9113cfe4-3102-431b-85a9-58ddbd988b1b None None] MFA Rules not processed for user `122fc227de9d4f87a66e4a0d86ff0b16`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:23.024971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-9113cfe4-3102-431b-85a9-58ddbd988b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:23.078840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:23.150934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 672/1359] 10.222.0.40 () {58 vars in 1058 bytes} [Tue Jul 12 14:33:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:23.157725 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e132606-40ec-4907-8f0a-3b243c340db7 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:23.159223 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1e132606-40ec-4907-8f0a-3b243c340db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:23.313308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e132606-40ec-4907-8f0a-3b243c340db7 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:23.393015 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:23.439176 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966802ee-cadd-450e-9acb-a107ba8821cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:23.439972 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966802ee-cadd-450e-9acb-a107ba8821cc service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:23.440620 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966802ee-cadd-450e-9acb-a107ba8821cc service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:23.441319 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966802ee-cadd-450e-9acb-a107ba8821cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:23.443841 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-966802ee-cadd-450e-9acb-a107ba8821cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:23.552343 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966802ee-cadd-450e-9acb-a107ba8821cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:23.554206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966802ee-cadd-450e-9acb-a107ba8821cc service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:23.576671 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 688/1360] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:25.868232 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00820ca5-407e-4312-9dbd-fdc64dc73011 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:25.869224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00820ca5-407e-4312-9dbd-fdc64dc73011 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:25.869573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00820ca5-407e-4312-9dbd-fdc64dc73011 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:25.870837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 673/1361] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:33:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:25.876505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f680d-574a-4df1-93aa-49a99ec1b70a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:25.876977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f680d-574a-4df1-93aa-49a99ec1b70a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:25.877126 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f680d-574a-4df1-93aa-49a99ec1b70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:25.944682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-bb5f680d-574a-4df1-93aa-49a99ec1b70a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:25.945939 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-bb5f680d-574a-4df1-93aa-49a99ec1b70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:25.984059 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:26.050016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 689/1362] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:26.095740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00820ca5-407e-4312-9dbd-fdc64dc73011 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:26.097369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-00820ca5-407e-4312-9dbd-fdc64dc73011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:26.274294 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00820ca5-407e-4312-9dbd-fdc64dc73011 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:26.286808 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:26.410844 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c94a7e-855a-4e73-aa12-94de50ecdbea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:26.411700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c94a7e-855a-4e73-aa12-94de50ecdbea service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:26.412116 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c94a7e-855a-4e73-aa12-94de50ecdbea service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:26.412530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c94a7e-855a-4e73-aa12-94de50ecdbea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:26.414283 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-12c94a7e-855a-4e73-aa12-94de50ecdbea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:26.538974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c94a7e-855a-4e73-aa12-94de50ecdbea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:26.541256 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c94a7e-855a-4e73-aa12-94de50ecdbea service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:26.563505 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 674/1363] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:29.107065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f449fc-d13e-47ba-9b53-e2fb6daafc60 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:29.108066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f449fc-d13e-47ba-9b53-e2fb6daafc60 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:29.108066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f449fc-d13e-47ba-9b53-e2fb6daafc60 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:29.109034 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 690/1364] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:29.114677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc9bbb-93d0-4163-aaf8-3b212ec1cadb None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:29.115505 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc9bbb-93d0-4163-aaf8-3b212ec1cadb None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:29.115966 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc9bbb-93d0-4163-aaf8-3b212ec1cadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:29.131742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:29.188463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-04bc9bbb-93d0-4163-aaf8-3b212ec1cadb None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:29.189764 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-04bc9bbb-93d0-4163-aaf8-3b212ec1cadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:29.299354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 675/1365] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:29.346727 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d916909-c061-4e8a-9037-42fb747e6eba None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:29.347412 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d916909-c061-4e8a-9037-42fb747e6eba None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:29.347801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d916909-c061-4e8a-9037-42fb747e6eba None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:29.349623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 691/1366] 10.222.0.40 () {54 vars in 961 bytes} [Tue Jul 12 14:33:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:29.355598 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70609127-bcc8-4674-b798-1c89eac84764 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:29.358705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70609127-bcc8-4674-b798-1c89eac84764 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:29.358705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70609127-bcc8-4674-b798-1c89eac84764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:29.442138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-70609127-bcc8-4674-b798-1c89eac84764 None None] MFA Rules not processed for user `122fc227de9d4f87a66e4a0d86ff0b16`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:29.444329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-70609127-bcc8-4674-b798-1c89eac84764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:29.485765 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:29.578832 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 676/1367] 10.222.0.40 () {58 vars in 1058 bytes} [Tue Jul 12 14:33:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:33:29.586525 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d916909-c061-4e8a-9037-42fb747e6eba None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:29.588119 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-2d916909-c061-4e8a-9037-42fb747e6eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:29.750805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d916909-c061-4e8a-9037-42fb747e6eba None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:29.773532 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:29.875099 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138cde4-8483-4cdc-bfa2-5a41b28a9b2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:29.875781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138cde4-8483-4cdc-bfa2-5a41b28a9b2f service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:29.876061 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138cde4-8483-4cdc-bfa2-5a41b28a9b2f service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:29.876331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138cde4-8483-4cdc-bfa2-5a41b28a9b2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:29.878016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-c138cde4-8483-4cdc-bfa2-5a41b28a9b2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:29.978048 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138cde4-8483-4cdc-bfa2-5a41b28a9b2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:29.980122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138cde4-8483-4cdc-bfa2-5a41b28a9b2f service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:30.004876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 692/1368] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:30.965503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21e22a-d117-4c2b-b109-32d9ea7bdc4f None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:30.966103 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21e22a-d117-4c2b-b109-32d9ea7bdc4f None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:30.966103 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21e22a-d117-4c2b-b109-32d9ea7bdc4f None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:30.967588 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 677/1369] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:30.972887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd3db-0ce3-4cb1-9e27-985efd97e7ce None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:30.973370 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd3db-0ce3-4cb1-9e27-985efd97e7ce None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:30.973665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd3db-0ce3-4cb1-9e27-985efd97e7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:31.009021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:31.047415 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-b29bd3db-0ce3-4cb1-9e27-985efd97e7ce None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:31.049305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b29bd3db-0ce3-4cb1-9e27-985efd97e7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:31.166384 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 693/1370] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:31.522065 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16af5d-0bdc-4044-8cd5-57a2d2d6cee7 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:31.522065 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16af5d-0bdc-4044-8cd5-57a2d2d6cee7 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:31.522065 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16af5d-0bdc-4044-8cd5-57a2d2d6cee7 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:31.523082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 678/1371] 10.222.0.40 () {54 vars in 963 bytes} [Tue Jul 12 14:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:31.528243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf658c-6836-4bb2-9f26-a9057d426f02 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:31.528550 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf658c-6836-4bb2-9f26-a9057d426f02 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:31.528802 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf658c-6836-4bb2-9f26-a9057d426f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:31.610894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-1fcf658c-6836-4bb2-9f26-a9057d426f02 None None] MFA Rules not processed for user `aeb6850303f54a16bb23f05165844dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:31.612147 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1fcf658c-6836-4bb2-9f26-a9057d426f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:31.668737 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:31.701276 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 694/1372] 10.222.0.40 () {58 vars in 1060 bytes} [Tue Jul 12 14:33:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:33:31.709148 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16af5d-0bdc-4044-8cd5-57a2d2d6cee7 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:31.710870 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-da16af5d-0bdc-4044-8cd5-57a2d2d6cee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:31.824853 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16af5d-0bdc-4044-8cd5-57a2d2d6cee7 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:31.867445 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:31.904661 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9010d78-7be5-4753-9db5-c1a41489e038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:31.905314 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9010d78-7be5-4753-9db5-c1a41489e038 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:31.905598 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9010d78-7be5-4753-9db5-c1a41489e038 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:31.905875 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9010d78-7be5-4753-9db5-c1a41489e038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:31.907702 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-d9010d78-7be5-4753-9db5-c1a41489e038 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:32.027304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9010d78-7be5-4753-9db5-c1a41489e038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:32.028779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9010d78-7be5-4753-9db5-c1a41489e038 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:32.048443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 679/1373] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:33:32.576778 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620e810-d878-49f2-b759-b7814b0d5fe6 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:32.577307 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620e810-d878-49f2-b759-b7814b0d5fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:32.577307 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620e810-d878-49f2-b759-b7814b0d5fe6 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:32.578718 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 695/1374] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:32.583952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d2c8b-f1f0-481d-ab1c-0b89c1f1a34b None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:32.584266 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d2c8b-f1f0-481d-ab1c-0b89c1f1a34b None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:32.584548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d2c8b-f1f0-481d-ab1c-0b89c1f1a34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:32.652635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-7e1d2c8b-f1f0-481d-ab1c-0b89c1f1a34b None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:32.653763 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-7e1d2c8b-f1f0-481d-ab1c-0b89c1f1a34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:32.676687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:32.756938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 680/1375] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:32.801705 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620e810-d878-49f2-b759-b7814b0d5fe6 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:32.803384 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-6620e810-d878-49f2-b759-b7814b0d5fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:32.952031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620e810-d878-49f2-b759-b7814b0d5fe6 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:33.002076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:33.067898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844be88a-c843-4291-a820-b376f4e37e0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:33.067898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844be88a-c843-4291-a820-b376f4e37e0d service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:33.067898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844be88a-c843-4291-a820-b376f4e37e0d service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:33.067898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844be88a-c843-4291-a820-b376f4e37e0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:33.069783 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-844be88a-c843-4291-a820-b376f4e37e0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:33.164376 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844be88a-c843-4291-a820-b376f4e37e0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:33.166336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844be88a-c843-4291-a820-b376f4e37e0d service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:33.184919 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 696/1376] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:35.623304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d144c0-c5a7-4563-b48d-8216d53d5ae2 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:35.623813 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d144c0-c5a7-4563-b48d-8216d53d5ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:35.623938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d144c0-c5a7-4563-b48d-8216d53d5ae2 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:35.625236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 681/1377] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:35.630583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438e362-4794-4198-a0bf-e97a03ee5347 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:35.631243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438e362-4794-4198-a0bf-e97a03ee5347 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:35.631452 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438e362-4794-4198-a0bf-e97a03ee5347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:35.715153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-d438e362-4794-4198-a0bf-e97a03ee5347 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:35.716457 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d438e362-4794-4198-a0bf-e97a03ee5347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:35.723498 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:35.854977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 697/1378] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:35.902523 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d144c0-c5a7-4563-b48d-8216d53d5ae2 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:35.904478 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-c1d144c0-c5a7-4563-b48d-8216d53d5ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:36.061921 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d144c0-c5a7-4563-b48d-8216d53d5ae2 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:36.066051 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:36.185216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c42d09-ac3f-4bbd-a26c-9044674292e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:36.185781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c42d09-ac3f-4bbd-a26c-9044674292e2 service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:36.186060 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c42d09-ac3f-4bbd-a26c-9044674292e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:36.186328 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c42d09-ac3f-4bbd-a26c-9044674292e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:36.188088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-00c42d09-ac3f-4bbd-a26c-9044674292e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:36.285971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c42d09-ac3f-4bbd-a26c-9044674292e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:36.287604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c42d09-ac3f-4bbd-a26c-9044674292e2 service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:36.307697 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 682/1379] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:38.614051 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf64d3-a97f-4a74-96c4-c80f2a6a202f None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:38.614640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf64d3-a97f-4a74-96c4-c80f2a6a202f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:38.614640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf64d3-a97f-4a74-96c4-c80f2a6a202f None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:38.616148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 698/1380] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:38.623261 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31b5ab-9423-4d17-b63c-338b8b53bbee None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:38.623772 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31b5ab-9423-4d17-b63c-338b8b53bbee None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:38.624117 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31b5ab-9423-4d17-b63c-338b8b53bbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:38.636650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:38.694368 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-7f31b5ab-9423-4d17-b63c-338b8b53bbee None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:38.695502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-7f31b5ab-9423-4d17-b63c-338b8b53bbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:38.803077 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 683/1381] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:38.848384 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf64d3-a97f-4a74-96c4-c80f2a6a202f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:38.850107 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-cecf64d3-a97f-4a74-96c4-c80f2a6a202f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:39.018317 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:39.032264 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf64d3-a97f-4a74-96c4-c80f2a6a202f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:39.168017 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961201e-546c-45a2-abeb-0a4d1a942aff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:39.168679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961201e-546c-45a2-abeb-0a4d1a942aff service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:39.168965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961201e-546c-45a2-abeb-0a4d1a942aff service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:39.169243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961201e-546c-45a2-abeb-0a4d1a942aff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:39.171170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e961201e-546c-45a2-abeb-0a4d1a942aff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:39.289672 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961201e-546c-45a2-abeb-0a4d1a942aff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:39.291203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961201e-546c-45a2-abeb-0a4d1a942aff service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:39.304588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:39.315562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 699/1382] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:42.058964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98f373-dcca-4877-99e7-5891dd0e7928 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:42.059911 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98f373-dcca-4877-99e7-5891dd0e7928 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:42.059911 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98f373-dcca-4877-99e7-5891dd0e7928 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:42.060966 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 684/1383] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:42.067558 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cb7c7-724f-4699-a79e-988af330cdf7 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:42.068080 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cb7c7-724f-4699-a79e-988af330cdf7 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:42.068605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cb7c7-724f-4699-a79e-988af330cdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:42.154993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-421cb7c7-724f-4699-a79e-988af330cdf7 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:42.156274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-421cb7c7-724f-4699-a79e-988af330cdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:42.293905 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 700/1384] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:33:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:42.356463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98f373-dcca-4877-99e7-5891dd0e7928 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:42.358108 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2b98f373-dcca-4877-99e7-5891dd0e7928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:42.467085 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:42.542623 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98f373-dcca-4877-99e7-5891dd0e7928 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:42.701535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6cc97-1501-473c-9986-092cbd4114eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:42.702141 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6cc97-1501-473c-9986-092cbd4114eb service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:42.702594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6cc97-1501-473c-9986-092cbd4114eb service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:42.702750 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6cc97-1501-473c-9986-092cbd4114eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:42.704636 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-eea6cc97-1501-473c-9986-092cbd4114eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:42.769436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:42.815186 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6cc97-1501-473c-9986-092cbd4114eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:42.816874 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6cc97-1501-473c-9986-092cbd4114eb service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:42.837720 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 685/1385] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:44.984708 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a71ab-c2f4-4cad-80c4-e1fab2bb4ca6 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:44.985280 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a71ab-c2f4-4cad-80c4-e1fab2bb4ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:44.985578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a71ab-c2f4-4cad-80c4-e1fab2bb4ca6 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:44.987568 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 701/1386] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:33:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:44.995506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8928d62-0211-422a-9156-e30cd900f9ff None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:44.996076 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8928d62-0211-422a-9156-e30cd900f9ff None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:44.996656 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8928d62-0211-422a-9156-e30cd900f9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:45.072420 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-b8928d62-0211-422a-9156-e30cd900f9ff None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:45.073656 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b8928d62-0211-422a-9156-e30cd900f9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:45.184627 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 686/1387] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:45.233129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a71ab-c2f4-4cad-80c4-e1fab2bb4ca6 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:45.235344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-6e6a71ab-c2f4-4cad-80c4-e1fab2bb4ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:45.329243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:45.409624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a71ab-c2f4-4cad-80c4-e1fab2bb4ca6 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:45.543705 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040450b8-30d5-4a03-87b3-ff51bc7208bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:45.544297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040450b8-30d5-4a03-87b3-ff51bc7208bc service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:45.544575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040450b8-30d5-4a03-87b3-ff51bc7208bc service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:45.544977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040450b8-30d5-4a03-87b3-ff51bc7208bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:45.546670 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-040450b8-30d5-4a03-87b3-ff51bc7208bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:45.586366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:45.641785 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040450b8-30d5-4a03-87b3-ff51bc7208bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:45.643534 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040450b8-30d5-4a03-87b3-ff51bc7208bc service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:45.662804 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 702/1388] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:47.731124 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc293794-e746-48a8-9548-53ac12f81fa5 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:47.732480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc293794-e746-48a8-9548-53ac12f81fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:47.732480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc293794-e746-48a8-9548-53ac12f81fa5 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:47.733080 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 687/1389] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:47.738475 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aafde0-1f14-4c00-baec-ceb8684a2bd8 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:47.738895 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aafde0-1f14-4c00-baec-ceb8684a2bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:47.739029 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aafde0-1f14-4c00-baec-ceb8684a2bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:47.807803 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-80aafde0-1f14-4c00-baec-ceb8684a2bd8 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:47.809047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-80aafde0-1f14-4c00-baec-ceb8684a2bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:47.910785 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 703/1390] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:47.972123 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3481834-4746-4991-9ff5-47a1f0018b04 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:47.972477 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3481834-4746-4991-9ff5-47a1f0018b04 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:47.972668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3481834-4746-4991-9ff5-47a1f0018b04 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:47.974214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 688/1391] 10.222.0.40 () {54 vars in 962 bytes} [Tue Jul 12 14:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:47.980314 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50632fdd-79f7-4a19-a582-1930183d03ba None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:47.980605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50632fdd-79f7-4a19-a582-1930183d03ba None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:47.980889 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50632fdd-79f7-4a19-a582-1930183d03ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:47.998202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:48.073254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-50632fdd-79f7-4a19-a582-1930183d03ba None None] MFA Rules not processed for user `37932500740c4ccb96358bd751d01598`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:48.074645 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-50632fdd-79f7-4a19-a582-1930183d03ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:48.162203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 704/1392] 10.222.0.40 () {58 vars in 1059 bytes} [Tue Jul 12 14:33:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:33:48.169828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3481834-4746-4991-9ff5-47a1f0018b04 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:48.171364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b3481834-4746-4991-9ff5-47a1f0018b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:48.182220 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edbe76-5814-4109-ba90-f9d7ea92cdbe None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:48.182486 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edbe76-5814-4109-ba90-f9d7ea92cdbe None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:48.182770 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edbe76-5814-4109-ba90-f9d7ea92cdbe None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:48.184185 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 705/1393] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:33:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:33:48.189143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37669358-85b1-4ba4-bdeb-97fb0dbb82fd None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:48.189443 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37669358-85b1-4ba4-bdeb-97fb0dbb82fd None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:48.189732 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37669358-85b1-4ba4-bdeb-97fb0dbb82fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:48.205128 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:48.262785 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-37669358-85b1-4ba4-bdeb-97fb0dbb82fd None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:48.264178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-37669358-85b1-4ba4-bdeb-97fb0dbb82fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:48.284316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3481834-4746-4991-9ff5-47a1f0018b04 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:48.320519 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:48.361130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812887c9-6ad1-4d08-ac11-2e9026d90297 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37932500740c4ccb96358bd751d01598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:48.361805 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812887c9-6ad1-4d08-ac11-2e9026d90297 service glance] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:48.362085 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812887c9-6ad1-4d08-ac11-2e9026d90297 service glance] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:48.362356 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812887c9-6ad1-4d08-ac11-2e9026d90297 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:48.364075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-812887c9-6ad1-4d08-ac11-2e9026d90297 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:48.364383 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 706/1394] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:33:48.408776 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37669358-85b1-4ba4-bdeb-97fb0dbb82fd None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:48.410043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-37669358-85b1-4ba4-bdeb-97fb0dbb82fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:48.445891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:48.478954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812887c9-6ad1-4d08-ac11-2e9026d90297 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:48.480808 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812887c9-6ad1-4d08-ac11-2e9026d90297 service glance] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:48.501217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 689/1395] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:48.534965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37669358-85b1-4ba4-bdeb-97fb0dbb82fd None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:48.608814 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:48.660631 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9bef1-1961-4c33-b4ba-f0c6c19b198a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:48.661286 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9bef1-1961-4c33-b4ba-f0c6c19b198a service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:48.661573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9bef1-1961-4c33-b4ba-f0c6c19b198a service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:48.661856 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9bef1-1961-4c33-b4ba-f0c6c19b198a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:48.663546 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a3a9bef1-1961-4c33-b4ba-f0c6c19b198a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:48.772523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9bef1-1961-4c33-b4ba-f0c6c19b198a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:48.776035 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9bef1-1961-4c33-b4ba-f0c6c19b198a service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:48.802952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 707/1396] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:33:49.430467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bbaac-35ae-49f9-8ca4-d371cb9e2850 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:49.431188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bbaac-35ae-49f9-8ca4-d371cb9e2850 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:49.431188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bbaac-35ae-49f9-8ca4-d371cb9e2850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:49.513233 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-482bbaac-35ae-49f9-8ca4-d371cb9e2850 None None] MFA Rules not processed for user `5ec758ef106b49f4985845b3c106f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:49.514461 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-482bbaac-35ae-49f9-8ca4-d371cb9e2850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:49.624506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 690/1397] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Jul 12 14:33:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:49.674448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504a40a-f5ff-4c9f-a58c-ac7a027f20ad None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:49.674922 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504a40a-f5ff-4c9f-a58c-ac7a027f20ad None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:49.675394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504a40a-f5ff-4c9f-a58c-ac7a027f20ad None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:49.677132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 708/1398] 10.222.0.40 () {54 vars in 942 bytes} [Tue Jul 12 14:33:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:49.684414 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f3150-820b-46b3-94fc-5ca161b654c3 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:49.684769 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f3150-820b-46b3-94fc-5ca161b654c3 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:49.685176 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f3150-820b-46b3-94fc-5ca161b654c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:49.745762 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:49.767713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-604f3150-820b-46b3-94fc-5ca161b654c3 None None] MFA Rules not processed for user `ad12085f356a4f0682bb70ad231a10b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:49.769230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-604f3150-820b-46b3-94fc-5ca161b654c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:49.900573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 691/1399] 10.222.0.40 () {58 vars in 1039 bytes} [Tue Jul 12 14:33:49 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:49.914281 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504a40a-f5ff-4c9f-a58c-ac7a027f20ad None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:49.916870 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b504a40a-f5ff-4c9f-a58c-ac7a027f20ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:50.011916 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:50.075834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504a40a-f5ff-4c9f-a58c-ac7a027f20ad None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:50.185557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366baa1c-0d78-4eae-ad93-8af0e7dfb35a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad12085f356a4f0682bb70ad231a10b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:50.186120 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366baa1c-0d78-4eae-ad93-8af0e7dfb35a service swift] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:50.186409 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366baa1c-0d78-4eae-ad93-8af0e7dfb35a service swift] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:50.186688 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366baa1c-0d78-4eae-ad93-8af0e7dfb35a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:50.188532 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-366baa1c-0d78-4eae-ad93-8af0e7dfb35a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:50.261076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:50.280980 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366baa1c-0d78-4eae-ad93-8af0e7dfb35a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:50.282612 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366baa1c-0d78-4eae-ad93-8af0e7dfb35a service swift] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:50.291423 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 709/1400] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Jul 12 14:33:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:33:51.155394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc70584-97b7-4558-ab24-72c48c367c94 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:51.156326 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc70584-97b7-4558-ab24-72c48c367c94 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:51.156905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc70584-97b7-4558-ab24-72c48c367c94 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:51.158568 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 692/1401] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:33:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:51.164460 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8632f21-8fed-4357-ba6d-56100600ef4c None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:51.165010 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8632f21-8fed-4357-ba6d-56100600ef4c None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:51.165275 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8632f21-8fed-4357-ba6d-56100600ef4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:51.251415 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-b8632f21-8fed-4357-ba6d-56100600ef4c None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:51.251415 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b8632f21-8fed-4357-ba6d-56100600ef4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:51.400580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 710/1402] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:51.453327 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc70584-97b7-4558-ab24-72c48c367c94 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:51.455598 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ecc70584-97b7-4558-ab24-72c48c367c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:51.597731 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:51.703641 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc70584-97b7-4558-ab24-72c48c367c94 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:51.810690 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d7d1c-8344-4394-a873-760739319a77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:51.811390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d7d1c-8344-4394-a873-760739319a77 service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:51.811680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d7d1c-8344-4394-a873-760739319a77 service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:51.811956 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d7d1c-8344-4394-a873-760739319a77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:51.813679 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-482d7d1c-8344-4394-a873-760739319a77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:51.926073 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d7d1c-8344-4394-a873-760739319a77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:51.927977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d7d1c-8344-4394-a873-760739319a77 service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:51.969232 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 693/1403] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:52.015384 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:54.431801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48b22c-74ab-4db5-8734-924401b93358 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:54.432493 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48b22c-74ab-4db5-8734-924401b93358 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:54.432493 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48b22c-74ab-4db5-8734-924401b93358 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:54.435609 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 711/1404] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:33:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:54.439027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ab434-430b-40fd-9875-fd1ec1108718 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:54.439880 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ab434-430b-40fd-9875-fd1ec1108718 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:54.440389 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ab434-430b-40fd-9875-fd1ec1108718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:54.527803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-9e3ab434-430b-40fd-9875-fd1ec1108718 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:54.534142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-9e3ab434-430b-40fd-9875-fd1ec1108718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:54.655643 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 694/1405] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:33:54.702439 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48b22c-74ab-4db5-8734-924401b93358 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:54.704853 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-2d48b22c-74ab-4db5-8734-924401b93358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:54.775702 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:54.881249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48b22c-74ab-4db5-8734-924401b93358 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:55.012464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac7e56-d4ce-41f4-a017-fed35e6fb2ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:55.013143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac7e56-d4ce-41f4-a017-fed35e6fb2ed service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:55.013432 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac7e56-d4ce-41f4-a017-fed35e6fb2ed service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:55.013712 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac7e56-d4ce-41f4-a017-fed35e6fb2ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:55.015601 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-faac7e56-d4ce-41f4-a017-fed35e6fb2ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:55.034896 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:55.125782 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac7e56-d4ce-41f4-a017-fed35e6fb2ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:55.127462 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac7e56-d4ce-41f4-a017-fed35e6fb2ed service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:55.159488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 712/1406] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:33:57.483088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfafe30-94f7-4197-a890-bc468d57faa1 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:57.483635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfafe30-94f7-4197-a890-bc468d57faa1 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:57.483635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfafe30-94f7-4197-a890-bc468d57faa1 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:57.485195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 695/1407] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:33:57.490661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6797c-ee0b-44ba-bb7c-9f034c891d11 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:57.491166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6797c-ee0b-44ba-bb7c-9f034c891d11 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:57.491271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6797c-ee0b-44ba-bb7c-9f034c891d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:57.579864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-3de6797c-ee0b-44ba-bb7c-9f034c891d11 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:33:57.581484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-3de6797c-ee0b-44ba-bb7c-9f034c891d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:57.695764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:57.702859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 713/1408] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:33:57.747206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfafe30-94f7-4197-a890-bc468d57faa1 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:33:57.748861 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fdfafe30-94f7-4197-a890-bc468d57faa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:57.805009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:57.920949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfafe30-94f7-4197-a890-bc468d57faa1 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:33:58.061925 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba09b91-d5d3-47e5-92c6-5614ff48c596 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:33:58.062945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba09b91-d5d3-47e5-92c6-5614ff48c596 service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:33:58.063230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba09b91-d5d3-47e5-92c6-5614ff48c596 service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:33:58.063539 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba09b91-d5d3-47e5-92c6-5614ff48c596 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:33:58.065311 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2ba09b91-d5d3-47e5-92c6-5614ff48c596 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:33:58.073334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:33:58.167616 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba09b91-d5d3-47e5-92c6-5614ff48c596 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:33:58.169365 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba09b91-d5d3-47e5-92c6-5614ff48c596 service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:33:58.188501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 696/1409] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:34:07.733592 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:08.185767 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=42 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:13.979623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db133a-b52f-4271-821a-66133aee3289 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:13.980200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db133a-b52f-4271-821a-66133aee3289 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:13.980200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db133a-b52f-4271-821a-66133aee3289 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:13.981545 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 714/1410] 10.222.0.40 () {54 vars in 918 bytes} [Tue Jul 12 14:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:13.986664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc2288-7fb8-44ae-b585-0900252a2b95 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:13.987125 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc2288-7fb8-44ae-b585-0900252a2b95 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:13.987232 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc2288-7fb8-44ae-b585-0900252a2b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:14.062434 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-c2dc2288-7fb8-44ae-b585-0900252a2b95 None None] MFA Rules not processed for user `0a3704fdba154f13ad3bf8ac00c916c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:14.063671 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-c2dc2288-7fb8-44ae-b585-0900252a2b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:14.172476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 697/1411] 10.222.0.40 () {58 vars in 1015 bytes} [Tue Jul 12 14:34:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:14.186880 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e5936-e7c2-4852-8ae5-3748280e983c None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:14.187164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e5936-e7c2-4852-8ae5-3748280e983c None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:14.187479 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e5936-e7c2-4852-8ae5-3748280e983c None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:14.188860 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 715/1412] 10.222.0.40 () {54 vars in 918 bytes} [Tue Jul 12 14:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:14.193540 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b713e-466c-4b27-83a9-9480edfc0790 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:14.197033 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b713e-466c-4b27-83a9-9480edfc0790 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:14.197033 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b713e-466c-4b27-83a9-9480edfc0790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:14.266699 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:14.269825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-5d8b713e-466c-4b27-83a9-9480edfc0790 None None] MFA Rules not processed for user `122fc227de9d4f87a66e4a0d86ff0b16`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:14.271035 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5d8b713e-466c-4b27-83a9-9480edfc0790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:14.389518 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 698/1413] 10.222.0.40 () {58 vars in 1015 bytes} [Tue Jul 12 14:34:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:16.890823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f607327-7410-49c2-a8fe-f6766bfc11ac None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:16.891519 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f607327-7410-49c2-a8fe-f6766bfc11ac None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:16.891519 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f607327-7410-49c2-a8fe-f6766bfc11ac None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:16.892761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:16.898119 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3ef48-adb8-4dd6-a81e-79ee5f02c917 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:16.898570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3ef48-adb8-4dd6-a81e-79ee5f02c917 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:16.898672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3ef48-adb8-4dd6-a81e-79ee5f02c917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:16.963613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-23d3ef48-adb8-4dd6-a81e-79ee5f02c917 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:16.964876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-23d3ef48-adb8-4dd6-a81e-79ee5f02c917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:17.020665 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:17.063309 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:17.105613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f607327-7410-49c2-a8fe-f6766bfc11ac None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:17.107187 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7f607327-7410-49c2-a8fe-f6766bfc11ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:17.255221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f607327-7410-49c2-a8fe-f6766bfc11ac None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:17.329916 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:17.370963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8aa108-f6b9-447e-ae75-3c74e758b385 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:17.371640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aa108-f6b9-447e-ae75-3c74e758b385 service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:17.371925 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aa108-f6b9-447e-ae75-3c74e758b385 service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:17.372225 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aa108-f6b9-447e-ae75-3c74e758b385 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:17.373882 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ad8aa108-f6b9-447e-ae75-3c74e758b385 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:17.463126 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8aa108-f6b9-447e-ae75-3c74e758b385 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:17.464741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8aa108-f6b9-447e-ae75-3c74e758b385 service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:17.483788 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 717/1416] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:18.399119 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245282f0-a51f-4fca-b343-46b83f8562dc None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:18.399772 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245282f0-a51f-4fca-b343-46b83f8562dc None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:18.399772 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245282f0-a51f-4fca-b343-46b83f8562dc None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:18.401316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:18.406286 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e3083-abc9-4c05-92f3-94a2adced5f0 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:18.406698 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e3083-abc9-4c05-92f3-94a2adced5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:18.406841 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e3083-abc9-4c05-92f3-94a2adced5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:18.481896 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-2c5e3083-abc9-4c05-92f3-94a2adced5f0 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:18.483124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-2c5e3083-abc9-4c05-92f3-94a2adced5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:18.511730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:18.582749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:18.734945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245282f0-a51f-4fca-b343-46b83f8562dc None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:18.736580 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-245282f0-a51f-4fca-b343-46b83f8562dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:18.887810 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245282f0-a51f-4fca-b343-46b83f8562dc None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:18.928219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:19.001559 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7a33e-3a22-46b7-93b6-4180ef3e4c5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:19.002211 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7a33e-3a22-46b7-93b6-4180ef3e4c5d service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:19.002491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7a33e-3a22-46b7-93b6-4180ef3e4c5d service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:19.002763 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7a33e-3a22-46b7-93b6-4180ef3e4c5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:19.004464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-1aa7a33e-3a22-46b7-93b6-4180ef3e4c5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:19.094644 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7a33e-3a22-46b7-93b6-4180ef3e4c5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:19.096298 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7a33e-3a22-46b7-93b6-4180ef3e4c5d service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:19.114427 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 701/1419] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:20.002956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e335927-97f1-4c9b-9856-5d143eb0b986 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:20.003535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e335927-97f1-4c9b-9856-5d143eb0b986 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:20.003535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e335927-97f1-4c9b-9856-5d143eb0b986 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:20.004983 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:20.011986 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645395f-97f1-46c4-b7f0-a7c22d805b9b None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:20.012466 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645395f-97f1-46c4-b7f0-a7c22d805b9b None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:20.012569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645395f-97f1-46c4-b7f0-a7c22d805b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:20.065745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:20.088176 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-4645395f-97f1-46c4-b7f0-a7c22d805b9b None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:20.089410 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-4645395f-97f1-46c4-b7f0-a7c22d805b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:20.189544 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:20.343266 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e335927-97f1-4c9b-9856-5d143eb0b986 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:20.344809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7e335927-97f1-4c9b-9856-5d143eb0b986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:20.493375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e335927-97f1-4c9b-9856-5d143eb0b986 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:20.508165 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:20.609676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc65c27-a2aa-40c5-a886-e140fa417bc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:20.610237 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc65c27-a2aa-40c5-a886-e140fa417bc0 service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:20.610520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc65c27-a2aa-40c5-a886-e140fa417bc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:20.610797 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc65c27-a2aa-40c5-a886-e140fa417bc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:20.612498 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-5fc65c27-a2aa-40c5-a886-e140fa417bc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:20.702755 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc65c27-a2aa-40c5-a886-e140fa417bc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:20.704419 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc65c27-a2aa-40c5-a886-e140fa417bc0 service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:20.722098 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 720/1422] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:21.588827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e48b1-98fc-4be8-ab7b-2d7c0f7d59dc None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:21.589387 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e48b1-98fc-4be8-ab7b-2d7c0f7d59dc None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:21.589387 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e48b1-98fc-4be8-ab7b-2d7c0f7d59dc None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:21.590742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:21.595860 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa63ee-dfd7-4086-8092-4fe2c5742ce7 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:21.596274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa63ee-dfd7-4086-8092-4fe2c5742ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:21.596422 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa63ee-dfd7-4086-8092-4fe2c5742ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:21.614682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:21.672359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-b1aa63ee-dfd7-4086-8092-4fe2c5742ce7 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:21.673575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b1aa63ee-dfd7-4086-8092-4fe2c5742ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:21.775718 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:21.927475 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e48b1-98fc-4be8-ab7b-2d7c0f7d59dc None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:21.928990 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-339e48b1-98fc-4be8-ab7b-2d7c0f7d59dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:22.040136 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:22.078228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e48b1-98fc-4be8-ab7b-2d7c0f7d59dc None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:22.192070 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf58d2f-1310-4743-8316-45ac3a308bf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:22.192642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf58d2f-1310-4743-8316-45ac3a308bf0 service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:22.192935 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf58d2f-1310-4743-8316-45ac3a308bf0 service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:22.193202 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf58d2f-1310-4743-8316-45ac3a308bf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:22.194850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-abf58d2f-1310-4743-8316-45ac3a308bf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:22.272690 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:22.286104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf58d2f-1310-4743-8316-45ac3a308bf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:22.287749 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf58d2f-1310-4743-8316-45ac3a308bf0 service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:22.306863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 704/1425] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:23.172163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13d85c-7992-46ed-b7f0-7ba12b6195f4 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.172736 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13d85c-7992-46ed-b7f0-7ba12b6195f4 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.172736 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13d85c-7992-46ed-b7f0-7ba12b6195f4 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.174302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:23.179411 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf324f-4847-4897-8cc1-14b109de51d6 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.179815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf324f-4847-4897-8cc1-14b109de51d6 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.179974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf324f-4847-4897-8cc1-14b109de51d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.255769 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-08bf324f-4847-4897-8cc1-14b109de51d6 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:23.257224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-08bf324f-4847-4897-8cc1-14b109de51d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:23.356204 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:23.508325 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13d85c-7992-46ed-b7f0-7ba12b6195f4 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:23.510603 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-bb13d85c-7992-46ed-b7f0-7ba12b6195f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:23.598500 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:23.663019 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13d85c-7992-46ed-b7f0-7ba12b6195f4 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:23.785733 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1850c9d-47c4-48b2-bbd8-ae67b5c09931 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:23.786386 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1850c9d-47c4-48b2-bbd8-ae67b5c09931 service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:23.786672 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1850c9d-47c4-48b2-bbd8-ae67b5c09931 service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:23.786949 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1850c9d-47c4-48b2-bbd8-ae67b5c09931 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:23.788641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b1850c9d-47c4-48b2-bbd8-ae67b5c09931 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:23.838048 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:23.879399 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1850c9d-47c4-48b2-bbd8-ae67b5c09931 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:23.881270 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1850c9d-47c4-48b2-bbd8-ae67b5c09931 service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:23.900988 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 723/1428] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:24.813265 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0cf3a-90cd-4f81-a8d8-1873b37eb540 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:24.813818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0cf3a-90cd-4f81-a8d8-1873b37eb540 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:24.813943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0cf3a-90cd-4f81-a8d8-1873b37eb540 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:24.815231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:24.820341 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b6d3b-95ad-4efe-ad0e-84d9699b3584 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:24.820755 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b6d3b-95ad-4efe-ad0e-84d9699b3584 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:24.820901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b6d3b-95ad-4efe-ad0e-84d9699b3584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:24.895549 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-551b6d3b-95ad-4efe-ad0e-84d9699b3584 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:24.896749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-551b6d3b-95ad-4efe-ad0e-84d9699b3584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:24.994075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:25.148976 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0cf3a-90cd-4f81-a8d8-1873b37eb540 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:25.151123 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-d6e0cf3a-90cd-4f81-a8d8-1873b37eb540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:25.200273 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:25.300826 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0cf3a-90cd-4f81-a8d8-1873b37eb540 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:25.419189 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206afa5a-9f59-42f1-9598-b8aadee00ab4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:25.419779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206afa5a-9f59-42f1-9598-b8aadee00ab4 service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:25.420064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206afa5a-9f59-42f1-9598-b8aadee00ab4 service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:25.420345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206afa5a-9f59-42f1-9598-b8aadee00ab4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:25.422256 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-206afa5a-9f59-42f1-9598-b8aadee00ab4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:25.429584 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:25.516438 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206afa5a-9f59-42f1-9598-b8aadee00ab4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:25.518054 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206afa5a-9f59-42f1-9598-b8aadee00ab4 service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:25.537349 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 707/1431] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:26.416318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf8850-5cd7-4150-a8dc-1e0e556938ab None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:26.416899 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf8850-5cd7-4150-a8dc-1e0e556938ab None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:26.416899 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf8850-5cd7-4150-a8dc-1e0e556938ab None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:26.418359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:26.423580 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa388ce6-8709-48f5-98ec-b2176a3fe192 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:26.424040 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa388ce6-8709-48f5-98ec-b2176a3fe192 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:26.424158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa388ce6-8709-48f5-98ec-b2176a3fe192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:26.506641 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-fa388ce6-8709-48f5-98ec-b2176a3fe192 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:26.506641 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fa388ce6-8709-48f5-98ec-b2176a3fe192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:26.573704 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:26.602918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:26.755609 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf8850-5cd7-4150-a8dc-1e0e556938ab None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:26.757451 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-eacf8850-5cd7-4150-a8dc-1e0e556938ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:26.776924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:26.913311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf8850-5cd7-4150-a8dc-1e0e556938ab None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:27.002413 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:27.029556 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99240a-940b-45cd-809b-90df6438f561 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:27.030133 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99240a-940b-45cd-809b-90df6438f561 service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:27.030419 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99240a-940b-45cd-809b-90df6438f561 service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:27.030697 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99240a-940b-45cd-809b-90df6438f561 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:27.032435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0f99240a-940b-45cd-809b-90df6438f561 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:27.123421 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99240a-940b-45cd-809b-90df6438f561 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:27.125108 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99240a-940b-45cd-809b-90df6438f561 service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:27.144143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 726/1434] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:28.056687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a18411-abe0-4407-801b-35054d961eb5 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:28.057272 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a18411-abe0-4407-801b-35054d961eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:28.057389 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a18411-abe0-4407-801b-35054d961eb5 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:28.058816 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:28.063807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfa889-30e6-4ce0-affb-0251d0fc2d5d None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:28.064213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfa889-30e6-4ce0-affb-0251d0fc2d5d None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:28.064363 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfa889-30e6-4ce0-affb-0251d0fc2d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:28.139523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-d7bfa889-30e6-4ce0-affb-0251d0fc2d5d None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:28.140895 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d7bfa889-30e6-4ce0-affb-0251d0fc2d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:28.185546 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:28.240353 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:28.393769 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a18411-abe0-4407-801b-35054d961eb5 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:28.395362 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-98a18411-abe0-4407-801b-35054d961eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:28.545408 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a18411-abe0-4407-801b-35054d961eb5 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:28.602006 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:28.662093 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbc709-e35e-4b10-a84f-657d4e74ce7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:28.662661 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbc709-e35e-4b10-a84f-657d4e74ce7b service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:28.662947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbc709-e35e-4b10-a84f-657d4e74ce7b service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:28.663220 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbc709-e35e-4b10-a84f-657d4e74ce7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:28.664988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-66bbc709-e35e-4b10-a84f-657d4e74ce7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:28.756513 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbc709-e35e-4b10-a84f-657d4e74ce7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:28.758221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbc709-e35e-4b10-a84f-657d4e74ce7b service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:28.777621 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 710/1437] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:29.672599 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f7cdf-f683-4f0e-ae75-502cf3a02857 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:29.673170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f7cdf-f683-4f0e-ae75-502cf3a02857 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:29.673170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f7cdf-f683-4f0e-ae75-502cf3a02857 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:29.674541 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:29.679739 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e06b5a-7285-420d-928d-8e43bb4b50f5 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:29.680214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e06b5a-7285-420d-928d-8e43bb4b50f5 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:29.680323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e06b5a-7285-420d-928d-8e43bb4b50f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:29.755348 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-e9e06b5a-7285-420d-928d-8e43bb4b50f5 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:29.756812 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-e9e06b5a-7285-420d-928d-8e43bb4b50f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:29.758837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:29.856963 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:34:30.007006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f7cdf-f683-4f0e-ae75-502cf3a02857 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:30.008486 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f11f7cdf-f683-4f0e-ae75-502cf3a02857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:30.156563 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f7cdf-f683-4f0e-ae75-502cf3a02857 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:30.184061 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:30.270699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b9640-ab12-46c1-8766-194ccd4c7bf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:30.271292 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b9640-ab12-46c1-8766-194ccd4c7bf5 service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:30.271615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b9640-ab12-46c1-8766-194ccd4c7bf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:30.271897 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b9640-ab12-46c1-8766-194ccd4c7bf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:30.273546 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-898b9640-ab12-46c1-8766-194ccd4c7bf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:30.361004 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b9640-ab12-46c1-8766-194ccd4c7bf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:30.362680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b9640-ab12-46c1-8766-194ccd4c7bf5 service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:30.381287 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 729/1440] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:32.322389 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5afcc5-0d90-43bc-8b10-98b50d21a568 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:32.323231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5afcc5-0d90-43bc-8b10-98b50d21a568 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:32.323601 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5afcc5-0d90-43bc-8b10-98b50d21a568 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:32.325071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:34:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:32.330536 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab847c-51bb-4700-b5a8-064b6dc85467 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:32.330965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab847c-51bb-4700-b5a8-064b6dc85467 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:32.331106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab847c-51bb-4700-b5a8-064b6dc85467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:32.371638 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:32.397025 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-72ab847c-51bb-4700-b5a8-064b6dc85467 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:32.398265 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-72ab847c-51bb-4700-b5a8-064b6dc85467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:32.498917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:32.538025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5afcc5-0d90-43bc-8b10-98b50d21a568 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:32.539601 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fe5afcc5-0d90-43bc-8b10-98b50d21a568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:32.645422 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5afcc5-0d90-43bc-8b10-98b50d21a568 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:32.677591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:32.719465 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8710a4-1fd5-46cb-8a26-2a9ee57d7341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:32.720204 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8710a4-1fd5-46cb-8a26-2a9ee57d7341 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:32.720693 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8710a4-1fd5-46cb-8a26-2a9ee57d7341 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:32.721200 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8710a4-1fd5-46cb-8a26-2a9ee57d7341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:32.723197 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-cb8710a4-1fd5-46cb-8a26-2a9ee57d7341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:32.833424 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8710a4-1fd5-46cb-8a26-2a9ee57d7341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:32.834868 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8710a4-1fd5-46cb-8a26-2a9ee57d7341 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:32.853906 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 713/1443] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:35.065995 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f54591-89ce-42df-b802-a9deab2d06a9 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:35.066572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f54591-89ce-42df-b802-a9deab2d06a9 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:35.066572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f54591-89ce-42df-b802-a9deab2d06a9 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:35.068006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:35.074277 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ef384-5e34-4ca9-80c7-276f5e067705 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:35.074734 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ef384-5e34-4ca9-80c7-276f5e067705 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:35.074850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ef384-5e34-4ca9-80c7-276f5e067705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:35.139853 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-633ef384-5e34-4ca9-80c7-276f5e067705 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:35.141053 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-633ef384-5e34-4ca9-80c7-276f5e067705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:35.154686 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:35.242389 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:35.281074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f54591-89ce-42df-b802-a9deab2d06a9 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:35.282670 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-c3f54591-89ce-42df-b802-a9deab2d06a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:35.388836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f54591-89ce-42df-b802-a9deab2d06a9 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:35.401806 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:35.463319 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c8c53-babc-4320-93db-b467174cac6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:35.463970 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c8c53-babc-4320-93db-b467174cac6c service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:35.464254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c8c53-babc-4320-93db-b467174cac6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:35.464533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c8c53-babc-4320-93db-b467174cac6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:35.466188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-2f7c8c53-babc-4320-93db-b467174cac6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:35.576057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c8c53-babc-4320-93db-b467174cac6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:35.577494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c8c53-babc-4320-93db-b467174cac6c service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:35.595730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 732/1446] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:38.041406 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4b9ba-57ab-4081-a45c-795ef4c947e2 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:38.042161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4b9ba-57ab-4081-a45c-795ef4c947e2 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:38.042161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4b9ba-57ab-4081-a45c-795ef4c947e2 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:38.043562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:34:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:38.049224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff7b4d-29da-48a2-a5c1-339d1c0af09d None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:38.049965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff7b4d-29da-48a2-a5c1-339d1c0af09d None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:38.049965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff7b4d-29da-48a2-a5c1-339d1c0af09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:38.106355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:38.125152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-96ff7b4d-29da-48a2-a5c1-339d1c0af09d None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:38.177835 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-96ff7b4d-29da-48a2-a5c1-339d1c0af09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:38.228975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:38.270219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4b9ba-57ab-4081-a45c-795ef4c947e2 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:38.270533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-d9b4b9ba-57ab-4081-a45c-795ef4c947e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:38.381419 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4b9ba-57ab-4081-a45c-795ef4c947e2 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:38.422262 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:38.457340 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011a058-2ae0-458a-81aa-7f0d92766bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:38.457997 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011a058-2ae0-458a-81aa-7f0d92766bbe service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:38.458278 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011a058-2ae0-458a-81aa-7f0d92766bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:38.458552 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011a058-2ae0-458a-81aa-7f0d92766bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:38.460251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-c011a058-2ae0-458a-81aa-7f0d92766bbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:38.577682 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011a058-2ae0-458a-81aa-7f0d92766bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:38.579147 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011a058-2ae0-458a-81aa-7f0d92766bbe service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:38.598603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 716/1449] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:40.798028 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d5942-7fba-4d7b-8038-febe22eb08ab None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:40.798638 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d5942-7fba-4d7b-8038-febe22eb08ab None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:40.798638 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d5942-7fba-4d7b-8038-febe22eb08ab None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:40.799993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:40.805229 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403912e7-0946-4e62-aa94-1228b8672c0d None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:40.805725 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403912e7-0946-4e62-aa94-1228b8672c0d None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:40.805844 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403912e7-0946-4e62-aa94-1228b8672c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:40.883493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-403912e7-0946-4e62-aa94-1228b8672c0d None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:40.885347 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-403912e7-0946-4e62-aa94-1228b8672c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:40.908280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:40.995668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:41.035107 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d5942-7fba-4d7b-8038-febe22eb08ab None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:41.036807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-6d7d5942-7fba-4d7b-8038-febe22eb08ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:41.155690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d5942-7fba-4d7b-8038-febe22eb08ab None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:41.177796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:41.238017 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1236dc-9b07-4c14-b194-087d2d9ad2ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:41.238677 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1236dc-9b07-4c14-b194-087d2d9ad2ae service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:41.238959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1236dc-9b07-4c14-b194-087d2d9ad2ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:41.239233 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1236dc-9b07-4c14-b194-087d2d9ad2ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:41.240966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-8b1236dc-9b07-4c14-b194-087d2d9ad2ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:41.355594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1236dc-9b07-4c14-b194-087d2d9ad2ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:41.357035 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1236dc-9b07-4c14-b194-087d2d9ad2ae service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:41.375717 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 735/1452] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:43.490810 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454a335-4455-4bf8-8476-2314a0b7eb92 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:43.491485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454a335-4455-4bf8-8476-2314a0b7eb92 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:43.491485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454a335-4455-4bf8-8476-2314a0b7eb92 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:43.492785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:43.499290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb6372-5751-4fe1-bf2b-935ef1f12f22 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:43.499835 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb6372-5751-4fe1-bf2b-935ef1f12f22 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:43.499955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb6372-5751-4fe1-bf2b-935ef1f12f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:43.567784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:43.570368 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-75fb6372-5751-4fe1-bf2b-935ef1f12f22 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:43.571779 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-75fb6372-5751-4fe1-bf2b-935ef1f12f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:43.671186 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:43.708288 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454a335-4455-4bf8-8476-2314a0b7eb92 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:43.709833 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b454a335-4455-4bf8-8476-2314a0b7eb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:43.814611 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454a335-4455-4bf8-8476-2314a0b7eb92 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:43.865776 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:43.890296 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11846518-5705-43ec-a43e-5b38cebd4a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:43.890948 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11846518-5705-43ec-a43e-5b38cebd4a7e service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:43.891232 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11846518-5705-43ec-a43e-5b38cebd4a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:43.891541 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11846518-5705-43ec-a43e-5b38cebd4a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:43.893207 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-11846518-5705-43ec-a43e-5b38cebd4a7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:44.002169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11846518-5705-43ec-a43e-5b38cebd4a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:44.003675 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11846518-5705-43ec-a43e-5b38cebd4a7e service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:44.022735 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 719/1455] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:46.174337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb27421-1edc-4f4a-b6bd-d2db66d1c88a None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:46.174895 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb27421-1edc-4f4a-b6bd-d2db66d1c88a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:46.174895 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb27421-1edc-4f4a-b6bd-d2db66d1c88a None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:46.176306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:46.182445 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a79195-bf49-4ab1-a8b5-02fa048fcfb1 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:46.182881 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a79195-bf49-4ab1-a8b5-02fa048fcfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:46.183019 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a79195-bf49-4ab1-a8b5-02fa048fcfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:46.250959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-99a79195-bf49-4ab1-a8b5-02fa048fcfb1 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:46.252205 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-99a79195-bf49-4ab1-a8b5-02fa048fcfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:46.281424 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:46.349728 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:46.388505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb27421-1edc-4f4a-b6bd-d2db66d1c88a None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:46.390037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-8bb27421-1edc-4f4a-b6bd-d2db66d1c88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:46.496402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb27421-1edc-4f4a-b6bd-d2db66d1c88a None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:46.524424 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:46.569904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be742f41-7db9-4f82-8bf3-f2f83df687df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:46.570547 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be742f41-7db9-4f82-8bf3-f2f83df687df service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:46.570831 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be742f41-7db9-4f82-8bf3-f2f83df687df service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:46.571155 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be742f41-7db9-4f82-8bf3-f2f83df687df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:46.572950 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-be742f41-7db9-4f82-8bf3-f2f83df687df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:46.685334 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be742f41-7db9-4f82-8bf3-f2f83df687df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:46.686760 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be742f41-7db9-4f82-8bf3-f2f83df687df service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:46.705706 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 738/1458] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:48.798631 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b0cb9-a0c9-4d2d-8e5c-43de16877e4e None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:48.799203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b0cb9-a0c9-4d2d-8e5c-43de16877e4e None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:48.799203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b0cb9-a0c9-4d2d-8e5c-43de16877e4e None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:48.800764 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:48.806349 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78884d2-865b-439f-9f5b-3dc27211c2a3 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:48.806839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78884d2-865b-439f-9f5b-3dc27211c2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:48.807109 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78884d2-865b-439f-9f5b-3dc27211c2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:48.872258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-b78884d2-865b-439f-9f5b-3dc27211c2a3 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:48.873454 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b78884d2-865b-439f-9f5b-3dc27211c2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:48.881979 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:48.969319 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:49.007220 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b0cb9-a0c9-4d2d-8e5c-43de16877e4e None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:49.008794 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-461b0cb9-a0c9-4d2d-8e5c-43de16877e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:49.119303 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b0cb9-a0c9-4d2d-8e5c-43de16877e4e None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:49.180914 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:49.204042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f24ba-8e9d-4917-b6c4-c55ce6103783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:49.204699 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f24ba-8e9d-4917-b6c4-c55ce6103783 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:49.205034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f24ba-8e9d-4917-b6c4-c55ce6103783 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:49.205311 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f24ba-8e9d-4917-b6c4-c55ce6103783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:49.206974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-216f24ba-8e9d-4917-b6c4-c55ce6103783 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:49.345646 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f24ba-8e9d-4917-b6c4-c55ce6103783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:49.347090 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f24ba-8e9d-4917-b6c4-c55ce6103783 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:49.371602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 722/1461] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:51.552335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b48b9c-d7a8-4545-a1f8-f25471414885 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:51.552861 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b48b9c-d7a8-4545-a1f8-f25471414885 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:51.552861 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b48b9c-d7a8-4545-a1f8-f25471414885 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:51.554204 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:51.560503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3402102-de15-4208-9b6e-68b626ecf7d9 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:51.560942 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3402102-de15-4208-9b6e-68b626ecf7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:51.561053 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3402102-de15-4208-9b6e-68b626ecf7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:51.626337 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-c3402102-de15-4208-9b6e-68b626ecf7d9 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:51.627704 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-c3402102-de15-4208-9b6e-68b626ecf7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:51.668043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:51.728280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:51.766622 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b48b9c-d7a8-4545-a1f8-f25471414885 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:51.768319 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-37b48b9c-d7a8-4545-a1f8-f25471414885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:51.872869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b48b9c-d7a8-4545-a1f8-f25471414885 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:51.911125 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:51.947607 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27c28f-2893-4770-98e7-8a604b546e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:51.948292 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27c28f-2893-4770-98e7-8a604b546e1f service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:51.948576 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27c28f-2893-4770-98e7-8a604b546e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:51.948852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27c28f-2893-4770-98e7-8a604b546e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:51.950486 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-8e27c28f-2893-4770-98e7-8a604b546e1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:52.059215 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27c28f-2893-4770-98e7-8a604b546e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:52.060675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27c28f-2893-4770-98e7-8a604b546e1f service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:52.080312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 741/1464] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:54.243892 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c6dc0-9a1e-4cea-9ba8-153c714b3b0b None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:54.244348 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c6dc0-9a1e-4cea-9ba8-153c714b3b0b None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:54.244444 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c6dc0-9a1e-4cea-9ba8-153c714b3b0b None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:54.245893 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:54.251409 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529f649-8466-42f0-80c9-4ec86e949129 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:54.251840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529f649-8466-42f0-80c9-4ec86e949129 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:54.251958 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529f649-8466-42f0-80c9-4ec86e949129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:54.315320 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-7529f649-8466-42f0-80c9-4ec86e949129 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:54.316534 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7529f649-8466-42f0-80c9-4ec86e949129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:54.336836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:54.417093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:54.453106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c6dc0-9a1e-4cea-9ba8-153c714b3b0b None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:54.454791 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-1f2c6dc0-9a1e-4cea-9ba8-153c714b3b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:54.561451 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c6dc0-9a1e-4cea-9ba8-153c714b3b0b None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:54.629651 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:54.637606 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4b1ec-2393-475f-a17f-25176f765ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:54.638257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4b1ec-2393-475f-a17f-25176f765ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:54.638535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4b1ec-2393-475f-a17f-25176f765ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:54.638806 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4b1ec-2393-475f-a17f-25176f765ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:54.640471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-cfd4b1ec-2393-475f-a17f-25176f765ea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:54.749037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4b1ec-2393-475f-a17f-25176f765ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:54.750471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4b1ec-2393-475f-a17f-25176f765ea1 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:54.768311 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 725/1467] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:34:56.851312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaab4d8-527c-475c-b488-ad7f4a3d9f9c None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:56.851874 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaab4d8-527c-475c-b488-ad7f4a3d9f9c None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:56.851874 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaab4d8-527c-475c-b488-ad7f4a3d9f9c None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:56.853848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:34:56.859252 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c7970-9ed2-4d01-8aa4-7d5893349bbe None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:56.859704 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c7970-9ed2-4d01-8aa4-7d5893349bbe None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:56.859845 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c7970-9ed2-4d01-8aa4-7d5893349bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:56.926480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-0f2c7970-9ed2-4d01-8aa4-7d5893349bbe None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:34:56.927747 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0f2c7970-9ed2-4d01-8aa4-7d5893349bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:56.975872 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:57.025194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:34:57.062140 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaab4d8-527c-475c-b488-ad7f4a3d9f9c None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:34:57.063806 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-fcaab4d8-527c-475c-b488-ad7f4a3d9f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:57.169871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaab4d8-527c-475c-b488-ad7f4a3d9f9c None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:34:57.218051 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:34:57.245123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a76c1-788f-427b-8139-ec84b555b893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:34:57.245781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a76c1-788f-427b-8139-ec84b555b893 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:34:57.246061 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a76c1-788f-427b-8139-ec84b555b893 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:34:57.246354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a76c1-788f-427b-8139-ec84b555b893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:34:57.248217 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e34a76c1-788f-427b-8139-ec84b555b893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:34:57.358117 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a76c1-788f-427b-8139-ec84b555b893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:34:57.359584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a76c1-788f-427b-8139-ec84b555b893 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:34:57.377866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 744/1470] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:34:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:07.023134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=22 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:07.375646 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=66 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:17.306165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba89c4e-37f7-48a4-a906-bbe935604f31 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:17.306797 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba89c4e-37f7-48a4-a906-bbe935604f31 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:17.306797 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba89c4e-37f7-48a4-a906-bbe935604f31 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:17.308148 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 727/1471] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:35:17.313532 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350922d7-146b-414a-a7f5-568d2d907895 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:17.313945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350922d7-146b-414a-a7f5-568d2d907895 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:17.314092 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350922d7-146b-414a-a7f5-568d2d907895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:17.381454 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-350922d7-146b-414a-a7f5-568d2d907895 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:17.382674 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-350922d7-146b-414a-a7f5-568d2d907895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:17.479301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 745/1472] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:17.565202 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7e961-b894-4568-99a4-886609061a88 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:17.565485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7e961-b894-4568-99a4-886609061a88 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:17.565760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7e961-b894-4568-99a4-886609061a88 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:17.567131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 728/1473] 10.222.0.40 () {54 vars in 962 bytes} [Tue Jul 12 14:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:35:17.572656 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1efc4f-f6e2-4bbd-bcb3-b1e7fd93df75 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:17.572950 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1efc4f-f6e2-4bbd-bcb3-b1e7fd93df75 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:17.573235 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1efc4f-f6e2-4bbd-bcb3-b1e7fd93df75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:17.648336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-8b1efc4f-f6e2-4bbd-bcb3-b1e7fd93df75 None None] MFA Rules not processed for user `37932500740c4ccb96358bd751d01598`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:17.649901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-8b1efc4f-f6e2-4bbd-bcb3-b1e7fd93df75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:17.670164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:17.727332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 746/1474] 10.222.0.40 () {58 vars in 1059 bytes} [Tue Jul 12 14:35:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:17.734861 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7e961-b894-4568-99a4-886609061a88 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:17.736362 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fee7e961-b894-4568-99a4-886609061a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:17.840498 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7e961-b894-4568-99a4-886609061a88 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:17.913871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84f3f0-f3d2-47a2-9d63-d8d80573ccb7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37932500740c4ccb96358bd751d01598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:17.915123 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84f3f0-f3d2-47a2-9d63-d8d80573ccb7 service glance] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:17.915439 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84f3f0-f3d2-47a2-9d63-d8d80573ccb7 service glance] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:17.915721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84f3f0-f3d2-47a2-9d63-d8d80573ccb7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:17.917380 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ba84f3f0-f3d2-47a2-9d63-d8d80573ccb7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:17.970350 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:18.025996 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84f3f0-f3d2-47a2-9d63-d8d80573ccb7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:18.027398 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84f3f0-f3d2-47a2-9d63-d8d80573ccb7 service glance] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:18.046329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 729/1475] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:20.185308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f2b01-5509-4ec1-92c4-3c4bd6cdf36e None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:20.185876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f2b01-5509-4ec1-92c4-3c4bd6cdf36e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:20.185876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f2b01-5509-4ec1-92c4-3c4bd6cdf36e None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:20.187401 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 747/1476] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:35:20.192686 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98563256-f5db-40f4-be6f-76dac58fd142 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:20.193142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98563256-f5db-40f4-be6f-76dac58fd142 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:20.193277 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98563256-f5db-40f4-be6f-76dac58fd142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:20.261731 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-98563256-f5db-40f4-be6f-76dac58fd142 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:20.262945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-98563256-f5db-40f4-be6f-76dac58fd142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:20.358488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 730/1477] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:20.382517 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f2b01-5509-4ec1-92c4-3c4bd6cdf36e None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:20.384730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f64f2b01-5509-4ec1-92c4-3c4bd6cdf36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:20.511562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f2b01-5509-4ec1-92c4-3c4bd6cdf36e None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:20.560087 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:20.605601 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84bc2e-7a4e-4f9c-9804-78244d5cb026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:20.606258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84bc2e-7a4e-4f9c-9804-78244d5cb026 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:20.606535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84bc2e-7a4e-4f9c-9804-78244d5cb026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:20.606806 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84bc2e-7a4e-4f9c-9804-78244d5cb026 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:20.607559 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84bc2e-7a4e-4f9c-9804-78244d5cb026 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:20.609310 dv-cinder-820027-12-smb devstack@keystone.service[80633]: WARNING py.warnings [None req-3e84bc2e-7a4e-4f9c-9804-78244d5cb026 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:35:20.609310 dv-cinder-820027-12-smb devstack@keystone.service[80633]: warnings.warn(msg) Jul 12 14:35:20.609310 dv-cinder-820027-12-smb devstack@keystone.service[80633]: Jul 12 14:35:20.610603 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84bc2e-7a4e-4f9c-9804-78244d5cb026 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:20.630059 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 748/1478] 10.222.0.40 () {56 vars in 1108 bytes} [Tue Jul 12 14:35:20 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:35:22.710228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeff67-4c04-437a-a3eb-0f4654e4737f None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:22.710769 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeff67-4c04-437a-a3eb-0f4654e4737f None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:22.710769 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeff67-4c04-437a-a3eb-0f4654e4737f None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:22.712378 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 731/1479] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:35:22.717577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697daab-6631-4122-905d-708feb7dc3e4 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:22.718017 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697daab-6631-4122-905d-708feb7dc3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:22.718152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697daab-6631-4122-905d-708feb7dc3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:22.784352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-d697daab-6631-4122-905d-708feb7dc3e4 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:22.785575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d697daab-6631-4122-905d-708feb7dc3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:22.884143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 749/1480] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:22.926934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caeff67-4c04-437a-a3eb-0f4654e4737f None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:22.928521 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-8caeff67-4c04-437a-a3eb-0f4654e4737f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:22.938854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:23.078766 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caeff67-4c04-437a-a3eb-0f4654e4737f None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:23.160119 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:23.196021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8316661-c4a4-4676-bb35-631d74273cf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:23.196678 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8316661-c4a4-4676-bb35-631d74273cf8 service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:23.196965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8316661-c4a4-4676-bb35-631d74273cf8 service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:23.197243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8316661-c4a4-4676-bb35-631d74273cf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:23.198891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b8316661-c4a4-4676-bb35-631d74273cf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:23.290036 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8316661-c4a4-4676-bb35-631d74273cf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:23.291675 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8316661-c4a4-4676-bb35-631d74273cf8 service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:23.310254 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 732/1481] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:25.528702 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ebd98-a73a-4579-91ed-bb4e5ca3a853 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:25.529236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ebd98-a73a-4579-91ed-bb4e5ca3a853 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:25.529236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ebd98-a73a-4579-91ed-bb4e5ca3a853 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:25.530539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 750/1482] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:35:25.535862 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72eafd-c46e-472e-9f69-08ae3c94cd0f None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:25.536296 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72eafd-c46e-472e-9f69-08ae3c94cd0f None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:25.536417 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72eafd-c46e-472e-9f69-08ae3c94cd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:25.606127 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-fd72eafd-c46e-472e-9f69-08ae3c94cd0f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:25.607390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fd72eafd-c46e-472e-9f69-08ae3c94cd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:25.656815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:25.707329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 733/1483] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:25.745012 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ebd98-a73a-4579-91ed-bb4e5ca3a853 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:25.746595 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-921ebd98-a73a-4579-91ed-bb4e5ca3a853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:25.770421 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:25.851049 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ebd98-a73a-4579-91ed-bb4e5ca3a853 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:25.925356 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b7907-6418-4393-aff1-7edce1d6772e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:25.926000 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b7907-6418-4393-aff1-7edce1d6772e service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:25.926283 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b7907-6418-4393-aff1-7edce1d6772e service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:25.926592 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b7907-6418-4393-aff1-7edce1d6772e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:25.928296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1b7b7907-6418-4393-aff1-7edce1d6772e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:26.003203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:26.040636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b7907-6418-4393-aff1-7edce1d6772e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:26.042090 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b7907-6418-4393-aff1-7edce1d6772e service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:26.060595 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 751/1484] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:28.153024 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd18096-d4d2-493c-a8bf-c8411bc7281d None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:28.153592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd18096-d4d2-493c-a8bf-c8411bc7281d None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:28.153592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd18096-d4d2-493c-a8bf-c8411bc7281d None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:28.154958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 734/1485] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:35:28.160570 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd678a3-4b10-44d9-95db-fb51d377bc0c None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:28.161003 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd678a3-4b10-44d9-95db-fb51d377bc0c None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:28.161138 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd678a3-4b10-44d9-95db-fb51d377bc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:28.344781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-cfd678a3-4b10-44d9-95db-fb51d377bc0c None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:28.345902 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-cfd678a3-4b10-44d9-95db-fb51d377bc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:28.444136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 752/1486] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:28.482624 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd18096-d4d2-493c-a8bf-c8411bc7281d None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:28.484249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-efd18096-d4d2-493c-a8bf-c8411bc7281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:28.589512 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd18096-d4d2-493c-a8bf-c8411bc7281d None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:28.661771 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:28.663492 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677529d-96ce-4cb1-a96b-e72bad8c5bfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:28.664137 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677529d-96ce-4cb1-a96b-e72bad8c5bfc service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:28.664968 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677529d-96ce-4cb1-a96b-e72bad8c5bfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:28.665244 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677529d-96ce-4cb1-a96b-e72bad8c5bfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:28.666891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-f677529d-96ce-4cb1-a96b-e72bad8c5bfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:28.778828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677529d-96ce-4cb1-a96b-e72bad8c5bfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:28.780305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677529d-96ce-4cb1-a96b-e72bad8c5bfc service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:28.799496 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 735/1487] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:31.005659 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a1a25-6dde-4281-a850-d0907140988e None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:31.006497 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a1a25-6dde-4281-a850-d0907140988e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:31.006599 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a1a25-6dde-4281-a850-d0907140988e None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:31.007981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 753/1488] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:35:31.014128 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9563490-ba1d-43dd-ad4c-c0ab9edbcf45 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:31.014533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9563490-ba1d-43dd-ad4c-c0ab9edbcf45 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:31.014695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9563490-ba1d-43dd-ad4c-c0ab9edbcf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:31.084404 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-b9563490-ba1d-43dd-ad4c-c0ab9edbcf45 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:31.085636 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b9563490-ba1d-43dd-ad4c-c0ab9edbcf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:31.140482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:31.185139 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 736/1489] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:31.225615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a1a25-6dde-4281-a850-d0907140988e None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:31.227241 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-3d8a1a25-6dde-4281-a850-d0907140988e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:31.265800 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:31.332609 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a1a25-6dde-4281-a850-d0907140988e None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:31.408301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44d99e-8fd7-490f-b9bc-87927eeb1058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:31.408935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44d99e-8fd7-490f-b9bc-87927eeb1058 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:31.409215 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44d99e-8fd7-490f-b9bc-87927eeb1058 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:31.409536 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44d99e-8fd7-490f-b9bc-87927eeb1058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:31.411174 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-be44d99e-8fd7-490f-b9bc-87927eeb1058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:31.491074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:31.522462 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44d99e-8fd7-490f-b9bc-87927eeb1058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:31.524638 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44d99e-8fd7-490f-b9bc-87927eeb1058 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:31.542964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 754/1490] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:34.070803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6716e-b2c2-4917-8c86-9e8b0cdc24a2 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:34.071407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6716e-b2c2-4917-8c86-9e8b0cdc24a2 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:34.071515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6716e-b2c2-4917-8c86-9e8b0cdc24a2 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:34.072804 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 737/1491] 10.222.0.40 () {54 vars in 926 bytes} [Tue Jul 12 14:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:35:34.078311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c889a-6dd0-4010-9a45-890e91ed5f7d None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:34.078752 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c889a-6dd0-4010-9a45-890e91ed5f7d None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:34.078876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c889a-6dd0-4010-9a45-890e91ed5f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:34.143145 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-a68c889a-6dd0-4010-9a45-890e91ed5f7d None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:35:34.144405 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a68c889a-6dd0-4010-9a45-890e91ed5f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:34.244579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 755/1492] 10.222.0.40 () {58 vars in 1023 bytes} [Tue Jul 12 14:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:35:34.284647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6716e-b2c2-4917-8c86-9e8b0cdc24a2 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:35:34.286218 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-38e6716e-b2c2-4917-8c86-9e8b0cdc24a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:34.390755 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6716e-b2c2-4917-8c86-9e8b0cdc24a2 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:35:34.464550 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecc0ee-f1ca-4ad4-bcd0-f813765f40f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:35:34.465205 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecc0ee-f1ca-4ad4-bcd0-f813765f40f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:35:34.465492 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecc0ee-f1ca-4ad4-bcd0-f813765f40f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:35:34.465774 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecc0ee-f1ca-4ad4-bcd0-f813765f40f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:35:34.467456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-c9ecc0ee-f1ca-4ad4-bcd0-f813765f40f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:35:34.476870 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:34.579093 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecc0ee-f1ca-4ad4-bcd0-f813765f40f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:35:34.580577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecc0ee-f1ca-4ad4-bcd0-f813765f40f6 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:35:34.599466 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 738/1493] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:35:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:35:44.243511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=82 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:35:44.597066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=50 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:32.529427 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86cf58-be72-4994-8916-9908f9eea60e None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:37:32.530136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86cf58-be72-4994-8916-9908f9eea60e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:37:32.530136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86cf58-be72-4994-8916-9908f9eea60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:37:32.630166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-4c86cf58-be72-4994-8916-9908f9eea60e None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:37:32.632100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-4c86cf58-be72-4994-8916-9908f9eea60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:37:32.755139 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 756/1494] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:37:32.764712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0705a6-e9e6-4fbc-906f-abe6384410db None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:37:32.769521 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0705a6-e9e6-4fbc-906f-abe6384410db None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:37:32.769521 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0705a6-e9e6-4fbc-906f-abe6384410db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:37:32.785325 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-9f0705a6-e9e6-4fbc-906f-abe6384410db None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:37:32.787014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-9f0705a6-e9e6-4fbc-906f-abe6384410db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:37:32.796562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 739/1495] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:37:32.801489 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86cf58-be72-4994-8916-9908f9eea60e None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:37:32.815961 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86cf58-be72-4994-8916-9908f9eea60e None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:37:32.821292 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f261bd-42c0-4d06-b4d0-a080d8427ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:37:32.821970 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f261bd-42c0-4d06-b4d0-a080d8427ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:37:32.822251 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f261bd-42c0-4d06-b4d0-a080d8427ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:37:32.822522 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f261bd-42c0-4d06-b4d0-a080d8427ee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:37:32.823260 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f261bd-42c0-4d06-b4d0-a080d8427ee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:37:32.823592 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f261bd-42c0-4d06-b4d0-a080d8427ee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:37:32.824618 dv-cinder-820027-12-smb devstack@keystone.service[80633]: WARNING py.warnings [None req-d3f261bd-42c0-4d06-b4d0-a080d8427ee1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:37:32.824618 dv-cinder-820027-12-smb devstack@keystone.service[80633]: warnings.warn(msg) Jul 12 14:37:32.824618 dv-cinder-820027-12-smb devstack@keystone.service[80633]: Jul 12 14:37:32.825506 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f261bd-42c0-4d06-b4d0-a080d8427ee1 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:37:32.838862 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 757/1496] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:37:32.847305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0705a6-e9e6-4fbc-906f-abe6384410db None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:37:32.857714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0705a6-e9e6-4fbc-906f-abe6384410db None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:37:32.862528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c500ab-a054-4d6e-b6b8-24604b180c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:37:32.863201 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c500ab-a054-4d6e-b6b8-24604b180c22 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:37:32.863508 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c500ab-a054-4d6e-b6b8-24604b180c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:37:32.863781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c500ab-a054-4d6e-b6b8-24604b180c22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:37:32.864500 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c500ab-a054-4d6e-b6b8-24604b180c22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:37:32.867171 dv-cinder-820027-12-smb devstack@keystone.service[80634]: WARNING py.warnings [None req-f6c500ab-a054-4d6e-b6b8-24604b180c22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:37:32.867171 dv-cinder-820027-12-smb devstack@keystone.service[80634]: warnings.warn(msg) Jul 12 14:37:32.867171 dv-cinder-820027-12-smb devstack@keystone.service[80634]: Jul 12 14:37:32.868424 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c500ab-a054-4d6e-b6b8-24604b180c22 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:37:32.999771 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 740/1497] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:37:32 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:37:33.004435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f261bd-42c0-4d06-b4d0-a080d8427ee1 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:37:33.016114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f261bd-42c0-4d06-b4d0-a080d8427ee1 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:37:33.071504 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:33.078888 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d353020-4870-45bf-8ce6-42ef8482d51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:37:33.084477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d353020-4870-45bf-8ce6-42ef8482d51e admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:37:33.084477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d353020-4870-45bf-8ce6-42ef8482d51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:37:33.084477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d353020-4870-45bf-8ce6-42ef8482d51e admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:37:33.084477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d353020-4870-45bf-8ce6-42ef8482d51e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:37:33.084477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: WARNING py.warnings [None req-9d353020-4870-45bf-8ce6-42ef8482d51e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:37:33.084477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: warnings.warn(msg) Jul 12 14:37:33.084477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: Jul 12 14:37:33.085269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d353020-4870-45bf-8ce6-42ef8482d51e admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:37:33.208065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 758/1498] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:37:33 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:37:33.212701 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c500ab-a054-4d6e-b6b8-24604b180c22 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:37:33.224594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c500ab-a054-4d6e-b6b8-24604b180c22 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:37:33.229665 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57d077-766b-4614-9b63-19afbe786ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:37:33.233432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57d077-766b-4614-9b63-19afbe786ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:37:33.233432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57d077-766b-4614-9b63-19afbe786ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:37:33.233432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57d077-766b-4614-9b63-19afbe786ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:37:33.233432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57d077-766b-4614-9b63-19afbe786ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:37:33.233432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: WARNING py.warnings [None req-4f57d077-766b-4614-9b63-19afbe786ce7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:37:33.233432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: warnings.warn(msg) Jul 12 14:37:33.233432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: Jul 12 14:37:33.234335 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57d077-766b-4614-9b63-19afbe786ce7 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:37:33.249409 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 741/1499] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:37:33.253826 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d353020-4870-45bf-8ce6-42ef8482d51e admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:37:33.265154 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d353020-4870-45bf-8ce6-42ef8482d51e admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:37:33.270528 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de61eb-e47e-4e9d-b312-65c30ce51796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:37:33.271368 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de61eb-e47e-4e9d-b312-65c30ce51796 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:37:33.271725 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de61eb-e47e-4e9d-b312-65c30ce51796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:37:33.272116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de61eb-e47e-4e9d-b312-65c30ce51796 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:37:33.272903 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de61eb-e47e-4e9d-b312-65c30ce51796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:37:33.274132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: WARNING py.warnings [None req-46de61eb-e47e-4e9d-b312-65c30ce51796 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:37:33.274132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: warnings.warn(msg) Jul 12 14:37:33.274132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: Jul 12 14:37:33.275568 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de61eb-e47e-4e9d-b312-65c30ce51796 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:37:33.293462 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 759/1500] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:37:33.298251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57d077-766b-4614-9b63-19afbe786ce7 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:37:33.309790 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57d077-766b-4614-9b63-19afbe786ce7 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:37:33.314914 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4568b36-79fd-4d17-8e2e-918d3914151f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:37:33.315964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4568b36-79fd-4d17-8e2e-918d3914151f admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:37:33.316394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4568b36-79fd-4d17-8e2e-918d3914151f admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:37:33.316802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4568b36-79fd-4d17-8e2e-918d3914151f admin admin] PATH_INFO: `/v3/projects/7eb42cdcb4424b819fe68afc5f2c04f4/users/1be31d40ec0c447b8491ebf9be00bcfb/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:37:33.335147 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4568b36-79fd-4d17-8e2e-918d3914151f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb42cdcb4424b819fe68afc5f2c04f4, user_id=1be31d40ec0c447b8491ebf9be00bcfb, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:37:33.336241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: WARNING py.warnings [None req-d4568b36-79fd-4d17-8e2e-918d3914151f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:37:33.336241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: warnings.warn(msg) Jul 12 14:37:33.336241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: Jul 12 14:37:33.338619 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4568b36-79fd-4d17-8e2e-918d3914151f admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:37:33.414500 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 742/1501] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:37:33 2022] PUT /identity/v3/projects/7eb42cdcb4424b819fe68afc5f2c04f4/users/1be31d40ec0c447b8491ebf9be00bcfb/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:37:33.428696 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c7b73-ffb9-411c-a758-f92bae8b8f5e None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:37:33.429064 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c7b73-ffb9-411c-a758-f92bae8b8f5e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:37:33.429411 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c7b73-ffb9-411c-a758-f92bae8b8f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:37:33.461611 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-059c7b73-ffb9-411c-a758-f92bae8b8f5e None None] MFA Rules not processed for user `1be31d40ec0c447b8491ebf9be00bcfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:37:33.463219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-059c7b73-ffb9-411c-a758-f92bae8b8f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:37:33.539727 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 760/1502] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:37:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:37:33.559072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a15d14-f784-4d24-81bf-3f4736837272 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:37:33.559482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a15d14-f784-4d24-81bf-3f4736837272 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:37:33.559774 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a15d14-f784-4d24-81bf-3f4736837272 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:37:33.561160 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 743/1503] 10.222.0.40 () {54 vars in 963 bytes} [Tue Jul 12 14:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 14:37:33.567017 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70aacd6-56b4-424c-9e19-8f5b0805b07a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:37:33.569690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70aacd6-56b4-424c-9e19-8f5b0805b07a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:37:33.569690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70aacd6-56b4-424c-9e19-8f5b0805b07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:37:33.641817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-a70aacd6-56b4-424c-9e19-8f5b0805b07a None None] MFA Rules not processed for user `aeb6850303f54a16bb23f05165844dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:37:33.642952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a70aacd6-56b4-424c-9e19-8f5b0805b07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:37:33.725983 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 761/1504] 10.222.0.40 () {58 vars in 1060 bytes} [Tue Jul 12 14:37:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:37:33.733907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a15d14-f784-4d24-81bf-3f4736837272 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:37:33.746121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a15d14-f784-4d24-81bf-3f4736837272 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:37:33.749882 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9db2f4-007f-4fe3-8a20-379f3d5dc322 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:37:33.750603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9db2f4-007f-4fe3-8a20-379f3d5dc322 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:37:33.750918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9db2f4-007f-4fe3-8a20-379f3d5dc322 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:37:33.751202 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9db2f4-007f-4fe3-8a20-379f3d5dc322 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:37:33.761178 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9db2f4-007f-4fe3-8a20-379f3d5dc322 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:37:33.762679 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9db2f4-007f-4fe3-8a20-379f3d5dc322 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:37:33.773497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 744/1505] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:37:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:37:33.824480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effbc55-dd7a-47f9-9b29-e12f0cab0f8e None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:37:33.824946 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effbc55-dd7a-47f9-9b29-e12f0cab0f8e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:37:33.825206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effbc55-dd7a-47f9-9b29-e12f0cab0f8e None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:37:33.826677 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 762/1506] 10.222.0.40 () {52 vars in 829 bytes} [Tue Jul 12 14:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:37:33.830910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9db2f4-007f-4fe3-8a20-379f3d5dc322 service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:37:33.901210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9db2f4-007f-4fe3-8a20-379f3d5dc322 service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:37:33.905887 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c1a49-ecbd-4047-916b-bccfda904afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:37:33.906769 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c1a49-ecbd-4047-916b-bccfda904afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:37:33.907049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c1a49-ecbd-4047-916b-bccfda904afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:37:33.907352 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c1a49-ecbd-4047-916b-bccfda904afe admin admin] PATH_INFO: `/v3/users/1be31d40ec0c447b8491ebf9be00bcfb` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:37:33.908645 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c1a49-ecbd-4047-916b-bccfda904afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be31d40ec0c447b8491ebf9be00bcfb)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:37:33.909620 dv-cinder-820027-12-smb devstack@keystone.service[80634]: WARNING py.warnings [None req-627c1a49-ecbd-4047-916b-bccfda904afe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:37:33.909620 dv-cinder-820027-12-smb devstack@keystone.service[80634]: warnings.warn(msg) Jul 12 14:37:33.909620 dv-cinder-820027-12-smb devstack@keystone.service[80634]: Jul 12 14:37:33.910843 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c1a49-ecbd-4047-916b-bccfda904afe admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:37:34.159763 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-627c1a49-ecbd-4047-916b-bccfda904afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be31d40ec0c447b8491ebf9be00bcfb'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:37:34.182234 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-627c1a49-ecbd-4047-916b-bccfda904afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be31d40ec0c447b8491ebf9be00bcfb'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:37:34.197402 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-627c1a49-ecbd-4047-916b-bccfda904afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be31d40ec0c447b8491ebf9be00bcfb'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:37:34.204317 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:34.293261 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-627c1a49-ecbd-4047-916b-bccfda904afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be31d40ec0c447b8491ebf9be00bcfb'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:37:34.293984 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-627c1a49-ecbd-4047-916b-bccfda904afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be31d40ec0c447b8491ebf9be00bcfb'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:37:34.300821 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 745/1507] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:37:33 2022] DELETE /identity/v3/users/1be31d40ec0c447b8491ebf9be00bcfb => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:37:34.305530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeac449-b98a-4f37-b0f5-2a52bf884677 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:37:34.305819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeac449-b98a-4f37-b0f5-2a52bf884677 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:37:34.306104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeac449-b98a-4f37-b0f5-2a52bf884677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:37:34.330848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-7eeac449-b98a-4f37-b0f5-2a52bf884677 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:37:34.332104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7eeac449-b98a-4f37-b0f5-2a52bf884677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:37:34.342895 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:34.395423 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 763/1508] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:37:34.406906 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c1a49-ecbd-4047-916b-bccfda904afe admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:37:34.408479 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-627c1a49-ecbd-4047-916b-bccfda904afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:37:34.494419 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c1a49-ecbd-4047-916b-bccfda904afe admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:37:34.498178 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e7284-2d50-4141-8567-3ba1af0c857d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:37:34.498845 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e7284-2d50-4141-8567-3ba1af0c857d service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:37:34.499135 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e7284-2d50-4141-8567-3ba1af0c857d service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:37:34.499482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e7284-2d50-4141-8567-3ba1af0c857d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:37:34.510788 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e7284-2d50-4141-8567-3ba1af0c857d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:37:34.512283 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e7284-2d50-4141-8567-3ba1af0c857d service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:37:34.523455 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 746/1509] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:37:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:37:35.066227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeac449-b98a-4f37-b0f5-2a52bf884677 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:37:35.068340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7eeac449-b98a-4f37-b0f5-2a52bf884677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:37:35.080441 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeac449-b98a-4f37-b0f5-2a52bf884677 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:37:35.086013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdfe7b-b7bb-487d-b8b4-0933ee6cdbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:37:35.086897 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdfe7b-b7bb-487d-b8b4-0933ee6cdbe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:37:35.087485 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdfe7b-b7bb-487d-b8b4-0933ee6cdbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:37:35.087485 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdfe7b-b7bb-487d-b8b4-0933ee6cdbe8 admin admin] PATH_INFO: `/v3/projects/7eb42cdcb4424b819fe68afc5f2c04f4` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:37:35.088690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdfe7b-b7bb-487d-b8b4-0933ee6cdbe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb42cdcb4424b819fe68afc5f2c04f4)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:37:35.089730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: WARNING py.warnings [None req-cabdfe7b-b7bb-487d-b8b4-0933ee6cdbe8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:37:35.089730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: warnings.warn(msg) Jul 12 14:37:35.089730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: Jul 12 14:37:35.091001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdfe7b-b7bb-487d-b8b4-0933ee6cdbe8 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:37:35.241356 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-cabdfe7b-b7bb-487d-b8b4-0933ee6cdbe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb42cdcb4424b819fe68afc5f2c04f4', 'request_id': 'req-cabdfe7b-b7bb-487d-b8b4-0933ee6cdbe8'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:37:35.339002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-cabdfe7b-b7bb-487d-b8b4-0933ee6cdbe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb42cdcb4424b819fe68afc5f2c04f4', 'request_id': 'req-cabdfe7b-b7bb-487d-b8b4-0933ee6cdbe8'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:37:35.346051 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-cabdfe7b-b7bb-487d-b8b4-0933ee6cdbe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb42cdcb4424b819fe68afc5f2c04f4', 'request_id': 'req-cabdfe7b-b7bb-487d-b8b4-0933ee6cdbe8'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:37:35.365011 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-cabdfe7b-b7bb-487d-b8b4-0933ee6cdbe8 admin admin] The token cache is being invalidate because project 7eb42cdcb4424b819fe68afc5f2c04f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:37:35.365302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-cabdfe7b-b7bb-487d-b8b4-0933ee6cdbe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:37:35.365989 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-cabdfe7b-b7bb-487d-b8b4-0933ee6cdbe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:37:35.367667 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 764/1510] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:37:35 2022] DELETE /identity/v3/projects/7eb42cdcb4424b819fe68afc5f2c04f4 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:37:44.517770 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:37:45.361563 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:29.180368 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7632bd-021b-41eb-87ec-fa37a4eddee7 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:29.180985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7632bd-021b-41eb-87ec-fa37a4eddee7 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:29.180985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7632bd-021b-41eb-87ec-fa37a4eddee7 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:29.182314 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:39:29.187289 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffe82e-edfc-45ae-bb63-e45a98467ae5 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:29.187821 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffe82e-edfc-45ae-bb63-e45a98467ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:29.187926 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffe82e-edfc-45ae-bb63-e45a98467ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:29.207585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-f8ffe82e-edfc-45ae-bb63-e45a98467ae5 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:29.208802 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f8ffe82e-edfc-45ae-bb63-e45a98467ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:29.273848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:29.426670 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7632bd-021b-41eb-87ec-fa37a4eddee7 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:29.430269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-6d7632bd-021b-41eb-87ec-fa37a4eddee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:29.535033 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7632bd-021b-41eb-87ec-fa37a4eddee7 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:29.540560 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332c68b-dceb-4f6f-933e-b097e0c84d5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:29.541225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332c68b-dceb-4f6f-933e-b097e0c84d5b service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:29.541513 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332c68b-dceb-4f6f-933e-b097e0c84d5b service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:29.541792 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332c68b-dceb-4f6f-933e-b097e0c84d5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:29.550666 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332c68b-dceb-4f6f-933e-b097e0c84d5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:29.552356 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332c68b-dceb-4f6f-933e-b097e0c84d5b service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:29.561985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 748/1513] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:30.404598 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94700fc8-7fd6-4e38-b460-34dbbd973e58 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:30.405145 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94700fc8-7fd6-4e38-b460-34dbbd973e58 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:30.405145 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94700fc8-7fd6-4e38-b460-34dbbd973e58 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:30.406431 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:39:30.411994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f13e5-9d30-4099-a56c-361cfae3585a None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:30.412502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f13e5-9d30-4099-a56c-361cfae3585a None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:30.412630 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f13e5-9d30-4099-a56c-361cfae3585a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:30.430840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-835f13e5-9d30-4099-a56c-361cfae3585a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:30.432081 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-835f13e5-9d30-4099-a56c-361cfae3585a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:30.440745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:30.592062 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94700fc8-7fd6-4e38-b460-34dbbd973e58 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:30.606395 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94700fc8-7fd6-4e38-b460-34dbbd973e58 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:30.612614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923c528-9a59-4ec2-891c-086133f320f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:30.613301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923c528-9a59-4ec2-891c-086133f320f9 service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:30.613536 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923c528-9a59-4ec2-891c-086133f320f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:30.614068 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923c528-9a59-4ec2-891c-086133f320f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:30.622080 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923c528-9a59-4ec2-891c-086133f320f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:30.623697 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923c528-9a59-4ec2-891c-086133f320f9 service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:30.634259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 767/1516] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:31.796701 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbfe4e-5e0c-46f6-bc04-0a0f1d0eb014 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:31.797316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbfe4e-5e0c-46f6-bc04-0a0f1d0eb014 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:31.797316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbfe4e-5e0c-46f6-bc04-0a0f1d0eb014 None None] PATH_INFO: `/v3` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:31.798737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 750/1517] 10.222.0.59 () {54 vars in 925 bytes} [Tue Jul 12 14:39:31 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:39:31.807263 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be86f0-6182-47ff-a065-7709d9ea5e66 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:31.807704 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be86f0-6182-47ff-a065-7709d9ea5e66 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:31.807837 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be86f0-6182-47ff-a065-7709d9ea5e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:31.856794 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-e4be86f0-6182-47ff-a065-7709d9ea5e66 None None] MFA Rules not processed for user `0a3704fdba154f13ad3bf8ac00c916c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:31.858007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e4be86f0-6182-47ff-a065-7709d9ea5e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:31.929378 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 768/1518] 10.222.0.59 () {58 vars in 1015 bytes} [Tue Jul 12 14:39:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:40.425975 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=49 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:41.893689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49f4c2-120f-456a-b44e-985c21d85495 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:41.894329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49f4c2-120f-456a-b44e-985c21d85495 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:41.894329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49f4c2-120f-456a-b44e-985c21d85495 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:41.895673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 751/1519] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:39:41.900599 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60854f-5f5d-4fb1-a5fd-d8131213f552 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:41.901005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60854f-5f5d-4fb1-a5fd-d8131213f552 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:41.901152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60854f-5f5d-4fb1-a5fd-d8131213f552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:41.919760 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-cf60854f-5f5d-4fb1-a5fd-d8131213f552 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:41.920960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-cf60854f-5f5d-4fb1-a5fd-d8131213f552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:41.929783 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 769/1520] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:42.095237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49f4c2-120f-456a-b44e-985c21d85495 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:42.112239 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49f4c2-120f-456a-b44e-985c21d85495 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:42.119563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28984f-8b10-4628-b03a-5b58bbd688ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:42.120411 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28984f-8b10-4628-b03a-5b58bbd688ad service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:42.120706 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28984f-8b10-4628-b03a-5b58bbd688ad service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:42.120991 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28984f-8b10-4628-b03a-5b58bbd688ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:42.133766 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28984f-8b10-4628-b03a-5b58bbd688ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:42.135552 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28984f-8b10-4628-b03a-5b58bbd688ad service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:42.146818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 752/1521] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:42.569466 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb38527-e8af-46c5-818b-79cd42745fe0 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:42.569762 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb38527-e8af-46c5-818b-79cd42745fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:42.570080 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb38527-e8af-46c5-818b-79cd42745fe0 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:42.571494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 770/1522] 10.222.0.40 () {54 vars in 960 bytes} [Tue Jul 12 14:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:39:42.576708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02f5f4-20bd-4399-9aa1-fedcca65932e None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:42.577000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02f5f4-20bd-4399-9aa1-fedcca65932e None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:42.577281 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02f5f4-20bd-4399-9aa1-fedcca65932e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:42.596958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-fb02f5f4-20bd-4399-9aa1-fedcca65932e None None] MFA Rules not processed for user `0a3704fdba154f13ad3bf8ac00c916c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:42.598218 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fb02f5f4-20bd-4399-9aa1-fedcca65932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:42.607338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 753/1523] 10.222.0.40 () {58 vars in 1057 bytes} [Tue Jul 12 14:39:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:42.615400 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb38527-e8af-46c5-818b-79cd42745fe0 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:42.629043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb38527-e8af-46c5-818b-79cd42745fe0 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:42.634479 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d626c-dfb9-44dd-a4dd-a7ecf92a653f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a3704fdba154f13ad3bf8ac00c916c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:42.635245 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d626c-dfb9-44dd-a4dd-a7ecf92a653f service placement] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:42.635570 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d626c-dfb9-44dd-a4dd-a7ecf92a653f service placement] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:42.635848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d626c-dfb9-44dd-a4dd-a7ecf92a653f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:42.645640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d626c-dfb9-44dd-a4dd-a7ecf92a653f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:42.647233 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d626c-dfb9-44dd-a4dd-a7ecf92a653f service placement] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:42.657828 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 771/1524] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:43.031885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011743f-fc50-427d-b5fd-0df41c8d4510 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:43.032446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011743f-fc50-427d-b5fd-0df41c8d4510 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:43.032552 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011743f-fc50-427d-b5fd-0df41c8d4510 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:43.033989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 14:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:39:43.039337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e7041-cda5-4e53-aa50-77a8f5db5678 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:43.039877 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e7041-cda5-4e53-aa50-77a8f5db5678 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:43.040013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e7041-cda5-4e53-aa50-77a8f5db5678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:43.061244 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-ec9e7041-cda5-4e53-aa50-77a8f5db5678 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:43.062458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ec9e7041-cda5-4e53-aa50-77a8f5db5678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:43.071593 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 14:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:43.228533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011743f-fc50-427d-b5fd-0df41c8d4510 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:43.245468 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011743f-fc50-427d-b5fd-0df41c8d4510 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:43.252408 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afd3a2-6746-419c-887d-3733655f576d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:43.253089 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afd3a2-6746-419c-887d-3733655f576d service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:43.253377 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afd3a2-6746-419c-887d-3733655f576d service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:43.253662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afd3a2-6746-419c-887d-3733655f576d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:43.263698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afd3a2-6746-419c-887d-3733655f576d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:43.265322 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afd3a2-6746-419c-887d-3733655f576d service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:43.275437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 755/1527] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:47.211823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6854ed4-22ac-4a32-87a4-6864752ea666 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:47.212396 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6854ed4-22ac-4a32-87a4-6864752ea666 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:47.212396 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6854ed4-22ac-4a32-87a4-6864752ea666 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:47.213742 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:39:47.218981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbd9ff-93de-46b4-9bef-050b99102108 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:47.220025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbd9ff-93de-46b4-9bef-050b99102108 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:47.220530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbd9ff-93de-46b4-9bef-050b99102108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:47.238890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-2ccbd9ff-93de-46b4-9bef-050b99102108 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:47.240132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2ccbd9ff-93de-46b4-9bef-050b99102108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:47.248428 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:47.327618 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6854ed4-22ac-4a32-87a4-6864752ea666 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:47.329956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a6854ed4-22ac-4a32-87a4-6864752ea666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:47.359095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:39:47.391171 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6854ed4-22ac-4a32-87a4-6864752ea666 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:47.395613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80040e56-ec2a-488c-a1ae-cf9c0fa72d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:47.396268 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80040e56-ec2a-488c-a1ae-cf9c0fa72d79 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:47.396557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80040e56-ec2a-488c-a1ae-cf9c0fa72d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:47.396863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80040e56-ec2a-488c-a1ae-cf9c0fa72d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:47.406198 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80040e56-ec2a-488c-a1ae-cf9c0fa72d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:47.407900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80040e56-ec2a-488c-a1ae-cf9c0fa72d79 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:47.417380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 774/1530] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:49.496654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a942e0-5654-49db-99b8-f0dff3169b36 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.497226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a942e0-5654-49db-99b8-f0dff3169b36 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.497226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a942e0-5654-49db-99b8-f0dff3169b36 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.498550 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:39:49.504720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c9c90-17f5-4a99-8e6b-484b8a02a0c5 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.505199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c9c90-17f5-4a99-8e6b-484b8a02a0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.505296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c9c90-17f5-4a99-8e6b-484b8a02a0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.523207 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-aa5c9c90-17f5-4a99-8e6b-484b8a02a0c5 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:49.524467 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-aa5c9c90-17f5-4a99-8e6b-484b8a02a0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:49.532639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:49.569384 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a942e0-5654-49db-99b8-f0dff3169b36 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:49.580209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a942e0-5654-49db-99b8-f0dff3169b36 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:49.583733 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccee04-6c1e-4c7e-bd24-3318c48d6db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:49.584369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccee04-6c1e-4c7e-bd24-3318c48d6db7 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:49.584650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccee04-6c1e-4c7e-bd24-3318c48d6db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:49.584926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccee04-6c1e-4c7e-bd24-3318c48d6db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:49.594245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccee04-6c1e-4c7e-bd24-3318c48d6db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:49.596380 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccee04-6c1e-4c7e-bd24-3318c48d6db7 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:49.606026 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 758/1533] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:53.282397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908589a-226b-4a95-ae5b-8f6affd517a4 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:53.282972 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908589a-226b-4a95-ae5b-8f6affd517a4 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:53.282972 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908589a-226b-4a95-ae5b-8f6affd517a4 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:53.284426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:39:53.289814 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7a4c3-3e9d-4c01-ae92-b5de873444c9 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:53.290234 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7a4c3-3e9d-4c01-ae92-b5de873444c9 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:53.290381 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7a4c3-3e9d-4c01-ae92-b5de873444c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:53.308815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-a3f7a4c3-3e9d-4c01-ae92-b5de873444c9 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:53.310023 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-a3f7a4c3-3e9d-4c01-ae92-b5de873444c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:53.318173 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:53.627458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908589a-226b-4a95-ae5b-8f6affd517a4 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:53.629155 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f908589a-226b-4a95-ae5b-8f6affd517a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:53.687415 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908589a-226b-4a95-ae5b-8f6affd517a4 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:53.691613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f7a60-f29b-4f6c-993c-bbab469e58eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:53.692292 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f7a60-f29b-4f6c-993c-bbab469e58eb service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:53.692577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f7a60-f29b-4f6c-993c-bbab469e58eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:53.692853 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f7a60-f29b-4f6c-993c-bbab469e58eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:53.702240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f7a60-f29b-4f6c-993c-bbab469e58eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:53.704463 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f7a60-f29b-4f6c-993c-bbab469e58eb service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:53.714401 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 777/1536] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:39:55.899632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791b00a-9394-4d9c-9812-7115d4384a4a None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:55.900184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791b00a-9394-4d9c-9812-7115d4384a4a None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:55.900315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791b00a-9394-4d9c-9812-7115d4384a4a None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:55.901792 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 14:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:39:55.909152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c4987-74a1-4833-954d-8d942b39029a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:55.910029 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c4987-74a1-4833-954d-8d942b39029a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:55.910206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c4987-74a1-4833-954d-8d942b39029a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:55.931152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-3d7c4987-74a1-4833-954d-8d942b39029a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:39:55.932422 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-3d7c4987-74a1-4833-954d-8d942b39029a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:55.941304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 14:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:39:56.255444 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791b00a-9394-4d9c-9812-7115d4384a4a None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:39:56.257471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5791b00a-9394-4d9c-9812-7115d4384a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:39:56.271598 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791b00a-9394-4d9c-9812-7115d4384a4a None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:39:56.275361 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2702072-c07b-44db-91c5-da5e26b5e88f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:39:56.276025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2702072-c07b-44db-91c5-da5e26b5e88f service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:39:56.276303 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2702072-c07b-44db-91c5-da5e26b5e88f service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:39:56.276582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2702072-c07b-44db-91c5-da5e26b5e88f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:39:56.287243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2702072-c07b-44db-91c5-da5e26b5e88f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:39:56.288752 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2702072-c07b-44db-91c5-da5e26b5e88f service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:39:56.299545 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 761/1539] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:40:05.924791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=47 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:40:06.294465 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=33 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:36.252212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf50a7-8914-4898-8f3e-1fa242b6e75f None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.253188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf50a7-8914-4898-8f3e-1fa242b6e75f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.253188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf50a7-8914-4898-8f3e-1fa242b6e75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.280874 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-f6bf50a7-8914-4898-8f3e-1fa242b6e75f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:36.282130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f6bf50a7-8914-4898-8f3e-1fa242b6e75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:36.284315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b1c63-8298-4bab-84c6-7b4d6e438646 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.284875 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b1c63-8298-4bab-84c6-7b4d6e438646 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.284875 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b1c63-8298-4bab-84c6-7b4d6e438646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.309970 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 779/1540] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:36.317109 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-5e3b1c63-8298-4bab-84c6-7b4d6e438646 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:36.318354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5e3b1c63-8298-4bab-84c6-7b4d6e438646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:36.320852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0806f-4a71-40da-883d-b7fec0c456af None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.321285 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0806f-4a71-40da-883d-b7fec0c456af None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.321771 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0806f-4a71-40da-883d-b7fec0c456af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.333764 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 762/1541] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 12 14:41:36.335118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0057e15-4c98-409c-9cf3-610ef8065ef3 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.335449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0057e15-4c98-409c-9cf3-610ef8065ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.337190 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0057e15-4c98-409c-9cf3-610ef8065ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.374863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-b2b0806f-4a71-40da-883d-b7fec0c456af None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:36.376148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b2b0806f-4a71-40da-883d-b7fec0c456af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:36.378353 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-d0057e15-4c98-409c-9cf3-610ef8065ef3 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:36.379559 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-d0057e15-4c98-409c-9cf3-610ef8065ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:36.393249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 780/1542] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:36.394569 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4108f5b-b7fd-4a07-aae5-266c505b394f None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.394866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4108f5b-b7fd-4a07-aae5-266c505b394f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.396059 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4108f5b-b7fd-4a07-aae5-266c505b394f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.403780 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 763/1543] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:36.405072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a3c57-95fd-417d-9c32-81867d94d52b None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.405371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a3c57-95fd-417d-9c32-81867d94d52b None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.405660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a3c57-95fd-417d-9c32-81867d94d52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.439505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-c4108f5b-b7fd-4a07-aae5-266c505b394f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:36.440748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-c4108f5b-b7fd-4a07-aae5-266c505b394f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:36.445860 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-ad7a3c57-95fd-417d-9c32-81867d94d52b None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:36.447408 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ad7a3c57-95fd-417d-9c32-81867d94d52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:36.452300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 781/1544] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:36.453639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4108f5b-b7fd-4a07-aae5-266c505b394f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:36.460770 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 764/1545] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:36.463084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cd068-947f-4126-82f8-a6c8274bf2bf None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.464195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cd068-947f-4126-82f8-a6c8274bf2bf None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.464684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cd068-947f-4126-82f8-a6c8274bf2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.470346 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4108f5b-b7fd-4a07-aae5-266c505b394f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:36.475898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57d7aa-121e-4d7c-bf53-e604cf753952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:36.476992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57d7aa-121e-4d7c-bf53-e604cf753952 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.477442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57d7aa-121e-4d7c-bf53-e604cf753952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.477882 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57d7aa-121e-4d7c-bf53-e604cf753952 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.478781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57d7aa-121e-4d7c-bf53-e604cf753952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:41:36.479300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57d7aa-121e-4d7c-bf53-e604cf753952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:36.481075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57d7aa-121e-4d7c-bf53-e604cf753952 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:36.490401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-394cd068-947f-4126-82f8-a6c8274bf2bf None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:36.491810 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-394cd068-947f-4126-82f8-a6c8274bf2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:36.496514 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 782/1546] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:41:36.498716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93e1cd-fc27-419f-9de1-652f5440823f None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.499174 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93e1cd-fc27-419f-9de1-652f5440823f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.499739 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93e1cd-fc27-419f-9de1-652f5440823f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.501419 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 765/1547] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:36.503182 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c07cd1-4dfe-4070-a160-9b6f9ad93ec3 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.503631 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c07cd1-4dfe-4070-a160-9b6f9ad93ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.503989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c07cd1-4dfe-4070-a160-9b6f9ad93ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.524263 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-6f93e1cd-fc27-419f-9de1-652f5440823f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:36.525800 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-6f93e1cd-fc27-419f-9de1-652f5440823f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:36.535373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 783/1548] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:36.536566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93e1cd-fc27-419f-9de1-652f5440823f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:36.548902 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93e1cd-fc27-419f-9de1-652f5440823f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:36.554249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabb942-8b46-4333-b6aa-7044101b3c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:36.555504 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabb942-8b46-4333-b6aa-7044101b3c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.555966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabb942-8b46-4333-b6aa-7044101b3c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.556424 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabb942-8b46-4333-b6aa-7044101b3c8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.557367 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabb942-8b46-4333-b6aa-7044101b3c8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:41:36.558003 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabb942-8b46-4333-b6aa-7044101b3c8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:36.561157 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabb942-8b46-4333-b6aa-7044101b3c8c admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:36.576045 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 784/1549] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:41:36.577973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702acb0e-35ae-4ba1-b1cf-75a6a184d861 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.578619 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702acb0e-35ae-4ba1-b1cf-75a6a184d861 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.579060 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702acb0e-35ae-4ba1-b1cf-75a6a184d861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.604424 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-702acb0e-35ae-4ba1-b1cf-75a6a184d861 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:36.607100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-702acb0e-35ae-4ba1-b1cf-75a6a184d861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:36.615228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 785/1550] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:36.616128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702acb0e-35ae-4ba1-b1cf-75a6a184d861 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:36.626857 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702acb0e-35ae-4ba1-b1cf-75a6a184d861 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:36.632132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeff6c8-cd45-4fa2-8b6c-476626d0dee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:36.632817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeff6c8-cd45-4fa2-8b6c-476626d0dee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.633101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeff6c8-cd45-4fa2-8b6c-476626d0dee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.633424 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeff6c8-cd45-4fa2-8b6c-476626d0dee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.634087 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeff6c8-cd45-4fa2-8b6c-476626d0dee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:36.635121 dv-cinder-820027-12-smb devstack@keystone.service[80633]: WARNING py.warnings [None req-fbeff6c8-cd45-4fa2-8b6c-476626d0dee0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:41:36.635121 dv-cinder-820027-12-smb devstack@keystone.service[80633]: warnings.warn(msg) Jul 12 14:41:36.635121 dv-cinder-820027-12-smb devstack@keystone.service[80633]: Jul 12 14:41:36.636369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeff6c8-cd45-4fa2-8b6c-476626d0dee0 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:36.662000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-e1c07cd1-4dfe-4070-a160-9b6f9ad93ec3 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:36.670235 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-e1c07cd1-4dfe-4070-a160-9b6f9ad93ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:36.672032 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 766/1551] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:36.672810 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c07cd1-4dfe-4070-a160-9b6f9ad93ec3 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:36.682354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c07cd1-4dfe-4070-a160-9b6f9ad93ec3 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:36.689089 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626dbec-715d-4339-9e61-add7a0317bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:36.689765 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626dbec-715d-4339-9e61-add7a0317bed admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.690046 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626dbec-715d-4339-9e61-add7a0317bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.690321 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626dbec-715d-4339-9e61-add7a0317bed admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.691171 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626dbec-715d-4339-9e61-add7a0317bed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:41:36.691546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626dbec-715d-4339-9e61-add7a0317bed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:36.692574 dv-cinder-820027-12-smb devstack@keystone.service[80634]: WARNING py.warnings [None req-b626dbec-715d-4339-9e61-add7a0317bed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:41:36.692574 dv-cinder-820027-12-smb devstack@keystone.service[80634]: warnings.warn(msg) Jul 12 14:41:36.692574 dv-cinder-820027-12-smb devstack@keystone.service[80634]: Jul 12 14:41:36.693556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626dbec-715d-4339-9e61-add7a0317bed admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:36.706036 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 767/1552] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:41:36.708285 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43862556-168a-4671-80b5-7e69de9be790 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.708580 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43862556-168a-4671-80b5-7e69de9be790 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.708919 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43862556-168a-4671-80b5-7e69de9be790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.728044 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-43862556-168a-4671-80b5-7e69de9be790 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:36.729307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-43862556-168a-4671-80b5-7e69de9be790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:36.732930 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 786/1553] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:41:36 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:36.734316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f231f5f-d3a9-4e83-beca-fe273a758e81 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.734671 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f231f5f-d3a9-4e83-beca-fe273a758e81 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.734972 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f231f5f-d3a9-4e83-beca-fe273a758e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.756058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-7f231f5f-d3a9-4e83-beca-fe273a758e81 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:36.756058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7f231f5f-d3a9-4e83-beca-fe273a758e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:36.803778 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 768/1554] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:36.807986 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43862556-168a-4671-80b5-7e69de9be790 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:36.818486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43862556-168a-4671-80b5-7e69de9be790 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:36.823374 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49353fc-a528-4119-bd0a-465273585607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:36.824039 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49353fc-a528-4119-bd0a-465273585607 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.824320 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49353fc-a528-4119-bd0a-465273585607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.824504 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 787/1555] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:36.826127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab440d3-b008-420f-826d-9bc764b6a756 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.826430 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab440d3-b008-420f-826d-9bc764b6a756 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.826670 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab440d3-b008-420f-826d-9bc764b6a756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.831619 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49353fc-a528-4119-bd0a-465273585607 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.832718 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49353fc-a528-4119-bd0a-465273585607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:36.835165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49353fc-a528-4119-bd0a-465273585607 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:36.846495 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-7ab440d3-b008-420f-826d-9bc764b6a756 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:36.847740 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7ab440d3-b008-420f-826d-9bc764b6a756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:36.856867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 788/1556] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:36.857664 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab440d3-b008-420f-826d-9bc764b6a756 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:36.868158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab440d3-b008-420f-826d-9bc764b6a756 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:36.873587 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc604a9-3fa1-4916-8f44-e53a949f33ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:36.874272 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc604a9-3fa1-4916-8f44-e53a949f33ce admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.874558 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc604a9-3fa1-4916-8f44-e53a949f33ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.874839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc604a9-3fa1-4916-8f44-e53a949f33ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.875617 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc604a9-3fa1-4916-8f44-e53a949f33ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:41:36.875927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc604a9-3fa1-4916-8f44-e53a949f33ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:36.877553 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc604a9-3fa1-4916-8f44-e53a949f33ce admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:36.890504 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 789/1557] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:41:36.892200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a9f6d-f714-41dc-ac46-0825de980d0d None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.892567 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a9f6d-f714-41dc-ac46-0825de980d0d None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.893928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a9f6d-f714-41dc-ac46-0825de980d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.912862 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-5d4a9f6d-f714-41dc-ac46-0825de980d0d None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:36.914207 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-5d4a9f6d-f714-41dc-ac46-0825de980d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:36.925339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 790/1558] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:36.926640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a9f6d-f714-41dc-ac46-0825de980d0d None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:36.940604 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a9f6d-f714-41dc-ac46-0825de980d0d None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:36.945628 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de28b2-aace-46c6-81fe-7bb77d264ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:36.946106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de28b2-aace-46c6-81fe-7bb77d264ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:36.946396 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de28b2-aace-46c6-81fe-7bb77d264ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:36.946673 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de28b2-aace-46c6-81fe-7bb77d264ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:36.947405 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de28b2-aace-46c6-81fe-7bb77d264ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:36.949318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de28b2-aace-46c6-81fe-7bb77d264ea6 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:37.069737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 769/1559] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:41:36 2022] POST /identity/v3/projects => generated 381 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:37.070746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49353fc-a528-4119-bd0a-465273585607 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:37.092164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 791/1560] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:41:36 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:37.093069 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de28b2-aace-46c6-81fe-7bb77d264ea6 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:37.128719 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:37.144196 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49353fc-a528-4119-bd0a-465273585607 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:37.160104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de28b2-aace-46c6-81fe-7bb77d264ea6 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:37.164860 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896d3b6-406e-4775-a6f2-ade8fae7a7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:37.165614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896d3b6-406e-4775-a6f2-ade8fae7a7fe admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:37.165958 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896d3b6-406e-4775-a6f2-ade8fae7a7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:37.166226 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896d3b6-406e-4775-a6f2-ade8fae7a7fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:37.166960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896d3b6-406e-4775-a6f2-ade8fae7a7fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:41:37.167267 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896d3b6-406e-4775-a6f2-ade8fae7a7fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:37.170520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896d3b6-406e-4775-a6f2-ade8fae7a7fe admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:37.185055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 792/1561] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:41:37.186756 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491c4ff-1b71-4814-9d3a-0a6393970baa None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:37.187053 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491c4ff-1b71-4814-9d3a-0a6393970baa None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:37.187352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491c4ff-1b71-4814-9d3a-0a6393970baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:37.193909 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:37.206886 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-d491c4ff-1b71-4814-9d3a-0a6393970baa None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:37.208135 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d491c4ff-1b71-4814-9d3a-0a6393970baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:37.210941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8037e-701f-4d35-893b-1c2b55a5f8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:37.211683 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8037e-701f-4d35-893b-1c2b55a5f8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:37.212005 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8037e-701f-4d35-893b-1c2b55a5f8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:37.212231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8037e-701f-4d35-893b-1c2b55a5f8b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:37.212929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8037e-701f-4d35-893b-1c2b55a5f8b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:37.214026 dv-cinder-820027-12-smb devstack@keystone.service[80634]: WARNING py.warnings [None req-dac8037e-701f-4d35-893b-1c2b55a5f8b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:41:37.214026 dv-cinder-820027-12-smb devstack@keystone.service[80634]: warnings.warn(msg) Jul 12 14:41:37.214026 dv-cinder-820027-12-smb devstack@keystone.service[80634]: Jul 12 14:41:37.215254 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8037e-701f-4d35-893b-1c2b55a5f8b1 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:37.217408 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 793/1562] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:37.218744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcbaa7-3b82-4a4b-b340-441eb1488413 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:37.219101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcbaa7-3b82-4a4b-b340-441eb1488413 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:37.219476 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcbaa7-3b82-4a4b-b340-441eb1488413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:37.238580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-d9dcbaa7-3b82-4a4b-b340-441eb1488413 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:37.239874 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d9dcbaa7-3b82-4a4b-b340-441eb1488413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:37.248383 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 794/1563] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:37.249236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcbaa7-3b82-4a4b-b340-441eb1488413 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:37.259141 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcbaa7-3b82-4a4b-b340-441eb1488413 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:37.265046 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dedfdc-a970-4665-b4be-c1b7899e3476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:37.265714 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dedfdc-a970-4665-b4be-c1b7899e3476 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:37.265995 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dedfdc-a970-4665-b4be-c1b7899e3476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:37.266268 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dedfdc-a970-4665-b4be-c1b7899e3476 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:37.266967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dedfdc-a970-4665-b4be-c1b7899e3476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:37.269157 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dedfdc-a970-4665-b4be-c1b7899e3476 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:37.310302 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 770/1564] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:41:37 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:37.311170 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8037e-701f-4d35-893b-1c2b55a5f8b1 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:37.321654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8037e-701f-4d35-893b-1c2b55a5f8b1 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:37.327524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e53ff-1a46-4b4f-aeb0-611a38ec43fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:37.332577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e53ff-1a46-4b4f-aeb0-611a38ec43fb admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:37.332577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e53ff-1a46-4b4f-aeb0-611a38ec43fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:37.332577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e53ff-1a46-4b4f-aeb0-611a38ec43fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:37.332577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e53ff-1a46-4b4f-aeb0-611a38ec43fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:41:37.332577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e53ff-1a46-4b4f-aeb0-611a38ec43fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:37.332577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e53ff-1a46-4b4f-aeb0-611a38ec43fb admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:37.345360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 771/1565] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:41:37.346205 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e53ff-1a46-4b4f-aeb0-611a38ec43fb admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:37.356772 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e53ff-1a46-4b4f-aeb0-611a38ec43fb admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:37.361835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3b11a-fc90-4346-8ee1-ea415e9ef9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:37.362503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3b11a-fc90-4346-8ee1-ea415e9ef9aa admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:37.362787 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3b11a-fc90-4346-8ee1-ea415e9ef9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:37.363065 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3b11a-fc90-4346-8ee1-ea415e9ef9aa admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:37.363801 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3b11a-fc90-4346-8ee1-ea415e9ef9aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:37.365776 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3b11a-fc90-4346-8ee1-ea415e9ef9aa admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:37.377998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 795/1566] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:41:37 2022] POST /identity/v3/projects => generated 405 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:37.377998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dedfdc-a970-4665-b4be-c1b7899e3476 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:37.447906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dedfdc-a970-4665-b4be-c1b7899e3476 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:37.454121 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a3cb6-7067-48e2-91ed-38753e58b260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:37.454895 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a3cb6-7067-48e2-91ed-38753e58b260 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:37.455236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a3cb6-7067-48e2-91ed-38753e58b260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:37.455569 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a3cb6-7067-48e2-91ed-38753e58b260 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:37.456362 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a3cb6-7067-48e2-91ed-38753e58b260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:37.458378 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a3cb6-7067-48e2-91ed-38753e58b260 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:37.464993 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 772/1567] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:41:37 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:37.466383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3b11a-fc90-4346-8ee1-ea415e9ef9aa admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:37.476979 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3b11a-fc90-4346-8ee1-ea415e9ef9aa admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:37.481941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27021455-cda7-4ce6-9597-974c9f074d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:37.482781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27021455-cda7-4ce6-9597-974c9f074d78 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:37.483066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27021455-cda7-4ce6-9597-974c9f074d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:37.483384 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27021455-cda7-4ce6-9597-974c9f074d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:37.484096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27021455-cda7-4ce6-9597-974c9f074d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:37.486018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27021455-cda7-4ce6-9597-974c9f074d78 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:37.619091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 796/1568] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:41:37 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:37.619954 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a3cb6-7067-48e2-91ed-38753e58b260 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:37.630624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a3cb6-7067-48e2-91ed-38753e58b260 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:37.636560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1af4f0-fb32-417a-85c6-756c59d15ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:37.636832 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1af4f0-fb32-417a-85c6-756c59d15ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:37.637120 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1af4f0-fb32-417a-85c6-756c59d15ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:37.637449 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1af4f0-fb32-417a-85c6-756c59d15ba4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:37.639261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1af4f0-fb32-417a-85c6-756c59d15ba4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:41:37.639833 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1af4f0-fb32-417a-85c6-756c59d15ba4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:37.643047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1af4f0-fb32-417a-85c6-756c59d15ba4 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:37.646198 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 773/1569] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:41:37 2022] POST /identity/v3/projects => generated 389 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:37.647130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27021455-cda7-4ce6-9597-974c9f074d78 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:37.673823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 797/1570] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:41:37.673823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1af4f0-fb32-417a-85c6-756c59d15ba4 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:37.681518 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1af4f0-fb32-417a-85c6-756c59d15ba4 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:37.730908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27021455-cda7-4ce6-9597-974c9f074d78 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:37.737357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b83f0-069e-473f-8926-04764484cae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:37.738045 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b83f0-069e-473f-8926-04764484cae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:37.738381 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b83f0-069e-473f-8926-04764484cae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:37.738666 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b83f0-069e-473f-8926-04764484cae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:37.739438 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b83f0-069e-473f-8926-04764484cae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:41:37.739751 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b83f0-069e-473f-8926-04764484cae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:37.741402 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b83f0-069e-473f-8926-04764484cae0 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:37.748902 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a44f22-6ae2-45ce-b262-482b317a1234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:37.749768 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a44f22-6ae2-45ce-b262-482b317a1234 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:37.750053 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a44f22-6ae2-45ce-b262-482b317a1234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:37.750330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a44f22-6ae2-45ce-b262-482b317a1234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:37.751063 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a44f22-6ae2-45ce-b262-482b317a1234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:37.752711 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a44f22-6ae2-45ce-b262-482b317a1234 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:37.755093 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 774/1571] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:41:37.759450 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b83f0-069e-473f-8926-04764484cae0 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:37.766094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 798/1572] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:37.767132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a44f22-6ae2-45ce-b262-482b317a1234 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:37.767259 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b83f0-069e-473f-8926-04764484cae0 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:37.772070 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a4ff6-d661-40c8-9416-31f0c64337c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:37.772726 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a4ff6-d661-40c8-9416-31f0c64337c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:37.772971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:37.773137 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a4ff6-d661-40c8-9416-31f0c64337c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:37.773372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a4ff6-d661-40c8-9416-31f0c64337c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:37.774081 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a4ff6-d661-40c8-9416-31f0c64337c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:37.776068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a4ff6-d661-40c8-9416-31f0c64337c4 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:37.779067 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a44f22-6ae2-45ce-b262-482b317a1234 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:37.784039 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd663c54-bd65-4a4a-a9c5-f00ae217ad73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:37.788174 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd663c54-bd65-4a4a-a9c5-f00ae217ad73 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:37.788174 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd663c54-bd65-4a4a-a9c5-f00ae217ad73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:37.788174 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd663c54-bd65-4a4a-a9c5-f00ae217ad73 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:37.788174 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd663c54-bd65-4a4a-a9c5-f00ae217ad73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:37.788174 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd663c54-bd65-4a4a-a9c5-f00ae217ad73 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:37.923230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 775/1573] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:41:37 2022] POST /identity/v3/projects => generated 393 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:37.924101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a4ff6-d661-40c8-9416-31f0c64337c4 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:37.954420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 799/1574] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:41:37 2022] POST /identity/v3/users => generated 303 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:37.961188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd663c54-bd65-4a4a-a9c5-f00ae217ad73 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:37.972493 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd663c54-bd65-4a4a-a9c5-f00ae217ad73 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:37.983141 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:37.997604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a4ff6-d661-40c8-9416-31f0c64337c4 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.002576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1828e5c-c6bd-4d99-b627-fcd892933c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.003265 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828e5c-c6bd-4d99-b627-fcd892933c02 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.003571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828e5c-c6bd-4d99-b627-fcd892933c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.003866 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828e5c-c6bd-4d99-b627-fcd892933c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.004591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1828e5c-c6bd-4d99-b627-fcd892933c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.006554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1828e5c-c6bd-4d99-b627-fcd892933c02 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.018153 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 776/1575] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:38.019315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1828e5c-c6bd-4d99-b627-fcd892933c02 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:38.029596 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1828e5c-c6bd-4d99-b627-fcd892933c02 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.034568 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8aed28-d085-4842-a4ea-80db81525b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.035261 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aed28-d085-4842-a4ea-80db81525b8d admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.035603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aed28-d085-4842-a4ea-80db81525b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.035863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aed28-d085-4842-a4ea-80db81525b8d admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.036571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8aed28-d085-4842-a4ea-80db81525b8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.038502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8aed28-d085-4842-a4ea-80db81525b8d admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.047959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19ed62-5bdb-4320-be79-3bd6762664a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.048639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19ed62-5bdb-4320-be79-3bd6762664a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.048923 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19ed62-5bdb-4320-be79-3bd6762664a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.049199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19ed62-5bdb-4320-be79-3bd6762664a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.049958 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19ed62-5bdb-4320-be79-3bd6762664a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.051583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19ed62-5bdb-4320-be79-3bd6762664a5 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.062911 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 800/1576] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:38.063849 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19ed62-5bdb-4320-be79-3bd6762664a5 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:38.073662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19ed62-5bdb-4320-be79-3bd6762664a5 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.078571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7efde-8b9f-4007-acfa-f71207bf2b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.079249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7efde-8b9f-4007-acfa-f71207bf2b2c admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.079564 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7efde-8b9f-4007-acfa-f71207bf2b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.079840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7efde-8b9f-4007-acfa-f71207bf2b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.080532 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7efde-8b9f-4007-acfa-f71207bf2b2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.082437 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7efde-8b9f-4007-acfa-f71207bf2b2c admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.138801 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 777/1577] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:41:38 2022] POST /identity/v3/users => generated 295 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:38.139657 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8aed28-d085-4842-a4ea-80db81525b8d admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:38.149284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8aed28-d085-4842-a4ea-80db81525b8d admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.153986 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4b353-dd27-4b9b-8fb2-8253a8fb20d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.154627 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4b353-dd27-4b9b-8fb2-8253a8fb20d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.154912 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4b353-dd27-4b9b-8fb2-8253a8fb20d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.155189 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4b353-dd27-4b9b-8fb2-8253a8fb20d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.155908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4b353-dd27-4b9b-8fb2-8253a8fb20d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.157793 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4b353-dd27-4b9b-8fb2-8253a8fb20d2 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.241486 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 801/1578] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:41:38 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:38.241486 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7efde-8b9f-4007-acfa-f71207bf2b2c admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:38.289064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 778/1579] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:41:38 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:38.289064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4b353-dd27-4b9b-8fb2-8253a8fb20d2 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:38.311900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7efde-8b9f-4007-acfa-f71207bf2b2c admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.355372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4b353-dd27-4b9b-8fb2-8253a8fb20d2 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.360970 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac828d58-51b0-49ac-a330-22606538f2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.361705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac828d58-51b0-49ac-a330-22606538f2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.361995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac828d58-51b0-49ac-a330-22606538f2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.362374 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac828d58-51b0-49ac-a330-22606538f2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.362969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac828d58-51b0-49ac-a330-22606538f2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.365011 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac828d58-51b0-49ac-a330-22606538f2f2 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.383609 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24be1b6-3260-4bde-9363-fcfa08cd0607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.384359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24be1b6-3260-4bde-9363-fcfa08cd0607 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.384627 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24be1b6-3260-4bde-9363-fcfa08cd0607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.384912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24be1b6-3260-4bde-9363-fcfa08cd0607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.385669 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24be1b6-3260-4bde-9363-fcfa08cd0607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.387376 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24be1b6-3260-4bde-9363-fcfa08cd0607 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.399332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 802/1580] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:38.405777 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24be1b6-3260-4bde-9363-fcfa08cd0607 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:38.406456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:38.412119 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24be1b6-3260-4bde-9363-fcfa08cd0607 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.417025 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69440d88-e8b7-400c-9854-3121e20d1d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.417713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69440d88-e8b7-400c-9854-3121e20d1d61 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.417997 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69440d88-e8b7-400c-9854-3121e20d1d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.418308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69440d88-e8b7-400c-9854-3121e20d1d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.419719 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69440d88-e8b7-400c-9854-3121e20d1d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.421585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69440d88-e8b7-400c-9854-3121e20d1d61 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.432334 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 803/1581] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:38.433450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69440d88-e8b7-400c-9854-3121e20d1d61 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:38.443815 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69440d88-e8b7-400c-9854-3121e20d1d61 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.448660 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2953da-bf99-467f-8745-db71ef49f2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.449341 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2953da-bf99-467f-8745-db71ef49f2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.449629 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2953da-bf99-467f-8745-db71ef49f2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.449926 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2953da-bf99-467f-8745-db71ef49f2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.450663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2953da-bf99-467f-8745-db71ef49f2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.452349 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2953da-bf99-467f-8745-db71ef49f2a7 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.463665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 804/1582] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:38.464626 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2953da-bf99-467f-8745-db71ef49f2a7 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:38.475551 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2953da-bf99-467f-8745-db71ef49f2a7 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.480534 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d168a-a675-4295-93fd-59ca55e7fdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.481906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d168a-a675-4295-93fd-59ca55e7fdb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.482279 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d168a-a675-4295-93fd-59ca55e7fdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.482557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d168a-a675-4295-93fd-59ca55e7fdb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.483343 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d168a-a675-4295-93fd-59ca55e7fdb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.484994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d168a-a675-4295-93fd-59ca55e7fdb2 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.496036 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 805/1583] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:38.496908 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d168a-a675-4295-93fd-59ca55e7fdb2 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:38.499419 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 779/1584] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:41:38 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:38.500584 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac828d58-51b0-49ac-a330-22606538f2f2 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:38.508033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d168a-a675-4295-93fd-59ca55e7fdb2 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.515917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac828d58-51b0-49ac-a330-22606538f2f2 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.516102 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9986717-9926-43e6-8980-48b4f84d1354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.516102 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9986717-9926-43e6-8980-48b4f84d1354 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.516102 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9986717-9926-43e6-8980-48b4f84d1354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.516102 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9986717-9926-43e6-8980-48b4f84d1354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.516439 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9986717-9926-43e6-8980-48b4f84d1354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.516638 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9986717-9926-43e6-8980-48b4f84d1354 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.517239 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35f32b-4060-4787-89cf-25a813e67b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.517926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35f32b-4060-4787-89cf-25a813e67b92 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.518216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35f32b-4060-4787-89cf-25a813e67b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.518517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35f32b-4060-4787-89cf-25a813e67b92 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.519221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35f32b-4060-4787-89cf-25a813e67b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.521226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35f32b-4060-4787-89cf-25a813e67b92 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.527940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 806/1585] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:38.529474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9986717-9926-43e6-8980-48b4f84d1354 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:38.540957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9986717-9926-43e6-8980-48b4f84d1354 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.547157 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b570dd-3697-4ea4-8900-05ff7ebc2b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.548352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b570dd-3697-4ea4-8900-05ff7ebc2b20 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.548352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b570dd-3697-4ea4-8900-05ff7ebc2b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.548672 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b570dd-3697-4ea4-8900-05ff7ebc2b20 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.549217 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b570dd-3697-4ea4-8900-05ff7ebc2b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.551168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b570dd-3697-4ea4-8900-05ff7ebc2b20 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.641981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 780/1586] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:41:38 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:38.643040 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35f32b-4060-4787-89cf-25a813e67b92 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:38.653803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35f32b-4060-4787-89cf-25a813e67b92 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.654010 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 807/1587] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:41:38 2022] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:38.654843 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b570dd-3697-4ea4-8900-05ff7ebc2b20 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:38.662026 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124e882-98e6-4f8c-be8b-b34414b29416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.663049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124e882-98e6-4f8c-be8b-b34414b29416 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.663361 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124e882-98e6-4f8c-be8b-b34414b29416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.663643 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124e882-98e6-4f8c-be8b-b34414b29416 admin admin] PATH_INFO: `/v3/projects/adcc39cd54b840b488f530a0346a607f/users/0068ad02f128494faa67e80b092c1deb/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.665513 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b570dd-3697-4ea4-8900-05ff7ebc2b20 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.670986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddd573-505f-4f51-8493-0a6b41487b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.671685 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddd573-505f-4f51-8493-0a6b41487b88 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.671992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddd573-505f-4f51-8493-0a6b41487b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.672272 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddd573-505f-4f51-8493-0a6b41487b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.673006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddd573-505f-4f51-8493-0a6b41487b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.674621 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddd573-505f-4f51-8493-0a6b41487b88 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.681700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124e882-98e6-4f8c-be8b-b34414b29416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adcc39cd54b840b488f530a0346a607f, user_id=0068ad02f128494faa67e80b092c1deb, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.684465 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124e882-98e6-4f8c-be8b-b34414b29416 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.691474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 808/1588] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:38.692301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddd573-505f-4f51-8493-0a6b41487b88 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:38.703390 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddd573-505f-4f51-8493-0a6b41487b88 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.708312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1debc66-3cf7-409c-b7ae-d8cf31a66fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.709232 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1debc66-3cf7-409c-b7ae-d8cf31a66fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.709519 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1debc66-3cf7-409c-b7ae-d8cf31a66fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.709806 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1debc66-3cf7-409c-b7ae-d8cf31a66fcd admin admin] PATH_INFO: `/v3/projects/10504da2d3104d1eaf857e8ede525043/users/b85e40eecf3d4caaaa4ca7b36fff69a5/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.725894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1debc66-3cf7-409c-b7ae-d8cf31a66fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=10504da2d3104d1eaf857e8ede525043, user_id=b85e40eecf3d4caaaa4ca7b36fff69a5, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.726936 dv-cinder-820027-12-smb devstack@keystone.service[80633]: WARNING py.warnings [None req-e1debc66-3cf7-409c-b7ae-d8cf31a66fcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:41:38.726936 dv-cinder-820027-12-smb devstack@keystone.service[80633]: warnings.warn(msg) Jul 12 14:41:38.726936 dv-cinder-820027-12-smb devstack@keystone.service[80633]: Jul 12 14:41:38.728900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1debc66-3cf7-409c-b7ae-d8cf31a66fcd admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.768182 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 781/1589] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:41:38 2022] PUT /identity/v3/projects/adcc39cd54b840b488f530a0346a607f/users/0068ad02f128494faa67e80b092c1deb/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:38.769069 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124e882-98e6-4f8c-be8b-b34414b29416 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:38.792503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 809/1590] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:41:38 2022] PUT /identity/v3/projects/10504da2d3104d1eaf857e8ede525043/users/b85e40eecf3d4caaaa4ca7b36fff69a5/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:38.792811 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1debc66-3cf7-409c-b7ae-d8cf31a66fcd admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:38.833589 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:38.848365 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124e882-98e6-4f8c-be8b-b34414b29416 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.872073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1debc66-3cf7-409c-b7ae-d8cf31a66fcd admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.877521 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808cc1cb-a919-4710-8527-f58db3976e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.878284 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cc1cb-a919-4710-8527-f58db3976e15 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.878641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cc1cb-a919-4710-8527-f58db3976e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.878988 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cc1cb-a919-4710-8527-f58db3976e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.879894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cc1cb-a919-4710-8527-f58db3976e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.881897 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cc1cb-a919-4710-8527-f58db3976e15 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.894509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 810/1591] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:38.900218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808cc1cb-a919-4710-8527-f58db3976e15 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:38.913845 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808cc1cb-a919-4710-8527-f58db3976e15 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.921234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084b399-d289-4003-8aba-4170658bfb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.921477 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1439d5-3398-4297-b3e2-d61f96085d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.922365 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084b399-d289-4003-8aba-4170658bfb99 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.922653 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1439d5-3398-4297-b3e2-d61f96085d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.922999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084b399-d289-4003-8aba-4170658bfb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.923097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1439d5-3398-4297-b3e2-d61f96085d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.923580 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1439d5-3398-4297-b3e2-d61f96085d2e admin admin] PATH_INFO: `/v3/projects/c19e0b34089e4d939521683a57f5730c/users/87fcc3fa1cbe4afeaa0e455f2631411a/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.923749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084b399-d289-4003-8aba-4170658bfb99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.924978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084b399-d289-4003-8aba-4170658bfb99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.927874 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084b399-d289-4003-8aba-4170658bfb99 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.946567 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 811/1592] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:38.946567 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084b399-d289-4003-8aba-4170658bfb99 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:38.948990 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1439d5-3398-4297-b3e2-d61f96085d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19e0b34089e4d939521683a57f5730c, user_id=87fcc3fa1cbe4afeaa0e455f2631411a, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.953797 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1439d5-3398-4297-b3e2-d61f96085d2e admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.955141 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084b399-d289-4003-8aba-4170658bfb99 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.960008 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a35d64-ef5e-4b7d-93d1-0e03a03b1f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.960658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a35d64-ef5e-4b7d-93d1-0e03a03b1f48 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.960939 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a35d64-ef5e-4b7d-93d1-0e03a03b1f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.961213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a35d64-ef5e-4b7d-93d1-0e03a03b1f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.961934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a35d64-ef5e-4b7d-93d1-0e03a03b1f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.963528 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a35d64-ef5e-4b7d-93d1-0e03a03b1f48 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:38.974932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 812/1593] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:38.975801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a35d64-ef5e-4b7d-93d1-0e03a03b1f48 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:38.985688 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a35d64-ef5e-4b7d-93d1-0e03a03b1f48 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:38.990503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55157f9-2d81-4d23-82a3-cc0064df512d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:38.991154 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55157f9-2d81-4d23-82a3-cc0064df512d admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:38.991464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55157f9-2d81-4d23-82a3-cc0064df512d admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:38.991743 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55157f9-2d81-4d23-82a3-cc0064df512d admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:38.992458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55157f9-2d81-4d23-82a3-cc0064df512d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:38.994081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55157f9-2d81-4d23-82a3-cc0064df512d admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:39.004238 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 813/1594] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:39.005057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55157f9-2d81-4d23-82a3-cc0064df512d admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:39.016154 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55157f9-2d81-4d23-82a3-cc0064df512d admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:39.022423 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8690b02-f37b-4cd1-8189-4daad3fee66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:39.023254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8690b02-f37b-4cd1-8189-4daad3fee66d admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.023566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8690b02-f37b-4cd1-8189-4daad3fee66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.023839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8690b02-f37b-4cd1-8189-4daad3fee66d admin admin] PATH_INFO: `/v3/projects/578d6f8e3843421d898264e40882c5b8/users/e04786555e674f31840b4e3b6adda371/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.040599 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8690b02-f37b-4cd1-8189-4daad3fee66d admin admin] RBAC: Authorizing `identity:create_grant(project_id=578d6f8e3843421d898264e40882c5b8, user_id=e04786555e674f31840b4e3b6adda371, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:39.043446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8690b02-f37b-4cd1-8189-4daad3fee66d admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:39.045278 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 782/1595] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:41:38 2022] PUT /identity/v3/projects/c19e0b34089e4d939521683a57f5730c/users/87fcc3fa1cbe4afeaa0e455f2631411a/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:39.046883 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d74be-e8b0-438d-aeb7-5799e0983b28 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.047181 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d74be-e8b0-438d-aeb7-5799e0983b28 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.047913 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d74be-e8b0-438d-aeb7-5799e0983b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.066007 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-ad2d74be-e8b0-438d-aeb7-5799e0983b28 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:39.067336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ad2d74be-e8b0-438d-aeb7-5799e0983b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:39.115693 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 814/1596] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:41:39 2022] PUT /identity/v3/projects/578d6f8e3843421d898264e40882c5b8/users/e04786555e674f31840b4e3b6adda371/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:39.117004 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80816c0-ef1e-49c5-84b9-b3b840d18e2a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.117287 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80816c0-ef1e-49c5-84b9-b3b840d18e2a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.117563 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80816c0-ef1e-49c5-84b9-b3b840d18e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.124995 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:39.133036 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 783/1597] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:39.133908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d74be-e8b0-438d-aeb7-5799e0983b28 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:39.144575 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d74be-e8b0-438d-aeb7-5799e0983b28 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:39.151268 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-a80816c0-ef1e-49c5-84b9-b3b840d18e2a None None] MFA Rules not processed for user `b85e40eecf3d4caaaa4ca7b36fff69a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:39.152574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a80816c0-ef1e-49c5-84b9-b3b840d18e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:39.204378 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73feaa09-d013-4007-ac31-7835a6ea0adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:39.205063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feaa09-d013-4007-ac31-7835a6ea0adb admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.205345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feaa09-d013-4007-ac31-7835a6ea0adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.205625 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feaa09-d013-4007-ac31-7835a6ea0adb admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.206471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73feaa09-d013-4007-ac31-7835a6ea0adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:39.208131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73feaa09-d013-4007-ac31-7835a6ea0adb admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:39.218803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 784/1598] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:39.220021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73feaa09-d013-4007-ac31-7835a6ea0adb admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:39.221081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 815/1599] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:39.221798 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80816c0-ef1e-49c5-84b9-b3b840d18e2a None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:39.234302 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73feaa09-d013-4007-ac31-7835a6ea0adb admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:39.234520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80816c0-ef1e-49c5-84b9-b3b840d18e2a None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:39.239248 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca8176-f7a2-46d4-9a54-2e2d055888fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:39.239963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca8176-f7a2-46d4-9a54-2e2d055888fe admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.240249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca8176-f7a2-46d4-9a54-2e2d055888fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.240366 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1b717-3c11-4ee0-a40c-f1840fef20e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:39.240534 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca8176-f7a2-46d4-9a54-2e2d055888fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.241226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1b717-3c11-4ee0-a40c-f1840fef20e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.241345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca8176-f7a2-46d4-9a54-2e2d055888fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:39.241510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1b717-3c11-4ee0-a40c-f1840fef20e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.241788 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1b717-3c11-4ee0-a40c-f1840fef20e9 admin admin] PATH_INFO: `/v3/projects/e88d46f58105478cba435e3cb6cdac8a/users/61f2fb5928004be4bc85b9aa1d12eef7/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.242853 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca8176-f7a2-46d4-9a54-2e2d055888fe admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:39.258884 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 816/1600] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:39.258884 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca8176-f7a2-46d4-9a54-2e2d055888fe admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:39.269058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1b717-3c11-4ee0-a40c-f1840fef20e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e88d46f58105478cba435e3cb6cdac8a, user_id=61f2fb5928004be4bc85b9aa1d12eef7, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:39.270986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca8176-f7a2-46d4-9a54-2e2d055888fe admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:39.271793 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1b717-3c11-4ee0-a40c-f1840fef20e9 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:39.275906 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:39.277451 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6532c-6e5c-470b-ac9b-988d175aaf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:39.278492 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6532c-6e5c-470b-ac9b-988d175aaf34 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.279155 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6532c-6e5c-470b-ac9b-988d175aaf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.279155 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6532c-6e5c-470b-ac9b-988d175aaf34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.279809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6532c-6e5c-470b-ac9b-988d175aaf34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:39.281483 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6532c-6e5c-470b-ac9b-988d175aaf34 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:39.292247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 817/1601] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:39.293786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0841d1-8726-426b-94ce-73eec8ddff42 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.294591 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0841d1-8726-426b-94ce-73eec8ddff42 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.294591 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0841d1-8726-426b-94ce-73eec8ddff42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.316585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-9b0841d1-8726-426b-94ce-73eec8ddff42 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:39.317838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-9b0841d1-8726-426b-94ce-73eec8ddff42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:39.326354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 818/1602] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:39.327690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de26fd7-e0cb-4c9a-8d25-0dd6f6177672 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.327980 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de26fd7-e0cb-4c9a-8d25-0dd6f6177672 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.328256 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de26fd7-e0cb-4c9a-8d25-0dd6f6177672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.344292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 785/1603] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:41:39 2022] PUT /identity/v3/projects/e88d46f58105478cba435e3cb6cdac8a/users/61f2fb5928004be4bc85b9aa1d12eef7/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:39.345224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1b717-3c11-4ee0-a40c-f1840fef20e9 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:39.358712 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-4de26fd7-e0cb-4c9a-8d25-0dd6f6177672 None None] MFA Rules not processed for user `e04786555e674f31840b4e3b6adda371`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:39.359937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-4de26fd7-e0cb-4c9a-8d25-0dd6f6177672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:39.406279 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1b717-3c11-4ee0-a40c-f1840fef20e9 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:39.409954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d541a-0394-41d5-af45-f3afe5d79ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:39.410620 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d541a-0394-41d5-af45-f3afe5d79ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.410910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d541a-0394-41d5-af45-f3afe5d79ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.411195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d541a-0394-41d5-af45-f3afe5d79ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.427860 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 819/1604] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:39.432750 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de26fd7-e0cb-4c9a-8d25-0dd6f6177672 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:39.476611 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d541a-0394-41d5-af45-f3afe5d79ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:39.478107 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d541a-0394-41d5-af45-f3afe5d79ec8 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:39.489575 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 786/1605] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:39.490223 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d541a-0394-41d5-af45-f3afe5d79ec8 service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:39.493651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:39.499859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de26fd7-e0cb-4c9a-8d25-0dd6f6177672 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:39.501722 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d541a-0394-41d5-af45-f3afe5d79ec8 service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:39.504635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c635a8d-a335-4fe3-869d-c0d5ec8bad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:39.505926 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c635a8d-a335-4fe3-869d-c0d5ec8bad77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.506059 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c635a8d-a335-4fe3-869d-c0d5ec8bad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.506552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c635a8d-a335-4fe3-869d-c0d5ec8bad77 admin admin] PATH_INFO: `/v3/projects/1cd64aef2efa46cea9056b3310da3638/users/abb27a4eecd14ab89a1d349fa3bdc0e3/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.507068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc4c2e-b407-41f8-816d-7bceefc37b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:39.508005 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc4c2e-b407-41f8-816d-7bceefc37b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.508290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc4c2e-b407-41f8-816d-7bceefc37b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.508572 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc4c2e-b407-41f8-816d-7bceefc37b07 admin admin] PATH_INFO: `/v3/projects/973d7ccbb11c41818dfd643e01f6e37b/users/625e51559d134917ab04a4a2704afa4c/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.521883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c635a8d-a335-4fe3-869d-c0d5ec8bad77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cd64aef2efa46cea9056b3310da3638, user_id=abb27a4eecd14ab89a1d349fa3bdc0e3, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:39.524744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c635a8d-a335-4fe3-869d-c0d5ec8bad77 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:39.529446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc4c2e-b407-41f8-816d-7bceefc37b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=973d7ccbb11c41818dfd643e01f6e37b, user_id=625e51559d134917ab04a4a2704afa4c, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:39.531304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc4c2e-b407-41f8-816d-7bceefc37b07 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:39.626250 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 820/1606] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:41:39 2022] PUT /identity/v3/projects/1cd64aef2efa46cea9056b3310da3638/users/abb27a4eecd14ab89a1d349fa3bdc0e3/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:39.626850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 787/1607] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:41:39 2022] PUT /identity/v3/projects/973d7ccbb11c41818dfd643e01f6e37b/users/625e51559d134917ab04a4a2704afa4c/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:39.627732 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdb66f-2f93-4adf-bbcd-172d7c629bcd None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.628027 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdb66f-2f93-4adf-bbcd-172d7c629bcd None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.628311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdb66f-2f93-4adf-bbcd-172d7c629bcd None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.629630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 821/1608] 10.222.0.40 () {54 vars in 961 bytes} [Tue Jul 12 14:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:41:39.633980 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdb66f-2f93-4adf-bbcd-172d7c629bcd None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:39.634785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc4c2e-b407-41f8-816d-7bceefc37b07 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:39.638665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-76cdb66f-2f93-4adf-bbcd-172d7c629bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:39.707131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdb66f-2f93-4adf-bbcd-172d7c629bcd None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:39.710115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc4c2e-b407-41f8-816d-7bceefc37b07 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:39.710954 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfda3c7-7f0b-44b1-a49f-69cddba1bb09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:39.711654 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfda3c7-7f0b-44b1-a49f-69cddba1bb09 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.711936 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfda3c7-7f0b-44b1-a49f-69cddba1bb09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.712217 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfda3c7-7f0b-44b1-a49f-69cddba1bb09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.714974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235035c-2121-4146-a86e-da2da3962a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:39.715943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235035c-2121-4146-a86e-da2da3962a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.716208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235035c-2121-4146-a86e-da2da3962a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.716482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235035c-2121-4146-a86e-da2da3962a09 admin admin] PATH_INFO: `/v3/projects/d8cfec85d8184dd085836c259a0337ae/users/ce1a840a6d4f48a58626784899176bd2/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.722571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfda3c7-7f0b-44b1-a49f-69cddba1bb09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:39.724063 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfda3c7-7f0b-44b1-a49f-69cddba1bb09 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:39.732961 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235035c-2121-4146-a86e-da2da3962a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8cfec85d8184dd085836c259a0337ae, user_id=ce1a840a6d4f48a58626784899176bd2, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:39.734371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 822/1609] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:39.735684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235035c-2121-4146-a86e-da2da3962a09 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:39.735822 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b55282-1e9a-46a6-ae19-2393b59e1bef None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.735962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b55282-1e9a-46a6-ae19-2393b59e1bef None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.736224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b55282-1e9a-46a6-ae19-2393b59e1bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.754288 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-45b55282-1e9a-46a6-ae19-2393b59e1bef None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:39.758747 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-45b55282-1e9a-46a6-ae19-2393b59e1bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:39.764218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 823/1610] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:39.765112 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b55282-1e9a-46a6-ae19-2393b59e1bef None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:39.775471 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b55282-1e9a-46a6-ae19-2393b59e1bef None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:39.780718 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc1e35-7c37-4b5b-b804-9ae3066d88bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:39.781325 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc1e35-7c37-4b5b-b804-9ae3066d88bd admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.781611 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc1e35-7c37-4b5b-b804-9ae3066d88bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.781894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc1e35-7c37-4b5b-b804-9ae3066d88bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.782592 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc1e35-7c37-4b5b-b804-9ae3066d88bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:39.784542 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc1e35-7c37-4b5b-b804-9ae3066d88bd admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:39.813744 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 788/1611] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:41:39 2022] PUT /identity/v3/projects/d8cfec85d8184dd085836c259a0337ae/users/ce1a840a6d4f48a58626784899176bd2/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:39.815101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687bd2e-fa63-48f5-98d4-0cd73ee63e1b None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.815576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687bd2e-fa63-48f5-98d4-0cd73ee63e1b None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.815861 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687bd2e-fa63-48f5-98d4-0cd73ee63e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.830559 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:39.842613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-0687bd2e-fa63-48f5-98d4-0cd73ee63e1b None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:39.844320 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0687bd2e-fa63-48f5-98d4-0cd73ee63e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:39.928370 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 824/1612] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:41:39 2022] POST /identity/v3/projects => generated 405 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:39.929992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e6492-96a9-44a6-8d66-b8af3dbc3ba5 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.933240 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 789/1613] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:39.933365 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e6492-96a9-44a6-8d66-b8af3dbc3ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.933365 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e6492-96a9-44a6-8d66-b8af3dbc3ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.933561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce98f27-24af-418c-8b55-8b8626d73e88 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:39.933561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce98f27-24af-418c-8b55-8b8626d73e88 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:39.933561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce98f27-24af-418c-8b55-8b8626d73e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:39.971480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-9ce98f27-24af-418c-8b55-8b8626d73e88 None None] MFA Rules not processed for user `625e51559d134917ab04a4a2704afa4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:39.972752 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-9ce98f27-24af-418c-8b55-8b8626d73e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:39.980701 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-ee9e6492-96a9-44a6-8d66-b8af3dbc3ba5 None None] MFA Rules not processed for user `122fc227de9d4f87a66e4a0d86ff0b16`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:39.982519 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ee9e6492-96a9-44a6-8d66-b8af3dbc3ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:40.053468 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 790/1614] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:40.054241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce98f27-24af-418c-8b55-8b8626d73e88 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:40.062252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 825/1615] 10.222.0.40 () {58 vars in 1058 bytes} [Tue Jul 12 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:40.063668 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357a18f-2a7f-4735-b310-f68cd7c362e1 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:40.063960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357a18f-2a7f-4735-b310-f68cd7c362e1 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:40.064307 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357a18f-2a7f-4735-b310-f68cd7c362e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:40.113956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-d357a18f-2a7f-4735-b310-f68cd7c362e1 None None] MFA Rules not processed for user `ce1a840a6d4f48a58626784899176bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:40.116600 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d357a18f-2a7f-4735-b310-f68cd7c362e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:40.158414 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:40.185254 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce98f27-24af-418c-8b55-8b8626d73e88 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:40.189766 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fab481-16cf-45f9-a8f1-36d43d62387d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:40.192032 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fab481-16cf-45f9-a8f1-36d43d62387d service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:40.192032 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fab481-16cf-45f9-a8f1-36d43d62387d service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:40.192032 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fab481-16cf-45f9-a8f1-36d43d62387d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:40.245304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 826/1616] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:40.246061 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357a18f-2a7f-4735-b310-f68cd7c362e1 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:40.299821 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:40.318720 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fab481-16cf-45f9-a8f1-36d43d62387d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:40.320200 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fab481-16cf-45f9-a8f1-36d43d62387d service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:40.330839 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 791/1617] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:40.335303 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fab481-16cf-45f9-a8f1-36d43d62387d service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:40.344187 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fab481-16cf-45f9-a8f1-36d43d62387d service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:40.346728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357a18f-2a7f-4735-b310-f68cd7c362e1 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:40.348736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ccbb4-df8f-4db9-afda-e0039762a7e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:40.349492 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ccbb4-df8f-4db9-afda-e0039762a7e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:40.349876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ccbb4-df8f-4db9-afda-e0039762a7e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:40.350231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ccbb4-df8f-4db9-afda-e0039762a7e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:40.350661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d279b-8511-4236-aac7-335d037fcd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:40.351480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d279b-8511-4236-aac7-335d037fcd61 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:40.352164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d279b-8511-4236-aac7-335d037fcd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:40.352280 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d279b-8511-4236-aac7-335d037fcd61 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:40.353188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d279b-8511-4236-aac7-335d037fcd61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:40.355548 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d279b-8511-4236-aac7-335d037fcd61 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:40.362160 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ccbb4-df8f-4db9-afda-e0039762a7e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:40.364512 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ccbb4-df8f-4db9-afda-e0039762a7e8 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:40.377692 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 792/1618] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:40.378828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ccbb4-df8f-4db9-afda-e0039762a7e8 service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:40.393764 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ccbb4-df8f-4db9-afda-e0039762a7e8 service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:40.399875 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f523af4-1f05-4eef-a9c4-60fe5cb8e18e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:40.404177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f523af4-1f05-4eef-a9c4-60fe5cb8e18e service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:40.404177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f523af4-1f05-4eef-a9c4-60fe5cb8e18e service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:40.404177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f523af4-1f05-4eef-a9c4-60fe5cb8e18e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:40.465495 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f523af4-1f05-4eef-a9c4-60fe5cb8e18e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:40.467357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f523af4-1f05-4eef-a9c4-60fe5cb8e18e service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:40.478861 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 793/1619] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:40.480768 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8d692-8a6f-4eb1-8c6c-4c2d78b6e380 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:40.482135 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8d692-8a6f-4eb1-8c6c-4c2d78b6e380 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:40.482794 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8d692-8a6f-4eb1-8c6c-4c2d78b6e380 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:40.484871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 794/1620] 10.222.0.40 () {54 vars in 961 bytes} [Tue Jul 12 14:41:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:41:40.486209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8d692-8a6f-4eb1-8c6c-4c2d78b6e380 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:40.500946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8d692-8a6f-4eb1-8c6c-4c2d78b6e380 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:40.509740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db46ab-5be5-4435-8225-a02b66465e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:40.509740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db46ab-5be5-4435-8225-a02b66465e4b admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:40.509740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db46ab-5be5-4435-8225-a02b66465e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:40.509740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db46ab-5be5-4435-8225-a02b66465e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:40.510169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db46ab-5be5-4435-8225-a02b66465e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:40.510441 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db46ab-5be5-4435-8225-a02b66465e4b admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:40.533980 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 827/1621] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:41:40 2022] POST /identity/v3/users => generated 309 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:40.535327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c6696-c3dd-4bdb-80ba-0c7e8571a227 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:40.535614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c6696-c3dd-4bdb-80ba-0c7e8571a227 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:40.535883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c6696-c3dd-4bdb-80ba-0c7e8571a227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:40.561979 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-de5c6696-c3dd-4bdb-80ba-0c7e8571a227 None None] MFA Rules not processed for user `122fc227de9d4f87a66e4a0d86ff0b16`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:40.564045 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-de5c6696-c3dd-4bdb-80ba-0c7e8571a227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:40.576349 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 828/1622] 10.222.0.40 () {58 vars in 1058 bytes} [Tue Jul 12 14:41:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:40.578136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c6696-c3dd-4bdb-80ba-0c7e8571a227 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:40.588721 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c6696-c3dd-4bdb-80ba-0c7e8571a227 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:40.594294 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898263a6-b122-40f3-aa7f-c05feaf14b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:40.594849 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898263a6-b122-40f3-aa7f-c05feaf14b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:40.595131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898263a6-b122-40f3-aa7f-c05feaf14b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:40.595435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898263a6-b122-40f3-aa7f-c05feaf14b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:40.596485 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898263a6-b122-40f3-aa7f-c05feaf14b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:40.598130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898263a6-b122-40f3-aa7f-c05feaf14b6e admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:40.610091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 829/1623] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:40.610979 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898263a6-b122-40f3-aa7f-c05feaf14b6e admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:40.631169 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898263a6-b122-40f3-aa7f-c05feaf14b6e admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:40.638854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f3293-25d1-49bb-8f5f-cc80b2d0e00d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:40.639611 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f3293-25d1-49bb-8f5f-cc80b2d0e00d service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:40.639895 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f3293-25d1-49bb-8f5f-cc80b2d0e00d service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:40.640174 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f3293-25d1-49bb-8f5f-cc80b2d0e00d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:40.665835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 795/1624] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:41:40 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:40.665835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db46ab-5be5-4435-8225-a02b66465e4b admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:40.669960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f3293-25d1-49bb-8f5f-cc80b2d0e00d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:40.674273 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f3293-25d1-49bb-8f5f-cc80b2d0e00d service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:40.699598 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 830/1625] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:40.700586 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f3293-25d1-49bb-8f5f-cc80b2d0e00d service nova] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:40.730149 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f3293-25d1-49bb-8f5f-cc80b2d0e00d service nova] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:40.788527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db46ab-5be5-4435-8225-a02b66465e4b admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:40.796073 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e973b4-8147-4695-9789-1060833f0717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:40.796996 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e973b4-8147-4695-9789-1060833f0717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:40.797471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e973b4-8147-4695-9789-1060833f0717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:40.797759 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e973b4-8147-4695-9789-1060833f0717 admin admin] PATH_INFO: `/v3/projects/6e2c8afa84d24d6fb1b56ab15686d193/users/27db66652e744746828f51eff575de82/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:40.816367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e973b4-8147-4695-9789-1060833f0717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2c8afa84d24d6fb1b56ab15686d193, user_id=27db66652e744746828f51eff575de82, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:40.818846 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e973b4-8147-4695-9789-1060833f0717 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:40.849317 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade049a1-a640-4f4e-8df6-1a2804ffcf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:40.850170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade049a1-a640-4f4e-8df6-1a2804ffcf9b admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:40.850461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade049a1-a640-4f4e-8df6-1a2804ffcf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:40.850740 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade049a1-a640-4f4e-8df6-1a2804ffcf9b admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:40.851491 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade049a1-a640-4f4e-8df6-1a2804ffcf9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:40.853808 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade049a1-a640-4f4e-8df6-1a2804ffcf9b admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:40.910720 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 796/1626] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:41:40 2022] PUT /identity/v3/projects/6e2c8afa84d24d6fb1b56ab15686d193/users/27db66652e744746828f51eff575de82/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:40.912316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24510c17-c32b-4a26-a24e-1d34d5b40ea0 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:40.912708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24510c17-c32b-4a26-a24e-1d34d5b40ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:40.912904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24510c17-c32b-4a26-a24e-1d34d5b40ea0 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:40.914686 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 797/1627] 10.222.0.40 () {54 vars in 912 bytes} [Tue Jul 12 14:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:41:40.919740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24510c17-c32b-4a26-a24e-1d34d5b40ea0 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:40.962916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:40.997681 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24510c17-c32b-4a26-a24e-1d34d5b40ea0 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:41.003329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fa57c-6e28-4449-b6b9-2f11a2e10662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:41.004071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fa57c-6e28-4449-b6b9-2f11a2e10662 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:41.004635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fa57c-6e28-4449-b6b9-2f11a2e10662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:41.004993 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fa57c-6e28-4449-b6b9-2f11a2e10662 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:41.005934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fa57c-6e28-4449-b6b9-2f11a2e10662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:41.008027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fa57c-6e28-4449-b6b9-2f11a2e10662 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:41.021306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 831/1628] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:41:40 2022] POST /identity/v3/users => generated 296 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:41.022816 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa13b2-61dd-4b33-872f-871670ed3d76 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:41.025269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa13b2-61dd-4b33-872f-871670ed3d76 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:41.025558 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa13b2-61dd-4b33-872f-871670ed3d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:41.025659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 798/1629] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:41.026770 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fa57c-6e28-4449-b6b9-2f11a2e10662 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:41.039587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fa57c-6e28-4449-b6b9-2f11a2e10662 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:41.045820 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1aab97-7866-4a4e-86e2-6ddee606da44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:41.046842 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1aab97-7866-4a4e-86e2-6ddee606da44 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:41.047194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1aab97-7866-4a4e-86e2-6ddee606da44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:41.047568 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1aab97-7866-4a4e-86e2-6ddee606da44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:41.049493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1aab97-7866-4a4e-86e2-6ddee606da44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:41.051693 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1aab97-7866-4a4e-86e2-6ddee606da44 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:41.065088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-7baa13b2-61dd-4b33-872f-871670ed3d76 None None] MFA Rules not processed for user `122fc227de9d4f87a66e4a0d86ff0b16`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:41.070877 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7baa13b2-61dd-4b33-872f-871670ed3d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:41.071042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 799/1630] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:41.071042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1aab97-7866-4a4e-86e2-6ddee606da44 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:41.075355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:41.082023 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1aab97-7866-4a4e-86e2-6ddee606da44 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:41.089746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5eb6b-abc0-40de-8baa-7ac7423fe785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:41.092104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5eb6b-abc0-40de-8baa-7ac7423fe785 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:41.092697 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5eb6b-abc0-40de-8baa-7ac7423fe785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:41.092975 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5eb6b-abc0-40de-8baa-7ac7423fe785 admin admin] PATH_INFO: `/v3/projects/6e2c8afa84d24d6fb1b56ab15686d193/users/27db66652e744746828f51eff575de82/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:41.095221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5eb6b-abc0-40de-8baa-7ac7423fe785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2c8afa84d24d6fb1b56ab15686d193, user_id=27db66652e744746828f51eff575de82, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:41.100030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5eb6b-abc0-40de-8baa-7ac7423fe785 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:41.124488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 800/1631] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:41:41 2022] PUT /identity/v3/projects/6e2c8afa84d24d6fb1b56ab15686d193/users/27db66652e744746828f51eff575de82/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:41.136977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db3faa-cdbe-4073-b535-664394aa22c0 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:41.138006 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db3faa-cdbe-4073-b535-664394aa22c0 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:41.138501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db3faa-cdbe-4073-b535-664394aa22c0 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:41.141330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 801/1632] 10.222.0.40 () {54 vars in 912 bytes} [Tue Jul 12 14:41:41 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:41:41.142185 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db3faa-cdbe-4073-b535-664394aa22c0 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:41.214270 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 832/1633] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Jul 12 14:41:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:41.221776 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba9c5c-71f6-4971-9c30-27acfc6d3bee None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:41.222140 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba9c5c-71f6-4971-9c30-27acfc6d3bee None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:41.222614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba9c5c-71f6-4971-9c30-27acfc6d3bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:41.253287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db3faa-cdbe-4073-b535-664394aa22c0 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:41.258856 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66b4bf-c845-475d-aaa1-95bca8e5cd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:41.259877 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66b4bf-c845-475d-aaa1-95bca8e5cd98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:41.260164 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66b4bf-c845-475d-aaa1-95bca8e5cd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:41.260585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66b4bf-c845-475d-aaa1-95bca8e5cd98 admin admin] PATH_INFO: `/v3/projects/204cd449b1844ea7896328059cf13fe3/users/cbc4269ba5a747aebac020f238641651/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:41.270629 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-acba9c5c-71f6-4971-9c30-27acfc6d3bee None None] MFA Rules not processed for user `27db66652e744746828f51eff575de82`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:41.272090 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-acba9c5c-71f6-4971-9c30-27acfc6d3bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:41.279899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66b4bf-c845-475d-aaa1-95bca8e5cd98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=204cd449b1844ea7896328059cf13fe3, user_id=cbc4269ba5a747aebac020f238641651, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:41.283177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66b4bf-c845-475d-aaa1-95bca8e5cd98 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:41.372346 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 833/1634] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:41 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:41.374995 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf7200-4571-4d9f-a919-62b043b0152a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:41.375413 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf7200-4571-4d9f-a919-62b043b0152a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:41.376001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf7200-4571-4d9f-a919-62b043b0152a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:41.400032 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 802/1635] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:41:41 2022] PUT /identity/v3/projects/204cd449b1844ea7896328059cf13fe3/users/cbc4269ba5a747aebac020f238641651/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:41.400032 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66b4bf-c845-475d-aaa1-95bca8e5cd98 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:41.423222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-7bcf7200-4571-4d9f-a919-62b043b0152a None None] MFA Rules not processed for user `122fc227de9d4f87a66e4a0d86ff0b16`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:41.427162 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7bcf7200-4571-4d9f-a919-62b043b0152a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:41.516974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66b4bf-c845-475d-aaa1-95bca8e5cd98 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:41.520921 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800b789-fb6c-4289-aa4f-d4a7392539d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:41.521591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800b789-fb6c-4289-aa4f-d4a7392539d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:41.521939 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800b789-fb6c-4289-aa4f-d4a7392539d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:41.522224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800b789-fb6c-4289-aa4f-d4a7392539d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:41.558444 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 834/1636] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Jul 12 14:41:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:41.578966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf7200-4571-4d9f-a919-62b043b0152a None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:41.590334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:41.604023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf7200-4571-4d9f-a919-62b043b0152a None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:41.612719 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2e952-56e5-4989-ac86-1d2b136a80f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:41.614248 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2e952-56e5-4989-ac86-1d2b136a80f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:41.614746 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2e952-56e5-4989-ac86-1d2b136a80f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:41.615134 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2e952-56e5-4989-ac86-1d2b136a80f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:41.636986 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800b789-fb6c-4289-aa4f-d4a7392539d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:41.638754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800b789-fb6c-4289-aa4f-d4a7392539d9 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:41.664061 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 803/1637] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:41.672305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800b789-fb6c-4289-aa4f-d4a7392539d9 service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:41.759231 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2e952-56e5-4989-ac86-1d2b136a80f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:41.761011 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2e952-56e5-4989-ac86-1d2b136a80f2 service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:41.762859 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800b789-fb6c-4289-aa4f-d4a7392539d9 service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:41.769125 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c066d20-524a-45c5-8771-b9b5ecc2c51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:41.769958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c066d20-524a-45c5-8771-b9b5ecc2c51f admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:41.770313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c066d20-524a-45c5-8771-b9b5ecc2c51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:41.770698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c066d20-524a-45c5-8771-b9b5ecc2c51f admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:41.771729 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c066d20-524a-45c5-8771-b9b5ecc2c51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:41.773932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c066d20-524a-45c5-8771-b9b5ecc2c51f admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:41.790316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 804/1638] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:41.791445 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c066d20-524a-45c5-8771-b9b5ecc2c51f admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:41.804338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c066d20-524a-45c5-8771-b9b5ecc2c51f admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:41.810841 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 835/1639] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:41 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:41.810988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f8866-8646-4947-84c5-52096e01d224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:41.811798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f8866-8646-4947-84c5-52096e01d224 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:41.812180 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f8866-8646-4947-84c5-52096e01d224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:41.812530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f8866-8646-4947-84c5-52096e01d224 admin admin] PATH_INFO: `/v3/projects/204cd449b1844ea7896328059cf13fe3/users/cbc4269ba5a747aebac020f238641651/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:41.815082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f8866-8646-4947-84c5-52096e01d224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=204cd449b1844ea7896328059cf13fe3, user_id=cbc4269ba5a747aebac020f238641651, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:41.818577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f8866-8646-4947-84c5-52096e01d224 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:41.832987 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 805/1640] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:41:41 2022] PUT /identity/v3/projects/204cd449b1844ea7896328059cf13fe3/users/cbc4269ba5a747aebac020f238641651/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:41.849145 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d077b7-9c93-4eab-b30b-6bceefd45771 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:41.849441 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d077b7-9c93-4eab-b30b-6bceefd45771 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:41.849731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d077b7-9c93-4eab-b30b-6bceefd45771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:41.909786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f8866-8646-4947-84c5-52096e01d224 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:41.920889 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-91d077b7-9c93-4eab-b30b-6bceefd45771 None None] MFA Rules not processed for user `cbc4269ba5a747aebac020f238641651`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:41.923026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-91d077b7-9c93-4eab-b30b-6bceefd45771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:41.925533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:42.039435 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f8866-8646-4947-84c5-52096e01d224 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:42.064325 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f0b11-dc12-45b0-921f-d20dc4ac906a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:42.065016 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f0b11-dc12-45b0-921f-d20dc4ac906a service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:42.065927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f0b11-dc12-45b0-921f-d20dc4ac906a service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:42.066220 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f0b11-dc12-45b0-921f-d20dc4ac906a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:42.067941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 836/1641] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:42.187920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f0b11-dc12-45b0-921f-d20dc4ac906a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:42.189811 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f0b11-dc12-45b0-921f-d20dc4ac906a service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:42.202694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 806/1642] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:42.620018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:43.575675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d077b7-9c93-4eab-b30b-6bceefd45771 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:43.593178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d077b7-9c93-4eab-b30b-6bceefd45771 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:43.601223 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e970c2-4db0-4471-84c7-5ca99b996c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:43.603677 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e970c2-4db0-4471-84c7-5ca99b996c3d service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:43.604316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e970c2-4db0-4471-84c7-5ca99b996c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:43.604841 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e970c2-4db0-4471-84c7-5ca99b996c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:43.621603 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e970c2-4db0-4471-84c7-5ca99b996c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:43.621603 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e970c2-4db0-4471-84c7-5ca99b996c3d service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:43.636144 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 837/1643] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:44.100752 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f0b11-dc12-45b0-921f-d20dc4ac906a service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:44.113784 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f0b11-dc12-45b0-921f-d20dc4ac906a service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:44.129735 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1b0ff-23ad-40f5-b1b6-3fe5f5cab551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:44.130499 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1b0ff-23ad-40f5-b1b6-3fe5f5cab551 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:44.130809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1b0ff-23ad-40f5-b1b6-3fe5f5cab551 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:44.131147 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1b0ff-23ad-40f5-b1b6-3fe5f5cab551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:44.144526 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e970c2-4db0-4471-84c7-5ca99b996c3d service cinder] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:44.259577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1b0ff-23ad-40f5-b1b6-3fe5f5cab551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:44.261894 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1b0ff-23ad-40f5-b1b6-3fe5f5cab551 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:44.269635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e970c2-4db0-4471-84c7-5ca99b996c3d service cinder] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:44.280116 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 807/1644] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:44.305482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966d7f8-02d1-4d33-9ce8-6a5a6ae5f9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:44.307849 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966d7f8-02d1-4d33-9ce8-6a5a6ae5f9e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:44.309602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966d7f8-02d1-4d33-9ce8-6a5a6ae5f9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:44.310128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966d7f8-02d1-4d33-9ce8-6a5a6ae5f9e4 admin admin] PATH_INFO: `/v3/users/e04786555e674f31840b4e3b6adda371` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:44.314597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966d7f8-02d1-4d33-9ce8-6a5a6ae5f9e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04786555e674f31840b4e3b6adda371)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:44.318750 dv-cinder-820027-12-smb devstack@keystone.service[80633]: WARNING py.warnings [None req-f966d7f8-02d1-4d33-9ce8-6a5a6ae5f9e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:41:44.318750 dv-cinder-820027-12-smb devstack@keystone.service[80633]: warnings.warn(msg) Jul 12 14:41:44.318750 dv-cinder-820027-12-smb devstack@keystone.service[80633]: Jul 12 14:41:44.326306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966d7f8-02d1-4d33-9ce8-6a5a6ae5f9e4 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:44.516837 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:44.658431 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f966d7f8-02d1-4d33-9ce8-6a5a6ae5f9e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04786555e674f31840b4e3b6adda371'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:44.708907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f966d7f8-02d1-4d33-9ce8-6a5a6ae5f9e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04786555e674f31840b4e3b6adda371'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:44.847228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f966d7f8-02d1-4d33-9ce8-6a5a6ae5f9e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04786555e674f31840b4e3b6adda371'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:44.848001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f966d7f8-02d1-4d33-9ce8-6a5a6ae5f9e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04786555e674f31840b4e3b6adda371'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:44.876229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f966d7f8-02d1-4d33-9ce8-6a5a6ae5f9e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04786555e674f31840b4e3b6adda371'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:44.894047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 838/1645] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:41:44 2022] DELETE /identity/v3/users/e04786555e674f31840b4e3b6adda371 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:44.895589 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bad24-879c-45ea-b085-c8057523f3a4 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:44.895837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bad24-879c-45ea-b085-c8057523f3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:44.896116 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bad24-879c-45ea-b085-c8057523f3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:44.930418 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-726bad24-879c-45ea-b085-c8057523f3a4 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:44.933738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-726bad24-879c-45ea-b085-c8057523f3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:45.113662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 808/1646] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:41:45.156398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966d7f8-02d1-4d33-9ce8-6a5a6ae5f9e4 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:45.158350 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f966d7f8-02d1-4d33-9ce8-6a5a6ae5f9e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:45.302348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966d7f8-02d1-4d33-9ce8-6a5a6ae5f9e4 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:45.308652 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b82eac-3359-4178-aa04-febaca0ab789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:45.312950 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b82eac-3359-4178-aa04-febaca0ab789 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:45.313519 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b82eac-3359-4178-aa04-febaca0ab789 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:45.313977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b82eac-3359-4178-aa04-febaca0ab789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:45.325791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b82eac-3359-4178-aa04-febaca0ab789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:45.327992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b82eac-3359-4178-aa04-febaca0ab789 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:45.344213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 839/1647] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:47.313489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bad24-879c-45ea-b085-c8057523f3a4 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:47.314951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-726bad24-879c-45ea-b085-c8057523f3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:47.332930 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bad24-879c-45ea-b085-c8057523f3a4 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:47.354571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca75548-a5f7-46a3-aa95-81fe2323c3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:47.357928 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca75548-a5f7-46a3-aa95-81fe2323c3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:47.358406 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca75548-a5f7-46a3-aa95-81fe2323c3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:47.361817 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca75548-a5f7-46a3-aa95-81fe2323c3ae admin admin] PATH_INFO: `/v3/projects/578d6f8e3843421d898264e40882c5b8` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:47.365430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca75548-a5f7-46a3-aa95-81fe2323c3ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=578d6f8e3843421d898264e40882c5b8)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:47.366646 dv-cinder-820027-12-smb devstack@keystone.service[80634]: WARNING py.warnings [None req-eca75548-a5f7-46a3-aa95-81fe2323c3ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 14:41:47.366646 dv-cinder-820027-12-smb devstack@keystone.service[80634]: warnings.warn(msg) Jul 12 14:41:47.366646 dv-cinder-820027-12-smb devstack@keystone.service[80634]: Jul 12 14:41:47.370145 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca75548-a5f7-46a3-aa95-81fe2323c3ae admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:47.772730 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-eca75548-a5f7-46a3-aa95-81fe2323c3ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578d6f8e3843421d898264e40882c5b8', 'request_id': 'req-eca75548-a5f7-46a3-aa95-81fe2323c3ae'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:47.782810 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-eca75548-a5f7-46a3-aa95-81fe2323c3ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578d6f8e3843421d898264e40882c5b8', 'request_id': 'req-eca75548-a5f7-46a3-aa95-81fe2323c3ae'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:47.798867 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-eca75548-a5f7-46a3-aa95-81fe2323c3ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578d6f8e3843421d898264e40882c5b8', 'request_id': 'req-eca75548-a5f7-46a3-aa95-81fe2323c3ae'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:47.908761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-eca75548-a5f7-46a3-aa95-81fe2323c3ae admin admin] The token cache is being invalidate because project 578d6f8e3843421d898264e40882c5b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:41:47.909503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-eca75548-a5f7-46a3-aa95-81fe2323c3ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:47.910846 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-eca75548-a5f7-46a3-aa95-81fe2323c3ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:47.913338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 809/1648] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:41:47 2022] DELETE /identity/v3/projects/578d6f8e3843421d898264e40882c5b8 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:47.917358 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b82eac-3359-4178-aa04-febaca0ab789 service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:47.936754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b82eac-3359-4178-aa04-febaca0ab789 service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:48.084906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de968d-3bb3-484e-83db-0e41a3f4f4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:48.087594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de968d-3bb3-484e-83db-0e41a3f4f4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:48.087988 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de968d-3bb3-484e-83db-0e41a3f4f4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:48.091884 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de968d-3bb3-484e-83db-0e41a3f4f4c8 admin admin] PATH_INFO: `/v3/users/27db66652e744746828f51eff575de82` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:48.092865 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de968d-3bb3-484e-83db-0e41a3f4f4c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27db66652e744746828f51eff575de82)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:48.096865 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de968d-3bb3-484e-83db-0e41a3f4f4c8 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:48.366574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a4de968d-3bb3-484e-83db-0e41a3f4f4c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27db66652e744746828f51eff575de82'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:48.368174 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:48.415571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a4de968d-3bb3-484e-83db-0e41a3f4f4c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27db66652e744746828f51eff575de82'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:48.507850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a4de968d-3bb3-484e-83db-0e41a3f4f4c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27db66652e744746828f51eff575de82'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:48.508561 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a4de968d-3bb3-484e-83db-0e41a3f4f4c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27db66652e744746828f51eff575de82'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:48.523585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a4de968d-3bb3-484e-83db-0e41a3f4f4c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27db66652e744746828f51eff575de82'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:48.560334 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 840/1649] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:41:47 2022] DELETE /identity/v3/users/27db66652e744746828f51eff575de82 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:49.598277 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca75548-a5f7-46a3-aa95-81fe2323c3ae admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:49.601630 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-eca75548-a5f7-46a3-aa95-81fe2323c3ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:49.630880 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca75548-a5f7-46a3-aa95-81fe2323c3ae admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:49.664519 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:49.794538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa3ce6-a3fd-43e7-b05d-26a4ac719d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:49.797854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa3ce6-a3fd-43e7-b05d-26a4ac719d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:49.798149 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa3ce6-a3fd-43e7-b05d-26a4ac719d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:49.798436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa3ce6-a3fd-43e7-b05d-26a4ac719d48 admin admin] PATH_INFO: `/v3/users/625e51559d134917ab04a4a2704afa4c` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:49.803248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa3ce6-a3fd-43e7-b05d-26a4ac719d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=625e51559d134917ab04a4a2704afa4c)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:49.808805 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa3ce6-a3fd-43e7-b05d-26a4ac719d48 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:50.127551 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-32aa3ce6-a3fd-43e7-b05d-26a4ac719d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '625e51559d134917ab04a4a2704afa4c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:50.166652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-32aa3ce6-a3fd-43e7-b05d-26a4ac719d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '625e51559d134917ab04a4a2704afa4c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:50.184817 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-32aa3ce6-a3fd-43e7-b05d-26a4ac719d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '625e51559d134917ab04a4a2704afa4c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:50.295883 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-32aa3ce6-a3fd-43e7-b05d-26a4ac719d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '625e51559d134917ab04a4a2704afa4c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:50.296472 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-32aa3ce6-a3fd-43e7-b05d-26a4ac719d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '625e51559d134917ab04a4a2704afa4c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:50.304952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 810/1650] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:41:49 2022] DELETE /identity/v3/users/625e51559d134917ab04a4a2704afa4c => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:50.310965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87860397-9992-4cf7-860f-2211f5cae8f2 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:50.311526 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87860397-9992-4cf7-860f-2211f5cae8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:50.311850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87860397-9992-4cf7-860f-2211f5cae8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:50.354771 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-87860397-9992-4cf7-860f-2211f5cae8f2 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:50.361510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-87860397-9992-4cf7-860f-2211f5cae8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:50.398295 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa3ce6-a3fd-43e7-b05d-26a4ac719d48 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:50.400513 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-32aa3ce6-a3fd-43e7-b05d-26a4ac719d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:50.576836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 841/1651] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:50.634986 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa3ce6-a3fd-43e7-b05d-26a4ac719d48 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:50.653766 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5620d-ad5e-44c1-afed-009ba05b5784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:50.654790 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5620d-ad5e-44c1-afed-009ba05b5784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:50.655427 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5620d-ad5e-44c1-afed-009ba05b5784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:50.655538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5620d-ad5e-44c1-afed-009ba05b5784 admin admin] PATH_INFO: `/v3/projects/6e2c8afa84d24d6fb1b56ab15686d193` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:50.657961 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5620d-ad5e-44c1-afed-009ba05b5784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2c8afa84d24d6fb1b56ab15686d193)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:50.659798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5620d-ad5e-44c1-afed-009ba05b5784 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:50.722228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87860397-9992-4cf7-860f-2211f5cae8f2 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:50.723507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-87860397-9992-4cf7-860f-2211f5cae8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:50.848506 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87860397-9992-4cf7-860f-2211f5cae8f2 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:50.868914 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-fea5620d-ad5e-44c1-afed-009ba05b5784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2c8afa84d24d6fb1b56ab15686d193', 'request_id': 'req-fea5620d-ad5e-44c1-afed-009ba05b5784'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:50.891357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-fea5620d-ad5e-44c1-afed-009ba05b5784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2c8afa84d24d6fb1b56ab15686d193', 'request_id': 'req-fea5620d-ad5e-44c1-afed-009ba05b5784'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:50.945739 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-fea5620d-ad5e-44c1-afed-009ba05b5784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2c8afa84d24d6fb1b56ab15686d193', 'request_id': 'req-fea5620d-ad5e-44c1-afed-009ba05b5784'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:51.001749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7d8e2-b16d-4402-9166-dc310b0113f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:51.002491 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7d8e2-b16d-4402-9166-dc310b0113f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:51.002944 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7d8e2-b16d-4402-9166-dc310b0113f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:51.003325 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7d8e2-b16d-4402-9166-dc310b0113f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:51.065304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-fea5620d-ad5e-44c1-afed-009ba05b5784 admin admin] The token cache is being invalidate because project 6e2c8afa84d24d6fb1b56ab15686d193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:41:51.065491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-fea5620d-ad5e-44c1-afed-009ba05b5784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:51.066443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-fea5620d-ad5e-44c1-afed-009ba05b5784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:51.069584 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 811/1652] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:41:50 2022] DELETE /identity/v3/projects/6e2c8afa84d24d6fb1b56ab15686d193 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:51.092805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:51.097648 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20675ee8-f726-436b-853a-ba20d2ec7c60 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:51.097956 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20675ee8-f726-436b-853a-ba20d2ec7c60 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:51.101042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20675ee8-f726-436b-853a-ba20d2ec7c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:51.159725 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-20675ee8-f726-436b-853a-ba20d2ec7c60 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:51.161923 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-20675ee8-f726-436b-853a-ba20d2ec7c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:51.174464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7d8e2-b16d-4402-9166-dc310b0113f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:51.176108 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7d8e2-b16d-4402-9166-dc310b0113f1 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:51.185429 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 812/1653] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:51.195141 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25720c0a-7385-4993-b6d6-9f499d5e0973 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:51.195506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25720c0a-7385-4993-b6d6-9f499d5e0973 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:51.195901 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25720c0a-7385-4993-b6d6-9f499d5e0973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:51.200309 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 842/1654] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:51.251229 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-25720c0a-7385-4993-b6d6-9f499d5e0973 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:51.254362 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-25720c0a-7385-4993-b6d6-9f499d5e0973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:51.278709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 813/1655] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:51.287931 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7d8e2-b16d-4402-9166-dc310b0113f1 service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:51.289820 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-58b7d8e2-b16d-4402-9166-dc310b0113f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:51.323678 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7d8e2-b16d-4402-9166-dc310b0113f1 service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:51.342760 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294ef8b-a60e-4353-8225-45d9d7962fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:51.343723 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294ef8b-a60e-4353-8225-45d9d7962fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:51.344062 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294ef8b-a60e-4353-8225-45d9d7962fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:51.344406 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294ef8b-a60e-4353-8225-45d9d7962fc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:51.345224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294ef8b-a60e-4353-8225-45d9d7962fc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:41:51.345627 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294ef8b-a60e-4353-8225-45d9d7962fc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:51.347355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294ef8b-a60e-4353-8225-45d9d7962fc1 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:51.377679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 843/1656] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:41:51.381684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25720c0a-7385-4993-b6d6-9f499d5e0973 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:51.396160 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25720c0a-7385-4993-b6d6-9f499d5e0973 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:51.409833 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1de91a-8b6f-429d-8d3e-8cfb6c868dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:51.411465 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1de91a-8b6f-429d-8d3e-8cfb6c868dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:51.414045 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1de91a-8b6f-429d-8d3e-8cfb6c868dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:51.414558 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1de91a-8b6f-429d-8d3e-8cfb6c868dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:51.417215 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1de91a-8b6f-429d-8d3e-8cfb6c868dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:51.420304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1de91a-8b6f-429d-8d3e-8cfb6c868dc2 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:51.588163 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 814/1657] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:41:51 2022] POST /identity/v3/projects => generated 405 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:51.592130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294ef8b-a60e-4353-8225-45d9d7962fc1 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:51.608577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294ef8b-a60e-4353-8225-45d9d7962fc1 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:51.799519 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0808b-1a91-4b9a-a7a8-8072bfc110d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:51.800560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0808b-1a91-4b9a-a7a8-8072bfc110d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:51.802406 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0808b-1a91-4b9a-a7a8-8072bfc110d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:51.802794 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0808b-1a91-4b9a-a7a8-8072bfc110d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:51.803760 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0808b-1a91-4b9a-a7a8-8072bfc110d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:51.824159 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0808b-1a91-4b9a-a7a8-8072bfc110d4 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:52.012802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1de91a-8b6f-429d-8d3e-8cfb6c868dc2 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:52.014333 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 844/1658] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:41:51 2022] POST /identity/v3/users => generated 303 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:52.030734 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1de91a-8b6f-429d-8d3e-8cfb6c868dc2 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:52.053723 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:52.063692 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646eb0a-a059-40fe-a944-504aa97f3aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:52.065137 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646eb0a-a059-40fe-a944-504aa97f3aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:52.065486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646eb0a-a059-40fe-a944-504aa97f3aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:52.065777 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646eb0a-a059-40fe-a944-504aa97f3aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:52.067562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646eb0a-a059-40fe-a944-504aa97f3aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:52.069093 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646eb0a-a059-40fe-a944-504aa97f3aa1 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:52.108300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0808b-1a91-4b9a-a7a8-8072bfc110d4 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:52.109565 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 815/1659] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:52.140983 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0808b-1a91-4b9a-a7a8-8072bfc110d4 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:52.159184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8cd03-1f5b-48dd-b932-b35500dd6027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:52.161312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8cd03-1f5b-48dd-b932-b35500dd6027 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:52.163716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8cd03-1f5b-48dd-b932-b35500dd6027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:52.164197 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8cd03-1f5b-48dd-b932-b35500dd6027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:52.165140 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8cd03-1f5b-48dd-b932-b35500dd6027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:52.169678 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8cd03-1f5b-48dd-b932-b35500dd6027 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:52.215891 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 845/1660] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:41:52.220486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646eb0a-a059-40fe-a944-504aa97f3aa1 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:52.236835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646eb0a-a059-40fe-a944-504aa97f3aa1 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:52.255251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bcbaa-4b34-4a3d-a8ef-42f7e3fff9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:52.257142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bcbaa-4b34-4a3d-a8ef-42f7e3fff9af admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:52.257142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bcbaa-4b34-4a3d-a8ef-42f7e3fff9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:52.257556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bcbaa-4b34-4a3d-a8ef-42f7e3fff9af admin admin] PATH_INFO: `/v3/projects/9815547a20194aa59c2a95f92dbaa63c/users/899d0fa4bc124c13aeb830f6f293748b/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:52.287565 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bcbaa-4b34-4a3d-a8ef-42f7e3fff9af admin admin] RBAC: Authorizing `identity:create_grant(project_id=9815547a20194aa59c2a95f92dbaa63c, user_id=899d0fa4bc124c13aeb830f6f293748b, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:52.292072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bcbaa-4b34-4a3d-a8ef-42f7e3fff9af admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:52.335162 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8cd03-1f5b-48dd-b932-b35500dd6027 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:52.337423 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-38c8cd03-1f5b-48dd-b932-b35500dd6027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:52.361496 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8cd03-1f5b-48dd-b932-b35500dd6027 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:52.389201 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfcd11-c900-45fc-82d8-f76189777181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:52.390704 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfcd11-c900-45fc-82d8-f76189777181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:52.391222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfcd11-c900-45fc-82d8-f76189777181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:52.391724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfcd11-c900-45fc-82d8-f76189777181 admin admin] PATH_INFO: `/v3/users/b85e40eecf3d4caaaa4ca7b36fff69a5` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:52.396109 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfcd11-c900-45fc-82d8-f76189777181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b85e40eecf3d4caaaa4ca7b36fff69a5)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:52.401026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfcd11-c900-45fc-82d8-f76189777181 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:52.403917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 816/1661] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:41:52 2022] PUT /identity/v3/projects/9815547a20194aa59c2a95f92dbaa63c/users/899d0fa4bc124c13aeb830f6f293748b/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:52.410191 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c6a9c-f1fd-44f3-bac6-30ce3b772911 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:52.410631 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c6a9c-f1fd-44f3-bac6-30ce3b772911 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:52.410921 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c6a9c-f1fd-44f3-bac6-30ce3b772911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:52.492731 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-ff8c6a9c-f1fd-44f3-bac6-30ce3b772911 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:52.495744 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ff8c6a9c-f1fd-44f3-bac6-30ce3b772911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:52.654847 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-06dfcd11-c900-45fc-82d8-f76189777181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b85e40eecf3d4caaaa4ca7b36fff69a5'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:52.681918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 817/1662] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:52.683259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-06dfcd11-c900-45fc-82d8-f76189777181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b85e40eecf3d4caaaa4ca7b36fff69a5'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:52.710595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579699d5-fe5e-4078-9767-bd44b03620e0 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:52.710852 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579699d5-fe5e-4078-9767-bd44b03620e0 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:52.711161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579699d5-fe5e-4078-9767-bd44b03620e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:52.757059 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-579699d5-fe5e-4078-9767-bd44b03620e0 None None] MFA Rules not processed for user `61f2fb5928004be4bc85b9aa1d12eef7`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:52.772644 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-579699d5-fe5e-4078-9767-bd44b03620e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:52.789998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-06dfcd11-c900-45fc-82d8-f76189777181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b85e40eecf3d4caaaa4ca7b36fff69a5'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:52.790894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-06dfcd11-c900-45fc-82d8-f76189777181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b85e40eecf3d4caaaa4ca7b36fff69a5'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:52.805174 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-06dfcd11-c900-45fc-82d8-f76189777181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b85e40eecf3d4caaaa4ca7b36fff69a5'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:52.843556 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 846/1663] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:41:52 2022] DELETE /identity/v3/users/b85e40eecf3d4caaaa4ca7b36fff69a5 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:52.845499 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfcd11-c900-45fc-82d8-f76189777181 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:52.851361 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-06dfcd11-c900-45fc-82d8-f76189777181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:52.892581 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:53.018510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 818/1664] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:53.020636 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f814e2-40bf-4536-9b04-fa9b6891593a None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:53.024253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f814e2-40bf-4536-9b04-fa9b6891593a None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:53.024662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f814e2-40bf-4536-9b04-fa9b6891593a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:53.046248 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfcd11-c900-45fc-82d8-f76189777181 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:53.051611 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac461a-13aa-4f77-accd-b933a5fbd001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:53.052380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac461a-13aa-4f77-accd-b933a5fbd001 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:53.052807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac461a-13aa-4f77-accd-b933a5fbd001 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:53.053085 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac461a-13aa-4f77-accd-b933a5fbd001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:53.057868 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e3ac461a-13aa-4f77-accd-b933a5fbd001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:53.065034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-e3f814e2-40bf-4536-9b04-fa9b6891593a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:53.067766 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-e3f814e2-40bf-4536-9b04-fa9b6891593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:53.191495 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 819/1665] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:53.192723 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f814e2-40bf-4536-9b04-fa9b6891593a None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:53.194368 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-e3f814e2-40bf-4536-9b04-fa9b6891593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:53.216386 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac461a-13aa-4f77-accd-b933a5fbd001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:53.218060 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac461a-13aa-4f77-accd-b933a5fbd001 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:53.230621 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 847/1666] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:53.232323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac461a-13aa-4f77-accd-b933a5fbd001 service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:53.265200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac461a-13aa-4f77-accd-b933a5fbd001 service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:53.278839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610cf35-2296-4ccc-a372-163900331b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:53.279598 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610cf35-2296-4ccc-a372-163900331b9f service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:53.279823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610cf35-2296-4ccc-a372-163900331b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:53.280105 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610cf35-2296-4ccc-a372-163900331b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:53.310082 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610cf35-2296-4ccc-a372-163900331b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:53.312288 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610cf35-2296-4ccc-a372-163900331b9f service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:53.341783 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 848/1667] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:53.346197 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610cf35-2296-4ccc-a372-163900331b9f service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:53.350496 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a610cf35-2296-4ccc-a372-163900331b9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:53.358331 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f814e2-40bf-4536-9b04-fa9b6891593a None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:53.377999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e99566-ff82-4b0b-9d27-ebaaed3b2436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:53.378601 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e99566-ff82-4b0b-9d27-ebaaed3b2436 service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:53.378892 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e99566-ff82-4b0b-9d27-ebaaed3b2436 service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:53.379174 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e99566-ff82-4b0b-9d27-ebaaed3b2436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:53.394194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610cf35-2296-4ccc-a372-163900331b9f service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:53.413559 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765f3a8-22d6-4ba3-b6ff-8b2184915496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:53.415490 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765f3a8-22d6-4ba3-b6ff-8b2184915496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:53.415920 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765f3a8-22d6-4ba3-b6ff-8b2184915496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:53.416490 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765f3a8-22d6-4ba3-b6ff-8b2184915496 admin admin] PATH_INFO: `/v3/projects/973d7ccbb11c41818dfd643e01f6e37b` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:53.420072 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765f3a8-22d6-4ba3-b6ff-8b2184915496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=973d7ccbb11c41818dfd643e01f6e37b)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:53.426892 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765f3a8-22d6-4ba3-b6ff-8b2184915496 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:53.531861 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e99566-ff82-4b0b-9d27-ebaaed3b2436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:53.533261 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e99566-ff82-4b0b-9d27-ebaaed3b2436 service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:53.559819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 820/1668] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:53.610497 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c765f3a8-22d6-4ba3-b6ff-8b2184915496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973d7ccbb11c41818dfd643e01f6e37b', 'request_id': 'req-c765f3a8-22d6-4ba3-b6ff-8b2184915496'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:53.662734 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:53.716306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c765f3a8-22d6-4ba3-b6ff-8b2184915496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973d7ccbb11c41818dfd643e01f6e37b', 'request_id': 'req-c765f3a8-22d6-4ba3-b6ff-8b2184915496'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:53.723615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c765f3a8-22d6-4ba3-b6ff-8b2184915496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973d7ccbb11c41818dfd643e01f6e37b', 'request_id': 'req-c765f3a8-22d6-4ba3-b6ff-8b2184915496'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:53.751831 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c765f3a8-22d6-4ba3-b6ff-8b2184915496 admin admin] The token cache is being invalidate because project 973d7ccbb11c41818dfd643e01f6e37b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:41:53.752245 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c765f3a8-22d6-4ba3-b6ff-8b2184915496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:53.754247 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c765f3a8-22d6-4ba3-b6ff-8b2184915496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:53.758561 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 849/1669] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:41:53 2022] DELETE /identity/v3/projects/973d7ccbb11c41818dfd643e01f6e37b => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:53.767746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e354d7-8ae0-40f1-b659-20ec7390656b None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:53.767746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e354d7-8ae0-40f1-b659-20ec7390656b None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:53.768746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e354d7-8ae0-40f1-b659-20ec7390656b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:53.810686 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-38e354d7-8ae0-40f1-b659-20ec7390656b None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:53.811695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-38e354d7-8ae0-40f1-b659-20ec7390656b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:54.002736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 821/1670] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:54.010393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5111e-8f7b-4de1-9d29-742874f1eade None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:54.010682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5111e-8f7b-4de1-9d29-742874f1eade None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:54.010974 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5111e-8f7b-4de1-9d29-742874f1eade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:54.061153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-a8f5111e-8f7b-4de1-9d29-742874f1eade None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:54.062442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a8f5111e-8f7b-4de1-9d29-742874f1eade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:54.121803 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 850/1671] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:54.124122 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e354d7-8ae0-40f1-b659-20ec7390656b None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:54.136438 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e354d7-8ae0-40f1-b659-20ec7390656b None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:54.161602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab06d6-e839-48e2-b4c0-fcaa78c9bc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:54.162575 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab06d6-e839-48e2-b4c0-fcaa78c9bc50 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:54.163000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab06d6-e839-48e2-b4c0-fcaa78c9bc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:54.164056 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab06d6-e839-48e2-b4c0-fcaa78c9bc50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:54.165502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab06d6-e839-48e2-b4c0-fcaa78c9bc50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:41:54.168484 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab06d6-e839-48e2-b4c0-fcaa78c9bc50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:54.177369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab06d6-e839-48e2-b4c0-fcaa78c9bc50 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:54.219791 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 822/1672] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:41:54.221943 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5111e-8f7b-4de1-9d29-742874f1eade None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:54.235732 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5111e-8f7b-4de1-9d29-742874f1eade None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:54.269715 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6134d-f383-4153-9619-1f2b6db80425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:54.270537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6134d-f383-4153-9619-1f2b6db80425 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:54.270928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6134d-f383-4153-9619-1f2b6db80425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:54.271390 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6134d-f383-4153-9619-1f2b6db80425 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:54.272257 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6134d-f383-4153-9619-1f2b6db80425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:54.277999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6134d-f383-4153-9619-1f2b6db80425 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:54.414368 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 851/1673] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:41:54 2022] POST /identity/v3/projects => generated 363 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:54.416142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab06d6-e839-48e2-b4c0-fcaa78c9bc50 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:54.427016 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab06d6-e839-48e2-b4c0-fcaa78c9bc50 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:54.561315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a57005-192d-4648-935a-fde49e0ffdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:54.562262 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a57005-192d-4648-935a-fde49e0ffdec admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:54.562720 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a57005-192d-4648-935a-fde49e0ffdec admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:54.563133 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a57005-192d-4648-935a-fde49e0ffdec admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:54.564017 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a57005-192d-4648-935a-fde49e0ffdec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:54.566163 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a57005-192d-4648-935a-fde49e0ffdec admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:54.740038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 823/1674] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:41:54 2022] POST /identity/v3/users => generated 282 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:54.741337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6134d-f383-4153-9619-1f2b6db80425 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:54.762869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6134d-f383-4153-9619-1f2b6db80425 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:54.771811 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80210d5f-f031-4caf-a0a3-67b1821bcab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:54.772511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80210d5f-f031-4caf-a0a3-67b1821bcab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:54.772797 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80210d5f-f031-4caf-a0a3-67b1821bcab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:54.773080 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80210d5f-f031-4caf-a0a3-67b1821bcab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:54.774132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80210d5f-f031-4caf-a0a3-67b1821bcab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:54.777445 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80210d5f-f031-4caf-a0a3-67b1821bcab8 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:54.790488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a57005-192d-4648-935a-fde49e0ffdec admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:54.792293 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-a5a57005-192d-4648-935a-fde49e0ffdec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:54.796009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 852/1675] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:54.796959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80210d5f-f031-4caf-a0a3-67b1821bcab8 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:54.815068 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80210d5f-f031-4caf-a0a3-67b1821bcab8 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:54.818961 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a57005-192d-4648-935a-fde49e0ffdec admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:54.829317 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd3222-6543-4d28-afa6-e6cca977e236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:54.829603 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd3222-6543-4d28-afa6-e6cca977e236 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:54.829997 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd3222-6543-4d28-afa6-e6cca977e236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:54.829997 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd3222-6543-4d28-afa6-e6cca977e236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:54.830754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd3222-6543-4d28-afa6-e6cca977e236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:54.835756 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9141c2-477c-4930-b9c7-0ad3c36a3c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:54.836656 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9141c2-477c-4930-b9c7-0ad3c36a3c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:54.836941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9141c2-477c-4930-b9c7-0ad3c36a3c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:54.837215 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9141c2-477c-4930-b9c7-0ad3c36a3c96 admin admin] PATH_INFO: `/v3/projects/10504da2d3104d1eaf857e8ede525043` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:54.841966 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9141c2-477c-4930-b9c7-0ad3c36a3c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10504da2d3104d1eaf857e8ede525043)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:54.843962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9141c2-477c-4930-b9c7-0ad3c36a3c96 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:54.844678 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd3222-6543-4d28-afa6-e6cca977e236 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:54.858451 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:54.874254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 853/1676] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:54.875229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd3222-6543-4d28-afa6-e6cca977e236 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:54.895630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd3222-6543-4d28-afa6-e6cca977e236 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:54.912743 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfb93e-f65e-41cb-b7bd-7536aa6a7d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:54.913794 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfb93e-f65e-41cb-b7bd-7536aa6a7d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:54.914217 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfb93e-f65e-41cb-b7bd-7536aa6a7d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:54.914601 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfb93e-f65e-41cb-b7bd-7536aa6a7d4e admin admin] PATH_INFO: `/v3/projects/38db260b9f8c442184f5bd1ca5d90292/users/b13ba58fcda8482981aa801639d822cc/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:54.947904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfb93e-f65e-41cb-b7bd-7536aa6a7d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=38db260b9f8c442184f5bd1ca5d90292, user_id=b13ba58fcda8482981aa801639d822cc, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:54.964758 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfb93e-f65e-41cb-b7bd-7536aa6a7d4e admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:55.063549 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 854/1677] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:41:54 2022] PUT /identity/v3/projects/38db260b9f8c442184f5bd1ca5d90292/users/b13ba58fcda8482981aa801639d822cc/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:55.065157 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda94687-71bd-4fed-a7c2-8b4e28eff600 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:55.065451 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda94687-71bd-4fed-a7c2-8b4e28eff600 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:55.065726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda94687-71bd-4fed-a7c2-8b4e28eff600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:55.078309 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-7e9141c2-477c-4930-b9c7-0ad3c36a3c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10504da2d3104d1eaf857e8ede525043', 'request_id': 'req-7e9141c2-477c-4930-b9c7-0ad3c36a3c96'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:55.106289 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-7e9141c2-477c-4930-b9c7-0ad3c36a3c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10504da2d3104d1eaf857e8ede525043', 'request_id': 'req-7e9141c2-477c-4930-b9c7-0ad3c36a3c96'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:55.149981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-7e9141c2-477c-4930-b9c7-0ad3c36a3c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10504da2d3104d1eaf857e8ede525043', 'request_id': 'req-7e9141c2-477c-4930-b9c7-0ad3c36a3c96'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:55.153836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-eda94687-71bd-4fed-a7c2-8b4e28eff600 None None] MFA Rules not processed for user `b13ba58fcda8482981aa801639d822cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:55.160107 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-eda94687-71bd-4fed-a7c2-8b4e28eff600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:55.287765 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-7e9141c2-477c-4930-b9c7-0ad3c36a3c96 admin admin] The token cache is being invalidate because project 10504da2d3104d1eaf857e8ede525043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:41:55.288693 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-7e9141c2-477c-4930-b9c7-0ad3c36a3c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:55.290020 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-7e9141c2-477c-4930-b9c7-0ad3c36a3c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:55.298363 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 824/1678] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:41:54 2022] DELETE /identity/v3/projects/10504da2d3104d1eaf857e8ede525043 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:41:55.307970 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902834e-bd45-4815-9d44-a82799c945ef None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:55.312319 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902834e-bd45-4815-9d44-a82799c945ef None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:55.312319 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902834e-bd45-4815-9d44-a82799c945ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:55.384275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-b902834e-bd45-4815-9d44-a82799c945ef None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:55.386254 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b902834e-bd45-4815-9d44-a82799c945ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:55.468223 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 855/1679] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:55.480739 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda94687-71bd-4fed-a7c2-8b4e28eff600 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:55.484669 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-eda94687-71bd-4fed-a7c2-8b4e28eff600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:55.552944 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 825/1680] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:55.569200 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d984e2-b761-4822-bb3b-f9144154c3e3 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:55.569654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d984e2-b761-4822-bb3b-f9144154c3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:55.571806 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d984e2-b761-4822-bb3b-f9144154c3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:55.625464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-64d984e2-b761-4822-bb3b-f9144154c3e3 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:55.627217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-64d984e2-b761-4822-bb3b-f9144154c3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:55.656018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 826/1681] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:55.661947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d984e2-b761-4822-bb3b-f9144154c3e3 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:55.688815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d984e2-b761-4822-bb3b-f9144154c3e3 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:55.702944 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964ddf7-070e-4f97-8146-1d080ba0e720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:55.703683 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964ddf7-070e-4f97-8146-1d080ba0e720 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:55.703968 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964ddf7-070e-4f97-8146-1d080ba0e720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:55.704307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964ddf7-070e-4f97-8146-1d080ba0e720 admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:55.705236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964ddf7-070e-4f97-8146-1d080ba0e720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:41:55.705639 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964ddf7-070e-4f97-8146-1d080ba0e720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:55.711697 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964ddf7-070e-4f97-8146-1d080ba0e720 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:55.727318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda94687-71bd-4fed-a7c2-8b4e28eff600 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:55.740374 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529ccc8-df25-4970-8415-c08b537d0968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:55.741239 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529ccc8-df25-4970-8415-c08b537d0968 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:55.741514 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529ccc8-df25-4970-8415-c08b537d0968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:55.741974 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529ccc8-df25-4970-8415-c08b537d0968 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:55.742699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529ccc8-df25-4970-8415-c08b537d0968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:55.745684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529ccc8-df25-4970-8415-c08b537d0968 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:55.751442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 827/1682] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:41:55.754886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964ddf7-070e-4f97-8146-1d080ba0e720 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:55.776177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964ddf7-070e-4f97-8146-1d080ba0e720 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:55.797303 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ef296-d5b5-4d94-8ec1-5fe3ff8187e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:55.798058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ef296-d5b5-4d94-8ec1-5fe3ff8187e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:55.799254 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ef296-d5b5-4d94-8ec1-5fe3ff8187e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:55.799593 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ef296-d5b5-4d94-8ec1-5fe3ff8187e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:55.800329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ef296-d5b5-4d94-8ec1-5fe3ff8187e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:55.803888 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ef296-d5b5-4d94-8ec1-5fe3ff8187e9 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:55.861982 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 856/1683] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:41:55 2022] POST /identity/v3/projects => generated 363 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:55.863804 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529ccc8-df25-4970-8415-c08b537d0968 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:55.951896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 828/1684] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:41:55 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:55.954275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdb41b-b5dc-4ba2-b20b-f68c444d12d3 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:55.954275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdb41b-b5dc-4ba2-b20b-f68c444d12d3 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:55.954607 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdb41b-b5dc-4ba2-b20b-f68c444d12d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:55.993621 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:56.033902 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529ccc8-df25-4970-8415-c08b537d0968 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:56.035487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-96fdb41b-b5dc-4ba2-b20b-f68c444d12d3 None None] MFA Rules not processed for user `87fcc3fa1cbe4afeaa0e455f2631411a`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:56.037346 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-96fdb41b-b5dc-4ba2-b20b-f68c444d12d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:56.201199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ac550-1eb2-4e4d-b6d1-caa73ebfb496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:56.201830 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ac550-1eb2-4e4d-b6d1-caa73ebfb496 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:56.202121 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ac550-1eb2-4e4d-b6d1-caa73ebfb496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:56.202408 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ac550-1eb2-4e4d-b6d1-caa73ebfb496 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:56.203117 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ac550-1eb2-4e4d-b6d1-caa73ebfb496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:56.208590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ac550-1eb2-4e4d-b6d1-caa73ebfb496 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:56.211813 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 829/1685] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:56.213308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdb41b-b5dc-4ba2-b20b-f68c444d12d3 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:56.263785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdb41b-b5dc-4ba2-b20b-f68c444d12d3 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:56.271198 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d2ba8-711e-4752-9fbf-211edf22f754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:56.271752 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d2ba8-711e-4752-9fbf-211edf22f754 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:56.272202 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d2ba8-711e-4752-9fbf-211edf22f754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:56.272624 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d2ba8-711e-4752-9fbf-211edf22f754 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:56.273546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d2ba8-711e-4752-9fbf-211edf22f754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:56.275846 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d2ba8-711e-4752-9fbf-211edf22f754 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:56.340799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 857/1686] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:41:55 2022] POST /identity/v3/users => generated 288 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:56.342518 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ac550-1eb2-4e4d-b6d1-caa73ebfb496 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:56.346039 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1c8ac550-1eb2-4e4d-b6d1-caa73ebfb496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:56.396581 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 830/1687] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:41:56 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:56.397979 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d2ba8-711e-4752-9fbf-211edf22f754 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:56.437521 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d2ba8-711e-4752-9fbf-211edf22f754 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:56.459185 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b6bee-a04b-4792-b53e-461935b2f014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:56.460090 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b6bee-a04b-4792-b53e-461935b2f014 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:56.462251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b6bee-a04b-4792-b53e-461935b2f014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:56.462709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b6bee-a04b-4792-b53e-461935b2f014 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:56.463666 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b6bee-a04b-4792-b53e-461935b2f014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:56.469505 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b6bee-a04b-4792-b53e-461935b2f014 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:56.518871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 831/1688] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:56.520866 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b6bee-a04b-4792-b53e-461935b2f014 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:56.540870 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ac550-1eb2-4e4d-b6d1-caa73ebfb496 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:56.547167 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b6bee-a04b-4792-b53e-461935b2f014 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:56.553324 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2999e-731b-4dae-a242-f23c3685674d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:56.562667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab9a0f-dd56-4027-865b-5789537be33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:56.563398 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab9a0f-dd56-4027-865b-5789537be33b admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:56.564068 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2999e-731b-4dae-a242-f23c3685674d service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:56.564495 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2999e-731b-4dae-a242-f23c3685674d service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:56.564785 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2999e-731b-4dae-a242-f23c3685674d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:56.565756 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab9a0f-dd56-4027-865b-5789537be33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:56.566049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab9a0f-dd56-4027-865b-5789537be33b admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:56.566809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab9a0f-dd56-4027-865b-5789537be33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:56.570946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab9a0f-dd56-4027-865b-5789537be33b admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:56.584393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2999e-731b-4dae-a242-f23c3685674d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:56.586390 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2999e-731b-4dae-a242-f23c3685674d service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:56.599646 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 858/1689] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:56.601034 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2999e-731b-4dae-a242-f23c3685674d service nova] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:56.613747 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2999e-731b-4dae-a242-f23c3685674d service nova] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:56.622541 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 832/1690] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:56.622541 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab9a0f-dd56-4027-865b-5789537be33b admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:56.623119 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afcb25-afb1-45f0-996d-38b09eac4f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:56.624662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afcb25-afb1-45f0-996d-38b09eac4f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:56.625197 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afcb25-afb1-45f0-996d-38b09eac4f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:56.625654 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afcb25-afb1-45f0-996d-38b09eac4f69 admin admin] PATH_INFO: `/v3/projects/4a41d205a74f41aeb5da9ffa4843b789/users/8df3482383ad41e5a4edf80b12e7c7cc/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:56.630159 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-41ab9a0f-dd56-4027-865b-5789537be33b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:56.646132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afcb25-afb1-45f0-996d-38b09eac4f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a41d205a74f41aeb5da9ffa4843b789, user_id=8df3482383ad41e5a4edf80b12e7c7cc, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:56.649896 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afcb25-afb1-45f0-996d-38b09eac4f69 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:56.665976 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab9a0f-dd56-4027-865b-5789537be33b admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:56.678568 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05066ce-4923-442a-be54-a57219581131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:56.682313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05066ce-4923-442a-be54-a57219581131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:56.683058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05066ce-4923-442a-be54-a57219581131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:56.683416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05066ce-4923-442a-be54-a57219581131 admin admin] PATH_INFO: `/v3/users/ce1a840a6d4f48a58626784899176bd2` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:56.686674 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05066ce-4923-442a-be54-a57219581131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce1a840a6d4f48a58626784899176bd2)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:56.691046 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05066ce-4923-442a-be54-a57219581131 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:56.755902 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 859/1691] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:41:56 2022] PUT /identity/v3/projects/4a41d205a74f41aeb5da9ffa4843b789/users/8df3482383ad41e5a4edf80b12e7c7cc/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:56.757351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afcb25-afb1-45f0-996d-38b09eac4f69 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:56.819651 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:56.914725 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afcb25-afb1-45f0-996d-38b09eac4f69 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:56.920467 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498a433-ecb3-4ea5-aa3d-590f6abf8525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:56.921303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498a433-ecb3-4ea5-aa3d-590f6abf8525 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:56.921598 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498a433-ecb3-4ea5-aa3d-590f6abf8525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:56.921885 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498a433-ecb3-4ea5-aa3d-590f6abf8525 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:56.922633 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498a433-ecb3-4ea5-aa3d-590f6abf8525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:56.924252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498a433-ecb3-4ea5-aa3d-590f6abf8525 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:56.938006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 860/1692] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:56.942601 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db292297-d4eb-40a7-ba93-89a014aa2d61 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:56.943873 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db292297-d4eb-40a7-ba93-89a014aa2d61 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:56.944174 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db292297-d4eb-40a7-ba93-89a014aa2d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:56.953901 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-d05066ce-4923-442a-be54-a57219581131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce1a840a6d4f48a58626784899176bd2'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:56.985749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-db292297-d4eb-40a7-ba93-89a014aa2d61 None None] MFA Rules not processed for user `899d0fa4bc124c13aeb830f6f293748b`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:56.986744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-db292297-d4eb-40a7-ba93-89a014aa2d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:56.998502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-d05066ce-4923-442a-be54-a57219581131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce1a840a6d4f48a58626784899176bd2'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:57.032067 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-d05066ce-4923-442a-be54-a57219581131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce1a840a6d4f48a58626784899176bd2'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:57.127301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:57.169174 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-d05066ce-4923-442a-be54-a57219581131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce1a840a6d4f48a58626784899176bd2'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:57.171788 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-d05066ce-4923-442a-be54-a57219581131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce1a840a6d4f48a58626784899176bd2'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:57.188004 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 861/1693] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:57.188924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db292297-d4eb-40a7-ba93-89a014aa2d61 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:57.205521 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 833/1694] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:41:56 2022] DELETE /identity/v3/users/ce1a840a6d4f48a58626784899176bd2 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:57.209303 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb526664-3197-48bc-bc63-ffb1b183496e None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:57.209819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb526664-3197-48bc-bc63-ffb1b183496e None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:57.212846 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb526664-3197-48bc-bc63-ffb1b183496e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:57.226576 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db292297-d4eb-40a7-ba93-89a014aa2d61 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:57.338832 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-bb526664-3197-48bc-bc63-ffb1b183496e None None] MFA Rules not processed for user `0068ad02f128494faa67e80b092c1deb`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:57.350754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-bb526664-3197-48bc-bc63-ffb1b183496e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:57.363933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98ea0c-e1db-4128-8f6d-45934cc19740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:57.364622 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98ea0c-e1db-4128-8f6d-45934cc19740 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:57.364907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98ea0c-e1db-4128-8f6d-45934cc19740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:57.365183 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98ea0c-e1db-4128-8f6d-45934cc19740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:57.365924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98ea0c-e1db-4128-8f6d-45934cc19740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:57.367826 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98ea0c-e1db-4128-8f6d-45934cc19740 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:57.381593 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 862/1695] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:57.382301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98ea0c-e1db-4128-8f6d-45934cc19740 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:57.384960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1b98ea0c-e1db-4128-8f6d-45934cc19740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:57.401859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98ea0c-e1db-4128-8f6d-45934cc19740 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:57.409560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83e3a6-29b6-423f-9921-c303a68d0575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:57.410814 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e3a6-29b6-423f-9921-c303a68d0575 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:57.410954 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e3a6-29b6-423f-9921-c303a68d0575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:57.414664 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e3a6-29b6-423f-9921-c303a68d0575 admin admin] PATH_INFO: `/v3/projects/6238d1a246ba4c6897e1a231fe56794b/users/d11dbba443c1461dabb1f08d816a2106/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:57.434609 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83e3a6-29b6-423f-9921-c303a68d0575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6238d1a246ba4c6897e1a231fe56794b, user_id=d11dbba443c1461dabb1f08d816a2106, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:57.437459 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83e3a6-29b6-423f-9921-c303a68d0575 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:57.583293 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 863/1696] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:41:57 2022] PUT /identity/v3/projects/6238d1a246ba4c6897e1a231fe56794b/users/d11dbba443c1461dabb1f08d816a2106/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:57.586058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83e3a6-29b6-423f-9921-c303a68d0575 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:57.593488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-cc83e3a6-29b6-423f-9921-c303a68d0575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:57.606112 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 834/1697] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:57.607455 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb976b6b-fd97-4e1c-b5c6-32c6b58f74eb None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:57.607758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb976b6b-fd97-4e1c-b5c6-32c6b58f74eb None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:57.608044 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb976b6b-fd97-4e1c-b5c6-32c6b58f74eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:57.633161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-cb976b6b-fd97-4e1c-b5c6-32c6b58f74eb None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:57.634421 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-cb976b6b-fd97-4e1c-b5c6-32c6b58f74eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:57.767887 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 835/1698] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:57.768835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb976b6b-fd97-4e1c-b5c6-32c6b58f74eb None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:57.771882 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-cb976b6b-fd97-4e1c-b5c6-32c6b58f74eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:57.788093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83e3a6-29b6-423f-9921-c303a68d0575 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:57.796495 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be603825-1e0d-43ba-9c71-1b9f98e882f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:57.798147 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be603825-1e0d-43ba-9c71-1b9f98e882f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:57.798636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be603825-1e0d-43ba-9c71-1b9f98e882f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:57.799245 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be603825-1e0d-43ba-9c71-1b9f98e882f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:57.799625 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb976b6b-fd97-4e1c-b5c6-32c6b58f74eb None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:57.800557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be603825-1e0d-43ba-9c71-1b9f98e882f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:57.802682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be603825-1e0d-43ba-9c71-1b9f98e882f9 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:57.817974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c314c09-6cf2-4014-abf8-8504de6b65a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:57.818874 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c314c09-6cf2-4014-abf8-8504de6b65a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:57.819162 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c314c09-6cf2-4014-abf8-8504de6b65a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:57.819487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c314c09-6cf2-4014-abf8-8504de6b65a4 admin admin] PATH_INFO: `/v3/projects/4a41d205a74f41aeb5da9ffa4843b789/users/8df3482383ad41e5a4edf80b12e7c7cc/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:57.822101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c314c09-6cf2-4014-abf8-8504de6b65a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a41d205a74f41aeb5da9ffa4843b789, user_id=8df3482383ad41e5a4edf80b12e7c7cc, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:57.824893 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c314c09-6cf2-4014-abf8-8504de6b65a4 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:57.860905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 836/1699] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:41:57 2022] PUT /identity/v3/projects/4a41d205a74f41aeb5da9ffa4843b789/users/8df3482383ad41e5a4edf80b12e7c7cc/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:57.862958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc1087-879d-4012-a4e4-145324d1bb28 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:57.863330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc1087-879d-4012-a4e4-145324d1bb28 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:57.863767 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc1087-879d-4012-a4e4-145324d1bb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:57.908696 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 864/1700] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:41:57 2022] POST /identity/v3/projects => generated 405 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:57.911858 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-6dcc1087-879d-4012-a4e4-145324d1bb28 None None] MFA Rules not processed for user `d11dbba443c1461dabb1f08d816a2106`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:57.912939 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b8a27-539a-4ffe-871d-7801f247426a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:57.912939 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b8a27-539a-4ffe-871d-7801f247426a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:57.913637 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b8a27-539a-4ffe-871d-7801f247426a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:57.915937 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-6dcc1087-879d-4012-a4e4-145324d1bb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:57.963359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-2e2b8a27-539a-4ffe-871d-7801f247426a None None] MFA Rules not processed for user `0068ad02f128494faa67e80b092c1deb`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:57.965573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-2e2b8a27-539a-4ffe-871d-7801f247426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:58.129612 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 865/1701] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:58.129612 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0304d5-bb1e-47f9-a516-40bfdf934864 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:58.131749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0304d5-bb1e-47f9-a516-40bfdf934864 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:58.132086 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0304d5-bb1e-47f9-a516-40bfdf934864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:58.167511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 837/1702] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:58.177318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc1087-879d-4012-a4e4-145324d1bb28 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:58.181252 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-6dcc1087-879d-4012-a4e4-145324d1bb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:58.194306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-0a0304d5-bb1e-47f9-a516-40bfdf934864 None None] MFA Rules not processed for user `abb27a4eecd14ab89a1d349fa3bdc0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:58.195641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0a0304d5-bb1e-47f9-a516-40bfdf934864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:58.265760 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:58.382388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 866/1703] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:58.383985 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79565553-5ddf-4eb0-bb0c-6939b8260831 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:58.384279 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79565553-5ddf-4eb0-bb0c-6939b8260831 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:58.384565 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79565553-5ddf-4eb0-bb0c-6939b8260831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:58.392375 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc1087-879d-4012-a4e4-145324d1bb28 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:58.406180 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd08a0-3267-4a9d-96f1-a5e98c78ef40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:58.406955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd08a0-3267-4a9d-96f1-a5e98c78ef40 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:58.407252 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd08a0-3267-4a9d-96f1-a5e98c78ef40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:58.407587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd08a0-3267-4a9d-96f1-a5e98c78ef40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:58.447664 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-79565553-5ddf-4eb0-bb0c-6939b8260831 None None] MFA Rules not processed for user `8df3482383ad41e5a4edf80b12e7c7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:58.451917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-79565553-5ddf-4eb0-bb0c-6939b8260831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:58.500617 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:58.546916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd08a0-3267-4a9d-96f1-a5e98c78ef40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:58.551268 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd08a0-3267-4a9d-96f1-a5e98c78ef40 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:58.576594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 867/1704] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:58 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:58.577667 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79565553-5ddf-4eb0-bb0c-6939b8260831 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:58.581850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 838/1705] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:58.584761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd08a0-3267-4a9d-96f1-a5e98c78ef40 service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:58.588672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-69bd08a0-3267-4a9d-96f1-a5e98c78ef40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:58.593428 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79565553-5ddf-4eb0-bb0c-6939b8260831 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:58.598494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf65ea8-b1c7-4239-bedd-bea9f6da93a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:58.599487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf65ea8-b1c7-4239-bedd-bea9f6da93a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:58.599786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf65ea8-b1c7-4239-bedd-bea9f6da93a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:58.600072 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf65ea8-b1c7-4239-bedd-bea9f6da93a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:58.601031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf65ea8-b1c7-4239-bedd-bea9f6da93a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:58.603205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf65ea8-b1c7-4239-bedd-bea9f6da93a1 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:58.714036 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 868/1706] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:41:58 2022] POST /identity/v3/users => generated 309 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:58.715877 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf65ea8-b1c7-4239-bedd-bea9f6da93a1 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:58.719331 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd08a0-3267-4a9d-96f1-a5e98c78ef40 service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:58.728063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bfba2-f4e6-414e-914a-3e9fe027b4d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:58.728758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bfba2-f4e6-414e-914a-3e9fe027b4d0 service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:58.732535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bfba2-f4e6-414e-914a-3e9fe027b4d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:58.733023 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bfba2-f4e6-414e-914a-3e9fe027b4d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:58.740841 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf65ea8-b1c7-4239-bedd-bea9f6da93a1 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:58.752872 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f89479-20b0-48c3-9cf5-2677c29a8a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:58.753448 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bfba2-f4e6-414e-914a-3e9fe027b4d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:58.754794 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f89479-20b0-48c3-9cf5-2677c29a8a92 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:58.755089 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f89479-20b0-48c3-9cf5-2677c29a8a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:58.756783 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f89479-20b0-48c3-9cf5-2677c29a8a92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:58.757511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f89479-20b0-48c3-9cf5-2677c29a8a92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:58.757690 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bfba2-f4e6-414e-914a-3e9fe027b4d0 service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:58.763188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f89479-20b0-48c3-9cf5-2677c29a8a92 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:58.781981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 839/1707] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:58.784153 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81277e7d-6828-4b11-a227-7bf8db8e0070 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:58.784453 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81277e7d-6828-4b11-a227-7bf8db8e0070 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:58.784835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81277e7d-6828-4b11-a227-7bf8db8e0070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:58.821957 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-81277e7d-6828-4b11-a227-7bf8db8e0070 None None] MFA Rules not processed for user `abb27a4eecd14ab89a1d349fa3bdc0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:41:58.823263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-81277e7d-6828-4b11-a227-7bf8db8e0070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:58.832887 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 840/1708] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:41:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:41:58.833874 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81277e7d-6828-4b11-a227-7bf8db8e0070 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:58.838208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-81277e7d-6828-4b11-a227-7bf8db8e0070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:58.903049 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 869/1709] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:41:58 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:58.904664 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f89479-20b0-48c3-9cf5-2677c29a8a92 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:59.045638 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81277e7d-6828-4b11-a227-7bf8db8e0070 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:59.127683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f89479-20b0-48c3-9cf5-2677c29a8a92 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:59.142336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c5842-2e12-46ff-af2e-3ff6eb6960fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:59.148081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c5842-2e12-46ff-af2e-3ff6eb6960fc admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:59.148081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c5842-2e12-46ff-af2e-3ff6eb6960fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:59.148081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c5842-2e12-46ff-af2e-3ff6eb6960fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:59.148081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c5842-2e12-46ff-af2e-3ff6eb6960fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:59.148081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c5842-2e12-46ff-af2e-3ff6eb6960fc admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:59.169775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5da80-e990-4b6f-b680-e6e7f5ebf153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:59.170765 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5da80-e990-4b6f-b680-e6e7f5ebf153 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:59.171244 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5da80-e990-4b6f-b680-e6e7f5ebf153 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:59.171612 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5da80-e990-4b6f-b680-e6e7f5ebf153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:59.173896 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 870/1710] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:41:59.174855 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c5842-2e12-46ff-af2e-3ff6eb6960fc admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:59.181528 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-3d6c5842-2e12-46ff-af2e-3ff6eb6960fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:59.371816 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5da80-e990-4b6f-b680-e6e7f5ebf153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:59.379956 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5da80-e990-4b6f-b680-e6e7f5ebf153 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:59.389267 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c5842-2e12-46ff-af2e-3ff6eb6960fc admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:59.403523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaca57b-953b-42a3-9fbb-88d9831d7a65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:59.405814 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaca57b-953b-42a3-9fbb-88d9831d7a65 service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:59.409783 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaca57b-953b-42a3-9fbb-88d9831d7a65 service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:59.411264 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaca57b-953b-42a3-9fbb-88d9831d7a65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:59.412104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 841/1711] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:58 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:59.414018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5da80-e990-4b6f-b680-e6e7f5ebf153 service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:59.442223 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5da80-e990-4b6f-b680-e6e7f5ebf153 service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:59.461692 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec91741-6ba2-4b73-9e03-b989ca432543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:59.462524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec91741-6ba2-4b73-9e03-b989ca432543 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:59.462876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec91741-6ba2-4b73-9e03-b989ca432543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:59.467500 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec91741-6ba2-4b73-9e03-b989ca432543 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:59.467500 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec91741-6ba2-4b73-9e03-b989ca432543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:59.467500 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec91741-6ba2-4b73-9e03-b989ca432543 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:59.566863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaca57b-953b-42a3-9fbb-88d9831d7a65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:59.573731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaca57b-953b-42a3-9fbb-88d9831d7a65 service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:59.598033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 871/1712] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:41:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:41:59.603733 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaca57b-953b-42a3-9fbb-88d9831d7a65 service nova] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:59.632641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaca57b-953b-42a3-9fbb-88d9831d7a65 service nova] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:59.643263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 842/1713] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:41:59 2022] POST /identity/v3/users => generated 294 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:41:59.647537 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec91741-6ba2-4b73-9e03-b989ca432543 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:59.647744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61f94a-d617-4685-be19-5264e52788af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:59.647744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61f94a-d617-4685-be19-5264e52788af admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:59.647744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61f94a-d617-4685-be19-5264e52788af admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:59.647744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61f94a-d617-4685-be19-5264e52788af admin admin] PATH_INFO: `/v3/projects/ba953a17d8384dc9bf766f9e003be154/users/1fe49f461a1443f59d20f072f1555db4/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:59.651663 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2ec91741-6ba2-4b73-9e03-b989ca432543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:41:59.691312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61f94a-d617-4685-be19-5264e52788af admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba953a17d8384dc9bf766f9e003be154, user_id=1fe49f461a1443f59d20f072f1555db4, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:59.695898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61f94a-d617-4685-be19-5264e52788af admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:59.700254 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec91741-6ba2-4b73-9e03-b989ca432543 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:41:59.702785 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:41:59.718608 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1e96c-25b9-4569-b1ad-145d80e6d1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:41:59.724200 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1e96c-25b9-4569-b1ad-145d80e6d1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:41:59.724522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1e96c-25b9-4569-b1ad-145d80e6d1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:41:59.724769 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1e96c-25b9-4569-b1ad-145d80e6d1b4 admin admin] PATH_INFO: `/v3/projects/d8cfec85d8184dd085836c259a0337ae` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:41:59.736210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1e96c-25b9-4569-b1ad-145d80e6d1b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8cfec85d8184dd085836c259a0337ae)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:41:59.744527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1e96c-25b9-4569-b1ad-145d80e6d1b4 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:41:59.785772 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 872/1714] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:41:59 2022] PUT /identity/v3/projects/ba953a17d8384dc9bf766f9e003be154/users/1fe49f461a1443f59d20f072f1555db4/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:41:59.788880 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61f94a-d617-4685-be19-5264e52788af admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:41:59.942331 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0eb1e96c-25b9-4569-b1ad-145d80e6d1b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8cfec85d8184dd085836c259a0337ae', 'request_id': 'req-0eb1e96c-25b9-4569-b1ad-145d80e6d1b4'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:59.959722 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0eb1e96c-25b9-4569-b1ad-145d80e6d1b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8cfec85d8184dd085836c259a0337ae', 'request_id': 'req-0eb1e96c-25b9-4569-b1ad-145d80e6d1b4'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:41:59.971394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0eb1e96c-25b9-4569-b1ad-145d80e6d1b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8cfec85d8184dd085836c259a0337ae', 'request_id': 'req-0eb1e96c-25b9-4569-b1ad-145d80e6d1b4'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:00.000574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61f94a-d617-4685-be19-5264e52788af admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:00.064907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0eb1e96c-25b9-4569-b1ad-145d80e6d1b4 admin admin] The token cache is being invalidate because project d8cfec85d8184dd085836c259a0337ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:00.065511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0eb1e96c-25b9-4569-b1ad-145d80e6d1b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:00.067620 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0eb1e96c-25b9-4569-b1ad-145d80e6d1b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:00.071878 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 843/1715] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:41:59 2022] DELETE /identity/v3/projects/d8cfec85d8184dd085836c259a0337ae => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:00.077056 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1e96c-25b9-4569-b1ad-145d80e6d1b4 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:00.083496 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0eb1e96c-25b9-4569-b1ad-145d80e6d1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:00.164244 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ea595-c214-4615-9f36-9d7ad3982aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:00.164956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea595-c214-4615-9f36-9d7ad3982aed admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:00.165248 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea595-c214-4615-9f36-9d7ad3982aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:00.165530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea595-c214-4615-9f36-9d7ad3982aed admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:00.166282 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ea595-c214-4615-9f36-9d7ad3982aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:00.168042 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ea595-c214-4615-9f36-9d7ad3982aed admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:00.197688 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 873/1716] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:00.198695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ea595-c214-4615-9f36-9d7ad3982aed admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:00.206023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-703ea595-c214-4615-9f36-9d7ad3982aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:00.237770 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ea595-c214-4615-9f36-9d7ad3982aed admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:00.274879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dbed1-336f-45e8-8fbd-71ca06576313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:00.276932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dbed1-336f-45e8-8fbd-71ca06576313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:00.279628 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dbed1-336f-45e8-8fbd-71ca06576313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:00.279628 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dbed1-336f-45e8-8fbd-71ca06576313 admin admin] PATH_INFO: `/v3/users/cbc4269ba5a747aebac020f238641651` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:00.283951 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13dbed1-336f-45e8-8fbd-71ca06576313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc4269ba5a747aebac020f238641651)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:00.285932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13dbed1-336f-45e8-8fbd-71ca06576313 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:00.309697 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1e96c-25b9-4569-b1ad-145d80e6d1b4 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:00.325087 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f34c02-cfed-4ad9-8f3b-8cb368f3d6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:00.326390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f34c02-cfed-4ad9-8f3b-8cb368f3d6dc admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:00.326390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f34c02-cfed-4ad9-8f3b-8cb368f3d6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:00.326390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f34c02-cfed-4ad9-8f3b-8cb368f3d6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:00.328209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f34c02-cfed-4ad9-8f3b-8cb368f3d6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:00.329897 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f34c02-cfed-4ad9-8f3b-8cb368f3d6dc admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:00.364656 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 844/1717] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:00.369196 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8b49c-6234-4955-a604-9c39c0fd6b3c None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:00.369419 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8b49c-6234-4955-a604-9c39c0fd6b3c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:00.369760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8b49c-6234-4955-a604-9c39c0fd6b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:00.428785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-9de8b49c-6234-4955-a604-9c39c0fd6b3c None None] MFA Rules not processed for user `61f2fb5928004be4bc85b9aa1d12eef7`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:00.435819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-9de8b49c-6234-4955-a604-9c39c0fd6b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:00.541435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f13dbed1-336f-45e8-8fbd-71ca06576313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc4269ba5a747aebac020f238641651'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:00.601015 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f13dbed1-336f-45e8-8fbd-71ca06576313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc4269ba5a747aebac020f238641651'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:00.611557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 845/1718] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:00.612556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8b49c-6234-4955-a604-9c39c0fd6b3c None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:00.620513 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-9de8b49c-6234-4955-a604-9c39c0fd6b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:00.642849 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8b49c-6234-4955-a604-9c39c0fd6b3c None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:00.656119 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918ac3e-5f30-4d72-b2c5-a6b4ac740fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:00.661007 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918ac3e-5f30-4d72-b2c5-a6b4ac740fac admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:00.661468 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918ac3e-5f30-4d72-b2c5-a6b4ac740fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:00.661920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918ac3e-5f30-4d72-b2c5-a6b4ac740fac admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:00.662826 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918ac3e-5f30-4d72-b2c5-a6b4ac740fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:00.666365 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918ac3e-5f30-4d72-b2c5-a6b4ac740fac admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:00.697838 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 846/1719] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:00.699639 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918ac3e-5f30-4d72-b2c5-a6b4ac740fac admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:00.706756 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f13dbed1-336f-45e8-8fbd-71ca06576313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc4269ba5a747aebac020f238641651'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:00.707611 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f13dbed1-336f-45e8-8fbd-71ca06576313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc4269ba5a747aebac020f238641651'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:00.717765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f13dbed1-336f-45e8-8fbd-71ca06576313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc4269ba5a747aebac020f238641651'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:00.723098 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918ac3e-5f30-4d72-b2c5-a6b4ac740fac admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:00.738460 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c739e84-0afb-4215-871f-76906a993202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:00.740644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 874/1720] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:00 2022] DELETE /identity/v3/users/cbc4269ba5a747aebac020f238641651 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:00.744920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:00.745010 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb6c0f-c2e0-44a8-bddc-ae660a8d4be5 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:00.745274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb6c0f-c2e0-44a8-bddc-ae660a8d4be5 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:00.746905 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb6c0f-c2e0-44a8-bddc-ae660a8d4be5 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:00.747292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c739e84-0afb-4215-871f-76906a993202 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:00.747938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c739e84-0afb-4215-871f-76906a993202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:00.748430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c739e84-0afb-4215-871f-76906a993202 admin admin] PATH_INFO: `/v3/projects/ba953a17d8384dc9bf766f9e003be154/users/1fe49f461a1443f59d20f072f1555db4/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:00.750683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 875/1721] 10.222.0.40 () {54 vars in 912 bytes} [Tue Jul 12 14:42:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:42:00.751491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c739e84-0afb-4215-871f-76906a993202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba953a17d8384dc9bf766f9e003be154, user_id=1fe49f461a1443f59d20f072f1555db4, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:00.751609 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb6c0f-c2e0-44a8-bddc-ae660a8d4be5 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:00.755740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c739e84-0afb-4215-871f-76906a993202 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:00.755935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-06eb6c0f-c2e0-44a8-bddc-ae660a8d4be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:00.783858 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 847/1722] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:00 2022] PUT /identity/v3/projects/ba953a17d8384dc9bf766f9e003be154/users/1fe49f461a1443f59d20f072f1555db4/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:00.785603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc274674-dc2f-47ea-9161-15d5daf66b6f None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:00.787139 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc274674-dc2f-47ea-9161-15d5daf66b6f None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:00.787711 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc274674-dc2f-47ea-9161-15d5daf66b6f None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:00.789277 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 848/1723] 10.222.0.40 () {54 vars in 912 bytes} [Tue Jul 12 14:42:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:42:00.795849 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d7778-e53b-4c00-9239-effebd94b991 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:00.796277 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d7778-e53b-4c00-9239-effebd94b991 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:00.796732 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d7778-e53b-4c00-9239-effebd94b991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:00.900861 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-bb2d7778-e53b-4c00-9239-effebd94b991 None None] MFA Rules not processed for user `2af2d348fc984ed897fd58196b433b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:00.905772 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-bb2d7778-e53b-4c00-9239-effebd94b991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:00.944354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb6c0f-c2e0-44a8-bddc-ae660a8d4be5 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:01.014318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:01.048745 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7666e-0634-4c91-94f7-bd93ee834127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:01.049755 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7666e-0634-4c91-94f7-bd93ee834127 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:01.050043 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7666e-0634-4c91-94f7-bd93ee834127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:01.051058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7666e-0634-4c91-94f7-bd93ee834127 admin admin] PATH_INFO: `/v3/projects/069a544503ed45b5813f1afaaef849e1/users/1147492f975d4dcdb6cd6afd9cb7d249/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:01.081194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 849/1724] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Jul 12 14:42:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:01.082784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7666e-0634-4c91-94f7-bd93ee834127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=069a544503ed45b5813f1afaaef849e1, user_id=1147492f975d4dcdb6cd6afd9cb7d249, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:01.085792 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7666e-0634-4c91-94f7-bd93ee834127 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:01.090954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db16e3-73d4-4db7-993c-9c6ea078d28d None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:01.091239 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db16e3-73d4-4db7-993c-9c6ea078d28d None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:01.091612 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db16e3-73d4-4db7-993c-9c6ea078d28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:01.118318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-c1db16e3-73d4-4db7-993c-9c6ea078d28d None None] MFA Rules not processed for user `2af2d348fc984ed897fd58196b433b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:01.120626 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-c1db16e3-73d4-4db7-993c-9c6ea078d28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:01.131185 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 850/1725] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Jul 12 14:42:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:01.132370 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db16e3-73d4-4db7-993c-9c6ea078d28d None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:01.133839 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-c1db16e3-73d4-4db7-993c-9c6ea078d28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:01.163744 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db16e3-73d4-4db7-993c-9c6ea078d28d None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:01.182829 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 876/1726] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:00 2022] PUT /identity/v3/projects/069a544503ed45b5813f1afaaef849e1/users/1147492f975d4dcdb6cd6afd9cb7d249/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:01.185768 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7666e-0634-4c91-94f7-bd93ee834127 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:01.193029 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b3d7666e-0634-4c91-94f7-bd93ee834127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:01.197659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7199a7-0c23-46b2-8dec-f0fbe12d47cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:01.199831 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7199a7-0c23-46b2-8dec-f0fbe12d47cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:01.202798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7199a7-0c23-46b2-8dec-f0fbe12d47cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:01.203245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7199a7-0c23-46b2-8dec-f0fbe12d47cc admin admin] PATH_INFO: `/v3/users/b13ba58fcda8482981aa801639d822cc` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:01.205848 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7199a7-0c23-46b2-8dec-f0fbe12d47cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b13ba58fcda8482981aa801639d822cc)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:01.213134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7199a7-0c23-46b2-8dec-f0fbe12d47cc admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:01.312554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7666e-0634-4c91-94f7-bd93ee834127 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:01.319203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaf4ad-6a4d-400e-b0fd-3142dae8be4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:01.320150 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaf4ad-6a4d-400e-b0fd-3142dae8be4f service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:01.320450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaf4ad-6a4d-400e-b0fd-3142dae8be4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:01.320853 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaf4ad-6a4d-400e-b0fd-3142dae8be4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:01.330824 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcaf4ad-6a4d-400e-b0fd-3142dae8be4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:01.332656 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcaf4ad-6a4d-400e-b0fd-3142dae8be4f service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:01.343746 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 877/1727] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:01.345024 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaf4ad-6a4d-400e-b0fd-3142dae8be4f service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:01.348044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-2fcaf4ad-6a4d-400e-b0fd-3142dae8be4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:01.366676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaf4ad-6a4d-400e-b0fd-3142dae8be4f service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:01.391229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e4b15-8192-4491-8b77-037eee2d48f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:01.391927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4b15-8192-4491-8b77-037eee2d48f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:01.392207 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4b15-8192-4491-8b77-037eee2d48f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:01.392488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4b15-8192-4491-8b77-037eee2d48f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:01.411062 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e4b15-8192-4491-8b77-037eee2d48f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:01.411062 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e4b15-8192-4491-8b77-037eee2d48f7 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:01.420286 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 878/1728] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:01.421854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70909b-1714-42fa-8299-e67fdfdadd48 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:01.422284 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70909b-1714-42fa-8299-e67fdfdadd48 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:01.422549 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70909b-1714-42fa-8299-e67fdfdadd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:01.460013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-7b70909b-1714-42fa-8299-e67fdfdadd48 None None] MFA Rules not processed for user `1147492f975d4dcdb6cd6afd9cb7d249`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:01.461363 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7b70909b-1714-42fa-8299-e67fdfdadd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:01.564923 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 879/1729] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:01.565440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6c7199a7-0c23-46b2-8dec-f0fbe12d47cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b13ba58fcda8482981aa801639d822cc'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:01.571849 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70909b-1714-42fa-8299-e67fdfdadd48 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:01.625765 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6c7199a7-0c23-46b2-8dec-f0fbe12d47cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b13ba58fcda8482981aa801639d822cc'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:01.655138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6c7199a7-0c23-46b2-8dec-f0fbe12d47cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b13ba58fcda8482981aa801639d822cc'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:01.698429 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70909b-1714-42fa-8299-e67fdfdadd48 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:01.718773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e41d54-c6ad-4037-8368-1364946bb1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:01.719680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e41d54-c6ad-4037-8368-1364946bb1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:01.719999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e41d54-c6ad-4037-8368-1364946bb1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:01.720498 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e41d54-c6ad-4037-8368-1364946bb1f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:01.721431 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e41d54-c6ad-4037-8368-1364946bb1f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:01.742428 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e41d54-c6ad-4037-8368-1364946bb1f9 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:01.745339 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6c7199a7-0c23-46b2-8dec-f0fbe12d47cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b13ba58fcda8482981aa801639d822cc'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:01.747976 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6c7199a7-0c23-46b2-8dec-f0fbe12d47cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b13ba58fcda8482981aa801639d822cc'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:01.762823 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 851/1730] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:01 2022] DELETE /identity/v3/users/b13ba58fcda8482981aa801639d822cc => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:01.772081 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572e80-c4d9-481f-9bae-b0a642736726 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:01.772962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572e80-c4d9-481f-9bae-b0a642736726 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:01.773271 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572e80-c4d9-481f-9bae-b0a642736726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:01.835384 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-b7572e80-c4d9-481f-9bae-b0a642736726 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:01.838576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b7572e80-c4d9-481f-9bae-b0a642736726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:01.846671 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 880/1731] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:01 2022] POST /identity/v3/projects => generated 385 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:01.850379 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e41d54-c6ad-4037-8368-1364946bb1f9 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:01.853078 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-50e41d54-c6ad-4037-8368-1364946bb1f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:01.958658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:02.003465 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e41d54-c6ad-4037-8368-1364946bb1f9 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:02.010374 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d000f-634e-41dc-b42c-6254bd8a23a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:02.012187 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d000f-634e-41dc-b42c-6254bd8a23a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:02.012624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d000f-634e-41dc-b42c-6254bd8a23a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:02.013040 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d000f-634e-41dc-b42c-6254bd8a23a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:02.013895 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d000f-634e-41dc-b42c-6254bd8a23a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:02.016672 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d000f-634e-41dc-b42c-6254bd8a23a6 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:02.049812 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 852/1732] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:02.082208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7572e80-c4d9-481f-9bae-b0a642736726 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:02.091577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b7572e80-c4d9-481f-9bae-b0a642736726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:02.142059 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 881/1733] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:01 2022] POST /identity/v3/users => generated 299 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:02.144907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d000f-634e-41dc-b42c-6254bd8a23a6 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:02.164992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d000f-634e-41dc-b42c-6254bd8a23a6 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:02.177129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526ad3d-3456-4f61-90ec-20875418cd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:02.178138 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526ad3d-3456-4f61-90ec-20875418cd7b admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:02.178760 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526ad3d-3456-4f61-90ec-20875418cd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:02.179115 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526ad3d-3456-4f61-90ec-20875418cd7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:02.180508 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526ad3d-3456-4f61-90ec-20875418cd7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:02.182786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526ad3d-3456-4f61-90ec-20875418cd7b admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:02.219351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 882/1734] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:02.221134 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526ad3d-3456-4f61-90ec-20875418cd7b admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:02.233568 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7572e80-c4d9-481f-9bae-b0a642736726 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:02.243911 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526ad3d-3456-4f61-90ec-20875418cd7b admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:02.246443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f75bee-8b04-45da-8f8a-8f3e2ed36e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:02.248384 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f75bee-8b04-45da-8f8a-8f3e2ed36e6d service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:02.248839 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f75bee-8b04-45da-8f8a-8f3e2ed36e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:02.249130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f75bee-8b04-45da-8f8a-8f3e2ed36e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:02.251412 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74706b87-ec8e-4a4b-b820-45851bbd4c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:02.252782 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74706b87-ec8e-4a4b-b820-45851bbd4c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:02.253509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74706b87-ec8e-4a4b-b820-45851bbd4c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:02.253885 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74706b87-ec8e-4a4b-b820-45851bbd4c90 admin admin] PATH_INFO: `/v3/projects/32a8b574afd34c90bcfd81225b0b0d56/users/36f2e435ca954640b31c8dfc259a2382/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:02.276085 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74706b87-ec8e-4a4b-b820-45851bbd4c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a8b574afd34c90bcfd81225b0b0d56, user_id=36f2e435ca954640b31c8dfc259a2382, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:02.277896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f75bee-8b04-45da-8f8a-8f3e2ed36e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:02.280067 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74706b87-ec8e-4a4b-b820-45851bbd4c90 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:02.283942 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f75bee-8b04-45da-8f8a-8f3e2ed36e6d service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:02.295136 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:02.311852 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 853/1735] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:02.314382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f75bee-8b04-45da-8f8a-8f3e2ed36e6d service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:02.319104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-a4f75bee-8b04-45da-8f8a-8f3e2ed36e6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:02.340878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 883/1736] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:02 2022] PUT /identity/v3/projects/32a8b574afd34c90bcfd81225b0b0d56/users/36f2e435ca954640b31c8dfc259a2382/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:02.342357 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74706b87-ec8e-4a4b-b820-45851bbd4c90 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:02.350901 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f75bee-8b04-45da-8f8a-8f3e2ed36e6d service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:02.506526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60325e72-4f95-4c95-a482-b3de4b83137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:02.509164 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60325e72-4f95-4c95-a482-b3de4b83137c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:02.510848 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60325e72-4f95-4c95-a482-b3de4b83137c admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:02.510848 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60325e72-4f95-4c95-a482-b3de4b83137c admin admin] PATH_INFO: `/v3/projects/204cd449b1844ea7896328059cf13fe3` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:02.515848 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60325e72-4f95-4c95-a482-b3de4b83137c admin admin] RBAC: Authorizing `identity:delete_project(project_id=204cd449b1844ea7896328059cf13fe3)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:02.521466 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60325e72-4f95-4c95-a482-b3de4b83137c admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:02.522116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74706b87-ec8e-4a4b-b820-45851bbd4c90 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:02.547254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b99876-1e85-41ca-a0c6-cadbfc3833f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:02.548159 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b99876-1e85-41ca-a0c6-cadbfc3833f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:02.549321 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b99876-1e85-41ca-a0c6-cadbfc3833f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:02.550284 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b99876-1e85-41ca-a0c6-cadbfc3833f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:02.551122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b99876-1e85-41ca-a0c6-cadbfc3833f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:02.554892 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b99876-1e85-41ca-a0c6-cadbfc3833f6 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:02.577847 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 884/1737] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:02.578888 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b99876-1e85-41ca-a0c6-cadbfc3833f6 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:02.604030 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b99876-1e85-41ca-a0c6-cadbfc3833f6 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:02.619588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8416d-e102-405f-84cb-3e7191eae42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:02.620585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8416d-e102-405f-84cb-3e7191eae42d admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:02.634755 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8416d-e102-405f-84cb-3e7191eae42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:02.635217 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8416d-e102-405f-84cb-3e7191eae42d admin admin] PATH_INFO: `/v3/projects/32a8b574afd34c90bcfd81225b0b0d56/users/36f2e435ca954640b31c8dfc259a2382/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:02.643913 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8416d-e102-405f-84cb-3e7191eae42d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a8b574afd34c90bcfd81225b0b0d56, user_id=36f2e435ca954640b31c8dfc259a2382, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:02.649136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8416d-e102-405f-84cb-3e7191eae42d admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:02.678137 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 885/1738] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:02 2022] PUT /identity/v3/projects/32a8b574afd34c90bcfd81225b0b0d56/users/36f2e435ca954640b31c8dfc259a2382/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:02.690240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff80c4-82d9-4231-b714-8a44728f6e7a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:02.695480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff80c4-82d9-4231-b714-8a44728f6e7a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:02.695930 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff80c4-82d9-4231-b714-8a44728f6e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:02.775776 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-03ff80c4-82d9-4231-b714-8a44728f6e7a None None] MFA Rules not processed for user `36f2e435ca954640b31c8dfc259a2382`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:02.777767 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-03ff80c4-82d9-4231-b714-8a44728f6e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:02.870746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:02.874140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-60325e72-4f95-4c95-a482-b3de4b83137c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '204cd449b1844ea7896328059cf13fe3', 'request_id': 'req-60325e72-4f95-4c95-a482-b3de4b83137c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:02.888077 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-60325e72-4f95-4c95-a482-b3de4b83137c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '204cd449b1844ea7896328059cf13fe3', 'request_id': 'req-60325e72-4f95-4c95-a482-b3de4b83137c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:02.907732 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-60325e72-4f95-4c95-a482-b3de4b83137c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '204cd449b1844ea7896328059cf13fe3', 'request_id': 'req-60325e72-4f95-4c95-a482-b3de4b83137c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:02.932946 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 886/1739] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:02.938641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:02.940782 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ff64e-9cd2-45ce-a804-99a6299131f7 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:02.941080 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ff64e-9cd2-45ce-a804-99a6299131f7 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:02.941365 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ff64e-9cd2-45ce-a804-99a6299131f7 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:02.943094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 887/1740] 10.222.0.40 () {54 vars in 960 bytes} [Tue Jul 12 14:42:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:42:02.944222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ff64e-9cd2-45ce-a804-99a6299131f7 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:02.946209 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-841ff64e-9cd2-45ce-a804-99a6299131f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:02.996066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-60325e72-4f95-4c95-a482-b3de4b83137c admin admin] The token cache is being invalidate because project 204cd449b1844ea7896328059cf13fe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:02.996347 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-60325e72-4f95-4c95-a482-b3de4b83137c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:03.000276 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-60325e72-4f95-4c95-a482-b3de4b83137c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:03.006582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 854/1741] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:02 2022] DELETE /identity/v3/projects/204cd449b1844ea7896328059cf13fe3 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:03.006582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60325e72-4f95-4c95-a482-b3de4b83137c admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:03.015788 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-60325e72-4f95-4c95-a482-b3de4b83137c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:03.127568 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ff64e-9cd2-45ce-a804-99a6299131f7 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:03.142476 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88838619-70cb-4bb9-9bd2-ab9630a34753 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a3704fdba154f13ad3bf8ac00c916c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:03.143153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88838619-70cb-4bb9-9bd2-ab9630a34753 service placement] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:03.143541 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88838619-70cb-4bb9-9bd2-ab9630a34753 service placement] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:03.143823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88838619-70cb-4bb9-9bd2-ab9630a34753 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:03.153358 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-88838619-70cb-4bb9-9bd2-ab9630a34753 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:03.188447 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88838619-70cb-4bb9-9bd2-ab9630a34753 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:03.190851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88838619-70cb-4bb9-9bd2-ab9630a34753 service placement] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:03.211011 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60325e72-4f95-4c95-a482-b3de4b83137c admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:03.217081 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200cc4e-7d98-4e8b-8949-890848f2eb1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:03.218369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200cc4e-7d98-4e8b-8949-890848f2eb1f service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:03.219144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200cc4e-7d98-4e8b-8949-890848f2eb1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:03.219655 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200cc4e-7d98-4e8b-8949-890848f2eb1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:03.222407 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 888/1742] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:03.229568 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb294f-4cee-4ece-b9cc-70492e358757 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:03.233006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb294f-4cee-4ece-b9cc-70492e358757 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:03.233006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb294f-4cee-4ece-b9cc-70492e358757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:03.240024 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-d200cc4e-7d98-4e8b-8949-890848f2eb1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:03.291673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200cc4e-7d98-4e8b-8949-890848f2eb1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:03.298007 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200cc4e-7d98-4e8b-8949-890848f2eb1f service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:03.301816 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-dbcb294f-4cee-4ece-b9cc-70492e358757 None None] MFA Rules not processed for user `0a3704fdba154f13ad3bf8ac00c916c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:03.312529 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-dbcb294f-4cee-4ece-b9cc-70492e358757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:03.333734 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 855/1743] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:03.346438 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 889/1744] 10.222.0.40 () {58 vars in 1057 bytes} [Tue Jul 12 14:42:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:03.352652 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a241c8e-e45b-480d-8fef-acae7072bd7f None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:03.356595 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a241c8e-e45b-480d-8fef-acae7072bd7f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:03.358095 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7681c1-0f82-4cd2-af0c-8895ff96b27a None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:03.358332 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7681c1-0f82-4cd2-af0c-8895ff96b27a None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:03.358559 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a241c8e-e45b-480d-8fef-acae7072bd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:03.358701 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7681c1-0f82-4cd2-af0c-8895ff96b27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:03.418048 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-9a241c8e-e45b-480d-8fef-acae7072bd7f None None] MFA Rules not processed for user `87fcc3fa1cbe4afeaa0e455f2631411a`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:03.419211 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-9a241c8e-e45b-480d-8fef-acae7072bd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:03.446787 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-2a7681c1-0f82-4cd2-af0c-8895ff96b27a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:03.453040 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2a7681c1-0f82-4cd2-af0c-8895ff96b27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:03.642596 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 890/1745] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:03.644281 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a8b70-d83b-4e09-803c-1f432ee67dde None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:03.646659 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a8b70-d83b-4e09-803c-1f432ee67dde None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:03.646899 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a8b70-d83b-4e09-803c-1f432ee67dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:03.673465 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-c68a8b70-d83b-4e09-803c-1f432ee67dde None None] MFA Rules not processed for user `abb27a4eecd14ab89a1d349fa3bdc0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:03.675144 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-c68a8b70-d83b-4e09-803c-1f432ee67dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:03.703033 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 856/1746] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:03.704465 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7681c1-0f82-4cd2-af0c-8895ff96b27a None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:03.721655 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7681c1-0f82-4cd2-af0c-8895ff96b27a None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:03.758391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a741f-3bf1-4c37-bf70-c50f94717d0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a3704fdba154f13ad3bf8ac00c916c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:03.760588 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a741f-3bf1-4c37-bf70-c50f94717d0a service placement] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:03.760950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a741f-3bf1-4c37-bf70-c50f94717d0a service placement] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:03.761658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a741f-3bf1-4c37-bf70-c50f94717d0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:03.780475 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:03.789758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a741f-3bf1-4c37-bf70-c50f94717d0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:03.791700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a741f-3bf1-4c37-bf70-c50f94717d0a service placement] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:03.809773 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 857/1747] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:03.811984 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8889f1-bb9f-4fbb-bfd3-98aeb425e2ab None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:03.812467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8889f1-bb9f-4fbb-bfd3-98aeb425e2ab None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:03.812988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8889f1-bb9f-4fbb-bfd3-98aeb425e2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:03.816000 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 891/1748] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:03.852138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-bd8889f1-bb9f-4fbb-bfd3-98aeb425e2ab None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:03.854144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-bd8889f1-bb9f-4fbb-bfd3-98aeb425e2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:03.875902 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 858/1749] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:03.879980 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a8b70-d83b-4e09-803c-1f432ee67dde None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:03.897332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a8b70-d83b-4e09-803c-1f432ee67dde None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:03.917189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f7990-e6a4-445d-b3a4-d8fdfebd2d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:03.919152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f7990-e6a4-445d-b3a4-d8fdfebd2d5d admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:03.919660 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f7990-e6a4-445d-b3a4-d8fdfebd2d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:03.919763 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f7990-e6a4-445d-b3a4-d8fdfebd2d5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:03.922551 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f7990-e6a4-445d-b3a4-d8fdfebd2d5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:03.922881 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f7990-e6a4-445d-b3a4-d8fdfebd2d5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:03.929007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f7990-e6a4-445d-b3a4-d8fdfebd2d5d admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:03.963316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8889f1-bb9f-4fbb-bfd3-98aeb425e2ab None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:03.971166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 892/1750] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:42:03.977945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8889f1-bb9f-4fbb-bfd3-98aeb425e2ab None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:03.994856 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371eb05-dcaf-4d9e-ba37-2f9f0087f6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:03.995585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371eb05-dcaf-4d9e-ba37-2f9f0087f6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:03.997631 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371eb05-dcaf-4d9e-ba37-2f9f0087f6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:03.997631 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371eb05-dcaf-4d9e-ba37-2f9f0087f6a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:03.998360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371eb05-dcaf-4d9e-ba37-2f9f0087f6a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:04.000630 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371eb05-dcaf-4d9e-ba37-2f9f0087f6a4 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:04.124932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f7990-e6a4-445d-b3a4-d8fdfebd2d5d admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:04.127566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ea6f7990-e6a4-445d-b3a4-d8fdfebd2d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:04.166642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f7990-e6a4-445d-b3a4-d8fdfebd2d5d admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:04.176705 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b492c-d8eb-4de7-b6c5-7bd1326f73fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:04.178605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b492c-d8eb-4de7-b6c5-7bd1326f73fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:04.178984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b492c-d8eb-4de7-b6c5-7bd1326f73fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:04.179385 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b492c-d8eb-4de7-b6c5-7bd1326f73fe admin admin] PATH_INFO: `/v3/projects/38db260b9f8c442184f5bd1ca5d90292` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:04.183065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b492c-d8eb-4de7-b6c5-7bd1326f73fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=38db260b9f8c442184f5bd1ca5d90292)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:04.190188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b492c-d8eb-4de7-b6c5-7bd1326f73fe admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:04.197375 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 859/1751] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:03 2022] POST /identity/v3/projects => generated 385 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:42:04.202246 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371eb05-dcaf-4d9e-ba37-2f9f0087f6a4 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:04.410899 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:04.462710 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a56b492c-d8eb-4de7-b6c5-7bd1326f73fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38db260b9f8c442184f5bd1ca5d90292', 'request_id': 'req-a56b492c-d8eb-4de7-b6c5-7bd1326f73fe'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:04.477369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371eb05-dcaf-4d9e-ba37-2f9f0087f6a4 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:04.529897 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a56b492c-d8eb-4de7-b6c5-7bd1326f73fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38db260b9f8c442184f5bd1ca5d90292', 'request_id': 'req-a56b492c-d8eb-4de7-b6c5-7bd1326f73fe'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:04.537008 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a56b492c-d8eb-4de7-b6c5-7bd1326f73fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38db260b9f8c442184f5bd1ca5d90292', 'request_id': 'req-a56b492c-d8eb-4de7-b6c5-7bd1326f73fe'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:04.580826 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a56b492c-d8eb-4de7-b6c5-7bd1326f73fe admin admin] The token cache is being invalidate because project 38db260b9f8c442184f5bd1ca5d90292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:04.581403 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a56b492c-d8eb-4de7-b6c5-7bd1326f73fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:04.583882 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a56b492c-d8eb-4de7-b6c5-7bd1326f73fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:04.587710 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 893/1752] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:04 2022] DELETE /identity/v3/projects/38db260b9f8c442184f5bd1ca5d90292 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:04.594454 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b492c-d8eb-4de7-b6c5-7bd1326f73fe admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:04.598830 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a56b492c-d8eb-4de7-b6c5-7bd1326f73fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:04.600892 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde6e8e-5671-4010-adea-7f50d7b3515f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:04.601810 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde6e8e-5671-4010-adea-7f50d7b3515f admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:04.603523 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde6e8e-5671-4010-adea-7f50d7b3515f admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:04.604560 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde6e8e-5671-4010-adea-7f50d7b3515f admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:04.606609 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde6e8e-5671-4010-adea-7f50d7b3515f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:04.609478 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde6e8e-5671-4010-adea-7f50d7b3515f admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:04.639574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b492c-d8eb-4de7-b6c5-7bd1326f73fe admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:04.658116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31fe86-be64-4444-ab0e-463ddf69d69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:04.659061 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31fe86-be64-4444-ab0e-463ddf69d69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:04.659589 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31fe86-be64-4444-ab0e-463ddf69d69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:04.659869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31fe86-be64-4444-ab0e-463ddf69d69e admin admin] PATH_INFO: `/v3/users/8df3482383ad41e5a4edf80b12e7c7cc` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:04.662653 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31fe86-be64-4444-ab0e-463ddf69d69e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df3482383ad41e5a4edf80b12e7c7cc)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:04.665714 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31fe86-be64-4444-ab0e-463ddf69d69e admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:04.719810 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 860/1753] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:04 2022] POST /identity/v3/users => generated 293 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:42:04.723611 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde6e8e-5671-4010-adea-7f50d7b3515f admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:04.726063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-1fde6e8e-5671-4010-adea-7f50d7b3515f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:04.749489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde6e8e-5671-4010-adea-7f50d7b3515f admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:04.762707 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05071e1c-d41b-4b4a-87c3-b7dbcb0706aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:04.763628 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05071e1c-d41b-4b4a-87c3-b7dbcb0706aa admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:04.763904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05071e1c-d41b-4b4a-87c3-b7dbcb0706aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:04.764188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05071e1c-d41b-4b4a-87c3-b7dbcb0706aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:04.764937 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05071e1c-d41b-4b4a-87c3-b7dbcb0706aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:04.766600 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05071e1c-d41b-4b4a-87c3-b7dbcb0706aa admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:04.841888 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 861/1754] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:42:04.850835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05071e1c-d41b-4b4a-87c3-b7dbcb0706aa admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:04.882039 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05071e1c-d41b-4b4a-87c3-b7dbcb0706aa admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:04.903306 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a57a35-64e5-4ce5-a5f6-d1b5248f4a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:04.904178 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a57a35-64e5-4ce5-a5f6-d1b5248f4a04 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:04.904471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a57a35-64e5-4ce5-a5f6-d1b5248f4a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:04.904808 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a57a35-64e5-4ce5-a5f6-d1b5248f4a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:04.905563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a57a35-64e5-4ce5-a5f6-d1b5248f4a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:04.913029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a57a35-64e5-4ce5-a5f6-d1b5248f4a04 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:04.935915 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0d31fe86-be64-4444-ab0e-463ddf69d69e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df3482383ad41e5a4edf80b12e7c7cc'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:04.944619 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 862/1755] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:04.948416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb65e80-e106-4929-98e0-74eff1fa75e1 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:04.948717 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb65e80-e106-4929-98e0-74eff1fa75e1 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:04.949039 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb65e80-e106-4929-98e0-74eff1fa75e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:04.998108 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0d31fe86-be64-4444-ab0e-463ddf69d69e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df3482383ad41e5a4edf80b12e7c7cc'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:05.006547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-4cb65e80-e106-4929-98e0-74eff1fa75e1 None None] MFA Rules not processed for user `1fe49f461a1443f59d20f072f1555db4`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:05.008987 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-4cb65e80-e106-4929-98e0-74eff1fa75e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:05.090313 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0d31fe86-be64-4444-ab0e-463ddf69d69e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df3482383ad41e5a4edf80b12e7c7cc'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:05.091039 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0d31fe86-be64-4444-ab0e-463ddf69d69e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df3482383ad41e5a4edf80b12e7c7cc'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:05.123502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0d31fe86-be64-4444-ab0e-463ddf69d69e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df3482383ad41e5a4edf80b12e7c7cc'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:05.157629 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 894/1756] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:04 2022] DELETE /identity/v3/users/8df3482383ad41e5a4edf80b12e7c7cc => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:05.159327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31fe86-be64-4444-ab0e-463ddf69d69e admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:05.166689 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0d31fe86-be64-4444-ab0e-463ddf69d69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:05.241033 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 863/1757] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:05.251751 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb65e80-e106-4929-98e0-74eff1fa75e1 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:05.254497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-4cb65e80-e106-4929-98e0-74eff1fa75e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:05.409218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31fe86-be64-4444-ab0e-463ddf69d69e admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:05.424386 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc04dd-c43d-4ebd-8625-89b2d31d2957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:05.425393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc04dd-c43d-4ebd-8625-89b2d31d2957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:05.425681 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc04dd-c43d-4ebd-8625-89b2d31d2957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:05.425961 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc04dd-c43d-4ebd-8625-89b2d31d2957 admin admin] PATH_INFO: `/v3/projects/8748e4793cf540b6910ee8765e09b797/users/cd70510a256e40d385af43297b3c3ee7/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:05.442711 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb65e80-e106-4929-98e0-74eff1fa75e1 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:05.463081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc04dd-c43d-4ebd-8625-89b2d31d2957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8748e4793cf540b6910ee8765e09b797, user_id=cd70510a256e40d385af43297b3c3ee7, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:05.466823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc04dd-c43d-4ebd-8625-89b2d31d2957 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:05.556685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe359d-6188-4dc1-bf5b-3b0022ab6d4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:05.558598 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe359d-6188-4dc1-bf5b-3b0022ab6d4a service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:05.559347 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe359d-6188-4dc1-bf5b-3b0022ab6d4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:05.559882 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe359d-6188-4dc1-bf5b-3b0022ab6d4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:05.563090 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-6bfe359d-6188-4dc1-bf5b-3b0022ab6d4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:05.598361 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 895/1758] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:05 2022] PUT /identity/v3/projects/8748e4793cf540b6910ee8765e09b797/users/cd70510a256e40d385af43297b3c3ee7/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:05.613087 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0d6c8-a355-448f-80f5-02833507efde None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:05.613382 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0d6c8-a355-448f-80f5-02833507efde None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:05.613671 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0d6c8-a355-448f-80f5-02833507efde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:05.704269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:05.708775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-05d0d6c8-a355-448f-80f5-02833507efde None None] MFA Rules not processed for user `cd70510a256e40d385af43297b3c3ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:05.717272 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe359d-6188-4dc1-bf5b-3b0022ab6d4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:05.718788 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe359d-6188-4dc1-bf5b-3b0022ab6d4a service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:05.728863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-05d0d6c8-a355-448f-80f5-02833507efde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:05.763462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 864/1759] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:06.020450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 896/1760] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:42:06.021658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe359d-6188-4dc1-bf5b-3b0022ab6d4a service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:06.052587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe359d-6188-4dc1-bf5b-3b0022ab6d4a service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:06.216375 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3cb93-2dc8-4f73-a272-116eac13f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:06.250919 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3cb93-2dc8-4f73-a272-116eac13f7dd admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:06.264760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3cb93-2dc8-4f73-a272-116eac13f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:06.265045 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3cb93-2dc8-4f73-a272-116eac13f7dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:06.265879 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3cb93-2dc8-4f73-a272-116eac13f7dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:06.273159 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3cb93-2dc8-4f73-a272-116eac13f7dd admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:06.479745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 865/1761] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:06 2022] POST /identity/v3/projects => generated 383 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:06.485504 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0d6c8-a355-448f-80f5-02833507efde None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:06.505408 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0d6c8-a355-448f-80f5-02833507efde None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:06.772473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:06.787105 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41275049-b090-426f-a0ef-4de7aa37d227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:06.788201 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41275049-b090-426f-a0ef-4de7aa37d227 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:06.789562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41275049-b090-426f-a0ef-4de7aa37d227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:06.813182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41275049-b090-426f-a0ef-4de7aa37d227 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:06.814062 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41275049-b090-426f-a0ef-4de7aa37d227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:06.820754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41275049-b090-426f-a0ef-4de7aa37d227 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:07.066063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3cb93-2dc8-4f73-a272-116eac13f7dd admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:07.076703 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 897/1762] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:06 2022] POST /identity/v3/users => generated 298 bytes in 587 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:07.123589 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3cb93-2dc8-4f73-a272-116eac13f7dd admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:07.144886 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41275049-b090-426f-a0ef-4de7aa37d227 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:07.150721 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-41275049-b090-426f-a0ef-4de7aa37d227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:07.167813 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237b6d0-355a-465b-9d4f-e6b5b3fd82d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:07.168849 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237b6d0-355a-465b-9d4f-e6b5b3fd82d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:07.172207 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237b6d0-355a-465b-9d4f-e6b5b3fd82d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:07.175263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237b6d0-355a-465b-9d4f-e6b5b3fd82d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:07.176972 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237b6d0-355a-465b-9d4f-e6b5b3fd82d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:07.191475 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237b6d0-355a-465b-9d4f-e6b5b3fd82d6 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:07.203497 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41275049-b090-426f-a0ef-4de7aa37d227 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:07.234604 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621a36a-afb4-48b1-ba5a-647959acfb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:07.245786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621a36a-afb4-48b1-ba5a-647959acfb72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:07.245786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621a36a-afb4-48b1-ba5a-647959acfb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:07.245786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621a36a-afb4-48b1-ba5a-647959acfb72 admin admin] PATH_INFO: `/v3/projects/4a41d205a74f41aeb5da9ffa4843b789` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:07.248507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621a36a-afb4-48b1-ba5a-647959acfb72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a41d205a74f41aeb5da9ffa4843b789)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:07.250682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621a36a-afb4-48b1-ba5a-647959acfb72 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:07.264965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 866/1763] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:07.268479 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237b6d0-355a-465b-9d4f-e6b5b3fd82d6 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:07.338784 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237b6d0-355a-465b-9d4f-e6b5b3fd82d6 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:07.385633 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6ffc1-81d3-448d-8fac-375231a92ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:07.387117 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6ffc1-81d3-448d-8fac-375231a92ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:07.387463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6ffc1-81d3-448d-8fac-375231a92ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:07.387747 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6ffc1-81d3-448d-8fac-375231a92ab9 admin admin] PATH_INFO: `/v3/projects/1609cfd8eaf54756959598299df6df77/users/f3259af8a69f4f72a191981c078388f7/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:07.458957 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6ffc1-81d3-448d-8fac-375231a92ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1609cfd8eaf54756959598299df6df77, user_id=f3259af8a69f4f72a191981c078388f7, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:07.462872 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6ffc1-81d3-448d-8fac-375231a92ab9 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:07.485901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f621a36a-afb4-48b1-ba5a-647959acfb72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a41d205a74f41aeb5da9ffa4843b789', 'request_id': 'req-f621a36a-afb4-48b1-ba5a-647959acfb72'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:07.561605 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 867/1764] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:07 2022] PUT /identity/v3/projects/1609cfd8eaf54756959598299df6df77/users/f3259af8a69f4f72a191981c078388f7/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:07.562690 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6ffc1-81d3-448d-8fac-375231a92ab9 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:07.574921 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f621a36a-afb4-48b1-ba5a-647959acfb72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a41d205a74f41aeb5da9ffa4843b789', 'request_id': 'req-f621a36a-afb4-48b1-ba5a-647959acfb72'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:07.590180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f621a36a-afb4-48b1-ba5a-647959acfb72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a41d205a74f41aeb5da9ffa4843b789', 'request_id': 'req-f621a36a-afb4-48b1-ba5a-647959acfb72'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:07.670856 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f621a36a-afb4-48b1-ba5a-647959acfb72 admin admin] The token cache is being invalidate because project 4a41d205a74f41aeb5da9ffa4843b789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:07.671119 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f621a36a-afb4-48b1-ba5a-647959acfb72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:07.674064 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f621a36a-afb4-48b1-ba5a-647959acfb72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:07.679706 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 898/1765] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:07 2022] DELETE /identity/v3/projects/4a41d205a74f41aeb5da9ffa4843b789 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:07.692692 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec843547-4611-4cf6-bd1c-86a7eec35dd8 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:07.692981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec843547-4611-4cf6-bd1c-86a7eec35dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:07.693262 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec843547-4611-4cf6-bd1c-86a7eec35dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:07.746940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-ec843547-4611-4cf6-bd1c-86a7eec35dd8 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:07.752786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ec843547-4611-4cf6-bd1c-86a7eec35dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:07.776562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6ffc1-81d3-448d-8fac-375231a92ab9 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:07.791451 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e7bdf-9c4e-4321-beaf-76b91fb347fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:07.792167 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e7bdf-9c4e-4321-beaf-76b91fb347fc admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:07.792455 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e7bdf-9c4e-4321-beaf-76b91fb347fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:07.792720 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e7bdf-9c4e-4321-beaf-76b91fb347fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:07.793492 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e7bdf-9c4e-4321-beaf-76b91fb347fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:07.795086 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e7bdf-9c4e-4321-beaf-76b91fb347fc admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:07.822876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 868/1766] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:07.829059 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e7bdf-9c4e-4321-beaf-76b91fb347fc admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:07.831772 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-194e7bdf-9c4e-4321-beaf-76b91fb347fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:07.854714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e7bdf-9c4e-4321-beaf-76b91fb347fc admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:07.865605 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291f8c0-4c8b-4851-afb3-6e5aba25eddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:07.867435 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291f8c0-4c8b-4851-afb3-6e5aba25eddd admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:07.869440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291f8c0-4c8b-4851-afb3-6e5aba25eddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:07.870329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291f8c0-4c8b-4851-afb3-6e5aba25eddd admin admin] PATH_INFO: `/v3/projects/1609cfd8eaf54756959598299df6df77/users/f3259af8a69f4f72a191981c078388f7/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:07.876041 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291f8c0-4c8b-4851-afb3-6e5aba25eddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1609cfd8eaf54756959598299df6df77, user_id=f3259af8a69f4f72a191981c078388f7, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:07.885968 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291f8c0-4c8b-4851-afb3-6e5aba25eddd admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:07.907113 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 899/1767] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:07.916842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68591bae-25a2-47bf-8b22-5c36ebeb87e6 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:07.917142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68591bae-25a2-47bf-8b22-5c36ebeb87e6 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:07.917426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68591bae-25a2-47bf-8b22-5c36ebeb87e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:07.929166 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 869/1768] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:07 2022] PUT /identity/v3/projects/1609cfd8eaf54756959598299df6df77/users/f3259af8a69f4f72a191981c078388f7/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:42:07.943640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757fa34-3e83-4a26-8735-2171781f10d7 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:07.944225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757fa34-3e83-4a26-8735-2171781f10d7 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:07.944508 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757fa34-3e83-4a26-8735-2171781f10d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:07.958813 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-68591bae-25a2-47bf-8b22-5c36ebeb87e6 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:07.962947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-68591bae-25a2-47bf-8b22-5c36ebeb87e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:08.005638 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-0757fa34-3e83-4a26-8735-2171781f10d7 None None] MFA Rules not processed for user `f3259af8a69f4f72a191981c078388f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:08.007088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0757fa34-3e83-4a26-8735-2171781f10d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:08.083232 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 900/1769] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:42:08.088396 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68591bae-25a2-47bf-8b22-5c36ebeb87e6 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:08.102428 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68591bae-25a2-47bf-8b22-5c36ebeb87e6 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:08.111100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb491d8-99a1-4de3-b76b-9cb2f5aa5112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:08.112108 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb491d8-99a1-4de3-b76b-9cb2f5aa5112 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:08.112770 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb491d8-99a1-4de3-b76b-9cb2f5aa5112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:08.113523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb491d8-99a1-4de3-b76b-9cb2f5aa5112 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:08.114381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb491d8-99a1-4de3-b76b-9cb2f5aa5112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:08.114939 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb491d8-99a1-4de3-b76b-9cb2f5aa5112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:08.116809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb491d8-99a1-4de3-b76b-9cb2f5aa5112 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:08.143444 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 901/1770] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:42:08.146878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb491d8-99a1-4de3-b76b-9cb2f5aa5112 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:08.170323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb491d8-99a1-4de3-b76b-9cb2f5aa5112 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:08.177346 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0000ce5-5824-4986-85db-0e25eb90ff9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:08.178398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000ce5-5824-4986-85db-0e25eb90ff9b admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:08.179184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000ce5-5824-4986-85db-0e25eb90ff9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:08.179617 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000ce5-5824-4986-85db-0e25eb90ff9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:08.180612 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0000ce5-5824-4986-85db-0e25eb90ff9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:08.184326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0000ce5-5824-4986-85db-0e25eb90ff9b admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:08.235537 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 870/1771] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:08.243870 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757fa34-3e83-4a26-8735-2171781f10d7 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:08.245914 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0757fa34-3e83-4a26-8735-2171781f10d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:08.294801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 902/1772] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:08 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:08.297084 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0000ce5-5824-4986-85db-0e25eb90ff9b admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:08.312478 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:08.391967 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757fa34-3e83-4a26-8735-2171781f10d7 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:08.424816 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:08.495496 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0000ce5-5824-4986-85db-0e25eb90ff9b admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:08.503920 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c1728-8434-4424-a309-eb857ff37bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:08.504822 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c1728-8434-4424-a309-eb857ff37bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:08.505019 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c1728-8434-4424-a309-eb857ff37bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:08.505466 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c1728-8434-4424-a309-eb857ff37bd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:08.506586 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c1728-8434-4424-a309-eb857ff37bd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:08.508866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c1728-8434-4424-a309-eb857ff37bd5 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:08.515581 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d3fc0-87e4-4d23-a3b5-8edfec72aaa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:08.518983 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d3fc0-87e4-4d23-a3b5-8edfec72aaa1 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:08.518983 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d3fc0-87e4-4d23-a3b5-8edfec72aaa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:08.518983 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d3fc0-87e4-4d23-a3b5-8edfec72aaa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:08.594248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d3fc0-87e4-4d23-a3b5-8edfec72aaa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:08.596456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d3fc0-87e4-4d23-a3b5-8edfec72aaa1 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:08.610323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 903/1773] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:08 2022] POST /identity/v3/users => generated 285 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:42:08.612204 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea99ef-09a8-48a4-803e-ea76e465d4fe None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:08.613858 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea99ef-09a8-48a4-803e-ea76e465d4fe None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:08.614275 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea99ef-09a8-48a4-803e-ea76e465d4fe None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:08.619448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 904/1774] 10.222.0.40 () {54 vars in 921 bytes} [Tue Jul 12 14:42:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:42:08.622154 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea99ef-09a8-48a4-803e-ea76e465d4fe None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:08.627655 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 871/1775] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:42:08.629295 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcd675-14e8-421c-aa1b-5aa635c9652c None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:08.630902 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcd675-14e8-421c-aa1b-5aa635c9652c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:08.633067 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcd675-14e8-421c-aa1b-5aa635c9652c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:08.654678 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea99ef-09a8-48a4-803e-ea76e465d4fe None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:08.677982 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5428f6-aa87-4e16-bdff-586a23ea058b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:08.685103 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5428f6-aa87-4e16-bdff-586a23ea058b admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:08.685403 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5428f6-aa87-4e16-bdff-586a23ea058b admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:08.685692 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5428f6-aa87-4e16-bdff-586a23ea058b admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:08.686466 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5428f6-aa87-4e16-bdff-586a23ea058b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:08.700270 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5428f6-aa87-4e16-bdff-586a23ea058b admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:08.705583 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-0abcd675-14e8-421c-aa1b-5aa635c9652c None None] MFA Rules not processed for user `0a3704fdba154f13ad3bf8ac00c916c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:08.707077 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0abcd675-14e8-421c-aa1b-5aa635c9652c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:08.756176 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 905/1776] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:08.762152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5428f6-aa87-4e16-bdff-586a23ea058b admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:08.809836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5428f6-aa87-4e16-bdff-586a23ea058b admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:08.823597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98367f-8aea-45af-9d56-d40003fc0acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:08.827581 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98367f-8aea-45af-9d56-d40003fc0acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:08.827882 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98367f-8aea-45af-9d56-d40003fc0acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:08.828176 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98367f-8aea-45af-9d56-d40003fc0acc admin admin] PATH_INFO: `/v3/users/cd70510a256e40d385af43297b3c3ee7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:08.832821 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98367f-8aea-45af-9d56-d40003fc0acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd70510a256e40d385af43297b3c3ee7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:08.834823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98367f-8aea-45af-9d56-d40003fc0acc admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:08.908199 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 872/1777] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Jul 12 14:42:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:08.914178 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcd675-14e8-421c-aa1b-5aa635c9652c None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:08.929773 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcd675-14e8-421c-aa1b-5aa635c9652c None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:08.944191 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dedb2b-2f2b-438a-be8f-b3befe423455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:08.944893 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dedb2b-2f2b-438a-be8f-b3befe423455 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:08.945178 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dedb2b-2f2b-438a-be8f-b3befe423455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:08.945463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dedb2b-2f2b-438a-be8f-b3befe423455 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:08.946207 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dedb2b-2f2b-438a-be8f-b3befe423455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:08.947931 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dedb2b-2f2b-438a-be8f-b3befe423455 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:08.972628 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 873/1778] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:08.972839 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dedb2b-2f2b-438a-be8f-b3befe423455 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:08.975017 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-56dedb2b-2f2b-438a-be8f-b3befe423455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:08.990900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dedb2b-2f2b-438a-be8f-b3befe423455 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:08.997430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c2026-c92f-4c43-b259-4203d41f0975 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a3704fdba154f13ad3bf8ac00c916c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:08.998305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c2026-c92f-4c43-b259-4203d41f0975 service placement] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:08.999089 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c2026-c92f-4c43-b259-4203d41f0975 service placement] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:08.999414 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c2026-c92f-4c43-b259-4203d41f0975 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:09.009410 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c2026-c92f-4c43-b259-4203d41f0975 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:09.011114 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c2026-c92f-4c43-b259-4203d41f0975 service placement] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:09.023143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 874/1779] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:09.023941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c2026-c92f-4c43-b259-4203d41f0975 service placement] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:09.034860 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c2026-c92f-4c43-b259-4203d41f0975 service placement] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:09.039784 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b89cb-bc8c-45a3-bbf9-291d0977521b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:09.040698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b89cb-bc8c-45a3-bbf9-291d0977521b admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:09.040988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b89cb-bc8c-45a3-bbf9-291d0977521b admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:09.041280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b89cb-bc8c-45a3-bbf9-291d0977521b admin admin] PATH_INFO: `/v3/projects/9fb86e27e3a64add9a400e9e89504d0d/users/f1805687e51e4d209dece879682eb0e5/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:09.068690 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b89cb-bc8c-45a3-bbf9-291d0977521b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb86e27e3a64add9a400e9e89504d0d, user_id=f1805687e51e4d209dece879682eb0e5, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:09.071972 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b89cb-bc8c-45a3-bbf9-291d0977521b admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:09.129031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-de98367f-8aea-45af-9d56-d40003fc0acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd70510a256e40d385af43297b3c3ee7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:09.182570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 875/1780] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:09 2022] PUT /identity/v3/projects/9fb86e27e3a64add9a400e9e89504d0d/users/f1805687e51e4d209dece879682eb0e5/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:09.182967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-de98367f-8aea-45af-9d56-d40003fc0acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd70510a256e40d385af43297b3c3ee7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:09.193511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4f8c6-b909-42b3-bc48-3d876cd208c0 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:09.193829 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4f8c6-b909-42b3-bc48-3d876cd208c0 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:09.194107 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4f8c6-b909-42b3-bc48-3d876cd208c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:09.252231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-56d4f8c6-b909-42b3-bc48-3d876cd208c0 None None] MFA Rules not processed for user `f1805687e51e4d209dece879682eb0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:09.253551 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-56d4f8c6-b909-42b3-bc48-3d876cd208c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:09.278394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-de98367f-8aea-45af-9d56-d40003fc0acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd70510a256e40d385af43297b3c3ee7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:09.279086 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-de98367f-8aea-45af-9d56-d40003fc0acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd70510a256e40d385af43297b3c3ee7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:09.295246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-de98367f-8aea-45af-9d56-d40003fc0acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd70510a256e40d385af43297b3c3ee7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:09.334028 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 906/1781] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:08 2022] DELETE /identity/v3/users/cd70510a256e40d385af43297b3c3ee7 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:09.338633 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a724676-80bd-4d52-a9ed-74f1d1a04e69 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:09.338930 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a724676-80bd-4d52-a9ed-74f1d1a04e69 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:09.339332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a724676-80bd-4d52-a9ed-74f1d1a04e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:09.382786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-8a724676-80bd-4d52-a9ed-74f1d1a04e69 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:09.384484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-8a724676-80bd-4d52-a9ed-74f1d1a04e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:09.446024 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 876/1782] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:09.451186 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4f8c6-b909-42b3-bc48-3d876cd208c0 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:09.458144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-56d4f8c6-b909-42b3-bc48-3d876cd208c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:09.602708 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 907/1783] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:42:09.678561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4f8c6-b909-42b3-bc48-3d876cd208c0 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:09.686353 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a724676-80bd-4d52-a9ed-74f1d1a04e69 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:09.688041 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-8a724676-80bd-4d52-a9ed-74f1d1a04e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:09.708587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a1402-3b6e-4f51-a107-8277c10616e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:09.711091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1402-3b6e-4f51-a107-8277c10616e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:09.715431 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1402-3b6e-4f51-a107-8277c10616e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:09.717121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1402-3b6e-4f51-a107-8277c10616e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:09.718235 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a1402-3b6e-4f51-a107-8277c10616e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:09.722111 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a1402-3b6e-4f51-a107-8277c10616e7 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:09.801476 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a724676-80bd-4d52-a9ed-74f1d1a04e69 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:09.805606 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d46b20-b223-42ca-8601-0b020f5ce2d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:09.806311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d46b20-b223-42ca-8601-0b020f5ce2d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:09.806598 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d46b20-b223-42ca-8601-0b020f5ce2d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:09.806877 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d46b20-b223-42ca-8601-0b020f5ce2d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:09.818146 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d46b20-b223-42ca-8601-0b020f5ce2d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:09.820336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d46b20-b223-42ca-8601-0b020f5ce2d3 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:09.832271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 908/1784] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:42:09.910545 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d46b20-b223-42ca-8601-0b020f5ce2d3 service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:09.920893 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 877/1785] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:09 2022] POST /identity/v3/projects => generated 367 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:09.925693 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d46b20-b223-42ca-8601-0b020f5ce2d3 service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:09.967431 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bf28c-c4bf-44d7-b0bb-b206ee2c5791 None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:09.968015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bf28c-c4bf-44d7-b0bb-b206ee2c5791 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:09.968359 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bf28c-c4bf-44d7-b0bb-b206ee2c5791 None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:09.970161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 878/1786] 10.222.0.40 () {54 vars in 921 bytes} [Tue Jul 12 14:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:42:09.979739 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658df4d1-fb36-43d4-82d0-adeccf25a800 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:09.980211 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658df4d1-fb36-43d4-82d0-adeccf25a800 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:09.980595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658df4d1-fb36-43d4-82d0-adeccf25a800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:10.019030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-658df4d1-fb36-43d4-82d0-adeccf25a800 None None] MFA Rules not processed for user `0a3704fdba154f13ad3bf8ac00c916c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:10.022230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-658df4d1-fb36-43d4-82d0-adeccf25a800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:10.091105 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c358d-ed8f-43f3-99ad-13e9ce0bfb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:10.092578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c358d-ed8f-43f3-99ad-13e9ce0bfb7c admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:10.093896 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c358d-ed8f-43f3-99ad-13e9ce0bfb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:10.095223 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c358d-ed8f-43f3-99ad-13e9ce0bfb7c admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:10.097994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c358d-ed8f-43f3-99ad-13e9ce0bfb7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:10.100449 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c358d-ed8f-43f3-99ad-13e9ce0bfb7c admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:10.147932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:10.194814 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 879/1787] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Jul 12 14:42:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:42:10.197333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c2cf4-709b-41e8-a43c-27003e0d0781 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:10.197640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c2cf4-709b-41e8-a43c-27003e0d0781 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:10.197922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c2cf4-709b-41e8-a43c-27003e0d0781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:10.231469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 909/1788] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:09 2022] POST /identity/v3/users => generated 290 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:10.231469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c358d-ed8f-43f3-99ad-13e9ce0bfb7c admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:10.233900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-840c358d-ed8f-43f3-99ad-13e9ce0bfb7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:10.254611 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c358d-ed8f-43f3-99ad-13e9ce0bfb7c admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:10.261019 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd82ddf-bff0-4163-8d14-1e58c38ac404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:10.263109 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd82ddf-bff0-4163-8d14-1e58c38ac404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:10.263449 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd82ddf-bff0-4163-8d14-1e58c38ac404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:10.270391 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd82ddf-bff0-4163-8d14-1e58c38ac404 admin admin] PATH_INFO: `/v3/users/899d0fa4bc124c13aeb830f6f293748b` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:10.270391 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd82ddf-bff0-4163-8d14-1e58c38ac404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=899d0fa4bc124c13aeb830f6f293748b)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:10.270391 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd82ddf-bff0-4163-8d14-1e58c38ac404 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:10.326062 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-578c2cf4-709b-41e8-a43c-27003e0d0781 None None] MFA Rules not processed for user `5ec758ef106b49f4985845b3c106f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:10.328130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-578c2cf4-709b-41e8-a43c-27003e0d0781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:10.441604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 880/1789] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Jul 12 14:42:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:10.442486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c2cf4-709b-41e8-a43c-27003e0d0781 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:10.467504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c2cf4-709b-41e8-a43c-27003e0d0781 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:10.472939 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cbd76-c64a-406f-b010-b8a371965122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:10.473907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cbd76-c64a-406f-b010-b8a371965122 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:10.474307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cbd76-c64a-406f-b010-b8a371965122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:10.474691 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cbd76-c64a-406f-b010-b8a371965122 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:10.475670 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9cbd76-c64a-406f-b010-b8a371965122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:10.477605 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9cbd76-c64a-406f-b010-b8a371965122 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:10.500648 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 881/1790] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:10.501716 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cbd76-c64a-406f-b010-b8a371965122 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:10.504480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-4b9cbd76-c64a-406f-b010-b8a371965122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:10.521359 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cbd76-c64a-406f-b010-b8a371965122 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:10.528766 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac7300-1081-4a66-8c1b-664bbd0e4d8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a3704fdba154f13ad3bf8ac00c916c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:10.529486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac7300-1081-4a66-8c1b-664bbd0e4d8c service placement] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:10.529773 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac7300-1081-4a66-8c1b-664bbd0e4d8c service placement] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:10.530048 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac7300-1081-4a66-8c1b-664bbd0e4d8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:10.536496 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-4dd82ddf-bff0-4163-8d14-1e58c38ac404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899d0fa4bc124c13aeb830f6f293748b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:10.539454 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac7300-1081-4a66-8c1b-664bbd0e4d8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:10.541637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac7300-1081-4a66-8c1b-664bbd0e4d8c service placement] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:10.551523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-4dd82ddf-bff0-4163-8d14-1e58c38ac404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899d0fa4bc124c13aeb830f6f293748b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:10.553885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 882/1791] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:10.560206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac7300-1081-4a66-8c1b-664bbd0e4d8c service placement] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:10.573402 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac7300-1081-4a66-8c1b-664bbd0e4d8c service placement] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:10.580183 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085193e6-8d5b-4a9c-b59e-cb92df6156ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:10.581150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085193e6-8d5b-4a9c-b59e-cb92df6156ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:10.581487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085193e6-8d5b-4a9c-b59e-cb92df6156ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:10.581891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085193e6-8d5b-4a9c-b59e-cb92df6156ce admin admin] PATH_INFO: `/v3/projects/bde67bc6177741c2bdf1b33c02b9014d/users/97361fdf73d94ff3b7cc7aad1233b139/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:10.607042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085193e6-8d5b-4a9c-b59e-cb92df6156ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde67bc6177741c2bdf1b33c02b9014d, user_id=97361fdf73d94ff3b7cc7aad1233b139, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:10.610298 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085193e6-8d5b-4a9c-b59e-cb92df6156ce admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:10.641149 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-4dd82ddf-bff0-4163-8d14-1e58c38ac404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899d0fa4bc124c13aeb830f6f293748b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:10.641850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-4dd82ddf-bff0-4163-8d14-1e58c38ac404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899d0fa4bc124c13aeb830f6f293748b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:10.653546 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-4dd82ddf-bff0-4163-8d14-1e58c38ac404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899d0fa4bc124c13aeb830f6f293748b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:10.660779 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 910/1792] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:10 2022] DELETE /identity/v3/users/899d0fa4bc124c13aeb830f6f293748b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:10.759607 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 883/1793] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:10 2022] PUT /identity/v3/projects/bde67bc6177741c2bdf1b33c02b9014d/users/97361fdf73d94ff3b7cc7aad1233b139/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:10.764460 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd82ddf-bff0-4163-8d14-1e58c38ac404 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:10.766239 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-4dd82ddf-bff0-4163-8d14-1e58c38ac404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:10.770021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:10.836853 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085193e6-8d5b-4a9c-b59e-cb92df6156ce admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:10.838783 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-085193e6-8d5b-4a9c-b59e-cb92df6156ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:10.863059 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd82ddf-bff0-4163-8d14-1e58c38ac404 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:11.050700 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7a47a-4f18-40d3-901a-a1894a0dcfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:11.053324 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7a47a-4f18-40d3-901a-a1894a0dcfae admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:11.053735 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7a47a-4f18-40d3-901a-a1894a0dcfae admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:11.057186 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7a47a-4f18-40d3-901a-a1894a0dcfae admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:11.057361 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085193e6-8d5b-4a9c-b59e-cb92df6156ce admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:11.058292 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7a47a-4f18-40d3-901a-a1894a0dcfae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:11.060868 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd29f0f-e0fe-492c-a8d6-bbfc4618f827 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad12085f356a4f0682bb70ad231a10b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:11.061576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd29f0f-e0fe-492c-a8d6-bbfc4618f827 service swift] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:11.061853 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd29f0f-e0fe-492c-a8d6-bbfc4618f827 service swift] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:11.062140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd29f0f-e0fe-492c-a8d6-bbfc4618f827 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:11.064361 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7a47a-4f18-40d3-901a-a1894a0dcfae admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:11.069485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-3bd29f0f-e0fe-492c-a8d6-bbfc4618f827 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:11.084122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 911/1794] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:11.085211 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7a47a-4f18-40d3-901a-a1894a0dcfae admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:11.114706 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7a47a-4f18-40d3-901a-a1894a0dcfae admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:11.146524 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0ede3-85c8-49fe-873a-e96c262ae65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:11.150577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0ede3-85c8-49fe-873a-e96c262ae65a admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:11.150577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0ede3-85c8-49fe-873a-e96c262ae65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:11.151480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0ede3-85c8-49fe-873a-e96c262ae65a admin admin] PATH_INFO: `/v3/projects/bde67bc6177741c2bdf1b33c02b9014d/users/97361fdf73d94ff3b7cc7aad1233b139/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:11.186002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0ede3-85c8-49fe-873a-e96c262ae65a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde67bc6177741c2bdf1b33c02b9014d, user_id=97361fdf73d94ff3b7cc7aad1233b139, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:11.200926 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0ede3-85c8-49fe-873a-e96c262ae65a admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:11.231871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 912/1795] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:11 2022] PUT /identity/v3/projects/bde67bc6177741c2bdf1b33c02b9014d/users/97361fdf73d94ff3b7cc7aad1233b139/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:11.240062 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0ede3-85c8-49fe-873a-e96c262ae65a admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:11.245505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-12a0ede3-85c8-49fe-873a-e96c262ae65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:11.306510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd29f0f-e0fe-492c-a8d6-bbfc4618f827 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:11.310072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd29f0f-e0fe-492c-a8d6-bbfc4618f827 service swift] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:11.325778 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 884/1796] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Jul 12 14:42:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 14:42:11.328346 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87128fd6-34d2-46bc-9185-29e17287db6a None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:11.328918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87128fd6-34d2-46bc-9185-29e17287db6a None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:11.328918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87128fd6-34d2-46bc-9185-29e17287db6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:11.422601 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-87128fd6-34d2-46bc-9185-29e17287db6a None None] MFA Rules not processed for user `97361fdf73d94ff3b7cc7aad1233b139`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:11.424578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-87128fd6-34d2-46bc-9185-29e17287db6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:11.439683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0ede3-85c8-49fe-873a-e96c262ae65a admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:11.451160 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8691580-79bf-4577-8365-ee1a3dd0ab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:11.451988 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8691580-79bf-4577-8365-ee1a3dd0ab1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:11.452427 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8691580-79bf-4577-8365-ee1a3dd0ab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:11.452549 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8691580-79bf-4577-8365-ee1a3dd0ab1c admin admin] PATH_INFO: `/v3/projects/9815547a20194aa59c2a95f92dbaa63c` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:11.454612 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8691580-79bf-4577-8365-ee1a3dd0ab1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9815547a20194aa59c2a95f92dbaa63c)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:11.456755 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8691580-79bf-4577-8365-ee1a3dd0ab1c admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:11.630252 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 885/1797] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:11.636759 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87128fd6-34d2-46bc-9185-29e17287db6a None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:11.641589 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:11.642768 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-87128fd6-34d2-46bc-9185-29e17287db6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:11.677532 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c8691580-79bf-4577-8365-ee1a3dd0ab1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9815547a20194aa59c2a95f92dbaa63c', 'request_id': 'req-c8691580-79bf-4577-8365-ee1a3dd0ab1c'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:11.788815 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c8691580-79bf-4577-8365-ee1a3dd0ab1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9815547a20194aa59c2a95f92dbaa63c', 'request_id': 'req-c8691580-79bf-4577-8365-ee1a3dd0ab1c'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:11.804511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c8691580-79bf-4577-8365-ee1a3dd0ab1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9815547a20194aa59c2a95f92dbaa63c', 'request_id': 'req-c8691580-79bf-4577-8365-ee1a3dd0ab1c'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:11.856033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c8691580-79bf-4577-8365-ee1a3dd0ab1c admin admin] The token cache is being invalidate because project 9815547a20194aa59c2a95f92dbaa63c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:11.856336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c8691580-79bf-4577-8365-ee1a3dd0ab1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:11.861275 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c8691580-79bf-4577-8365-ee1a3dd0ab1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:11.865594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 913/1798] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:11 2022] DELETE /identity/v3/projects/9815547a20194aa59c2a95f92dbaa63c => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:11.869579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8691580-79bf-4577-8365-ee1a3dd0ab1c admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:11.872666 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-c8691580-79bf-4577-8365-ee1a3dd0ab1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:11.887805 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87128fd6-34d2-46bc-9185-29e17287db6a None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:11.964046 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:12.033702 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48fd4c-0035-46c6-bbdd-a5034217d2df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:12.037219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48fd4c-0035-46c6-bbdd-a5034217d2df service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:12.037219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48fd4c-0035-46c6-bbdd-a5034217d2df service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:12.037219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48fd4c-0035-46c6-bbdd-a5034217d2df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:12.051663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8691580-79bf-4577-8365-ee1a3dd0ab1c admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:12.053646 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-9c48fd4c-0035-46c6-bbdd-a5034217d2df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:12.064134 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384c278-0116-4b1e-aaca-edaa23ada4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:12.065300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384c278-0116-4b1e-aaca-edaa23ada4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:12.065868 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384c278-0116-4b1e-aaca-edaa23ada4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:12.066288 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384c278-0116-4b1e-aaca-edaa23ada4cb admin admin] PATH_INFO: `/v3/users/1fe49f461a1443f59d20f072f1555db4` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:12.068327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384c278-0116-4b1e-aaca-edaa23ada4cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe49f461a1443f59d20f072f1555db4)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:12.070488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384c278-0116-4b1e-aaca-edaa23ada4cb admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:12.167600 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48fd4c-0035-46c6-bbdd-a5034217d2df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:12.171324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48fd4c-0035-46c6-bbdd-a5034217d2df service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:12.211540 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 886/1799] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:11 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:12.381442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-4384c278-0116-4b1e-aaca-edaa23ada4cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe49f461a1443f59d20f072f1555db4'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:12.407235 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:12.409909 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-4384c278-0116-4b1e-aaca-edaa23ada4cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe49f461a1443f59d20f072f1555db4'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:12.517642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-4384c278-0116-4b1e-aaca-edaa23ada4cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe49f461a1443f59d20f072f1555db4'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:12.519457 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-4384c278-0116-4b1e-aaca-edaa23ada4cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe49f461a1443f59d20f072f1555db4'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:12.531751 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-4384c278-0116-4b1e-aaca-edaa23ada4cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe49f461a1443f59d20f072f1555db4'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:12.544933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 914/1800] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:11 2022] DELETE /identity/v3/users/1fe49f461a1443f59d20f072f1555db4 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:13.011113 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48fd4c-0035-46c6-bbdd-a5034217d2df service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:13.046573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48fd4c-0035-46c6-bbdd-a5034217d2df service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:13.190957 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2f8c4-de20-4148-9690-6c67c3c1d503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:13.192095 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2f8c4-de20-4148-9690-6c67c3c1d503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:13.193288 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2f8c4-de20-4148-9690-6c67c3c1d503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:13.193579 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2f8c4-de20-4148-9690-6c67c3c1d503 admin admin] PATH_INFO: `/v3/projects/ba953a17d8384dc9bf766f9e003be154` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:13.195137 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2f8c4-de20-4148-9690-6c67c3c1d503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba953a17d8384dc9bf766f9e003be154)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:13.200621 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2f8c4-de20-4148-9690-6c67c3c1d503 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:13.439661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384c278-0116-4b1e-aaca-edaa23ada4cb admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:13.443362 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:13.445883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-4384c278-0116-4b1e-aaca-edaa23ada4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:13.464480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-64d2f8c4-de20-4148-9690-6c67c3c1d503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba953a17d8384dc9bf766f9e003be154', 'request_id': 'req-64d2f8c4-de20-4148-9690-6c67c3c1d503'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:13.470516 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384c278-0116-4b1e-aaca-edaa23ada4cb admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:13.480942 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-64d2f8c4-de20-4148-9690-6c67c3c1d503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba953a17d8384dc9bf766f9e003be154', 'request_id': 'req-64d2f8c4-de20-4148-9690-6c67c3c1d503'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:13.498007 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-64d2f8c4-de20-4148-9690-6c67c3c1d503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba953a17d8384dc9bf766f9e003be154', 'request_id': 'req-64d2f8c4-de20-4148-9690-6c67c3c1d503'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:13.579306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d02d40-b2a7-4317-8a0f-97991a9bd39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:13.580422 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d02d40-b2a7-4317-8a0f-97991a9bd39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:13.580645 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d02d40-b2a7-4317-8a0f-97991a9bd39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:13.580924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d02d40-b2a7-4317-8a0f-97991a9bd39b admin admin] PATH_INFO: `/v3/projects/8748e4793cf540b6910ee8765e09b797` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:13.582446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d02d40-b2a7-4317-8a0f-97991a9bd39b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8748e4793cf540b6910ee8765e09b797)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:13.585625 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d02d40-b2a7-4317-8a0f-97991a9bd39b admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:13.586863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-64d2f8c4-de20-4148-9690-6c67c3c1d503 admin admin] The token cache is being invalidate because project ba953a17d8384dc9bf766f9e003be154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:13.587121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-64d2f8c4-de20-4148-9690-6c67c3c1d503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:13.591129 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-64d2f8c4-de20-4148-9690-6c67c3c1d503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:13.596547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 887/1801] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:13 2022] DELETE /identity/v3/projects/ba953a17d8384dc9bf766f9e003be154 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:13.598153 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f42a4-049f-44e4-8a56-6e743a9d41dd None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:13.598447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f42a4-049f-44e4-8a56-6e743a9d41dd None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:13.598727 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f42a4-049f-44e4-8a56-6e743a9d41dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:13.641267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-6f6f42a4-049f-44e4-8a56-6e743a9d41dd None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:13.643472 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-6f6f42a4-049f-44e4-8a56-6e743a9d41dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:13.667753 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 888/1802] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:42:13.667753 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f18b1-9e28-4f22-969b-a0eae620e91c None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:13.667753 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f18b1-9e28-4f22-969b-a0eae620e91c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:13.667753 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f18b1-9e28-4f22-969b-a0eae620e91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:13.706927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-bd1f18b1-9e28-4f22-969b-a0eae620e91c None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:13.710533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-bd1f18b1-9e28-4f22-969b-a0eae620e91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:13.731743 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b0d02d40-b2a7-4317-8a0f-97991a9bd39b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8748e4793cf540b6910ee8765e09b797', 'request_id': 'req-b0d02d40-b2a7-4317-8a0f-97991a9bd39b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:13.787093 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:13.817932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b0d02d40-b2a7-4317-8a0f-97991a9bd39b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8748e4793cf540b6910ee8765e09b797', 'request_id': 'req-b0d02d40-b2a7-4317-8a0f-97991a9bd39b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:13.827635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b0d02d40-b2a7-4317-8a0f-97991a9bd39b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8748e4793cf540b6910ee8765e09b797', 'request_id': 'req-b0d02d40-b2a7-4317-8a0f-97991a9bd39b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:13.871867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b0d02d40-b2a7-4317-8a0f-97991a9bd39b admin admin] The token cache is being invalidate because project 8748e4793cf540b6910ee8765e09b797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:13.873896 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b0d02d40-b2a7-4317-8a0f-97991a9bd39b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:13.877556 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b0d02d40-b2a7-4317-8a0f-97991a9bd39b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:13.883691 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 915/1803] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:13 2022] DELETE /identity/v3/projects/8748e4793cf540b6910ee8765e09b797 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:13.892414 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d02d40-b2a7-4317-8a0f-97991a9bd39b admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:13.898915 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b0d02d40-b2a7-4317-8a0f-97991a9bd39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:13.939951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 889/1804] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:13.944996 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f18b1-9e28-4f22-969b-a0eae620e91c None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:13.989179 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f18b1-9e28-4f22-969b-a0eae620e91c None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:14.012436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab320367-934d-4cd2-9b06-b98179bb1fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:14.013203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab320367-934d-4cd2-9b06-b98179bb1fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:14.013488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab320367-934d-4cd2-9b06-b98179bb1fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:14.013862 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab320367-934d-4cd2-9b06-b98179bb1fe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:14.014601 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab320367-934d-4cd2-9b06-b98179bb1fe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:14.015129 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab320367-934d-4cd2-9b06-b98179bb1fe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:14.017033 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab320367-934d-4cd2-9b06-b98179bb1fe8 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:14.069676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 890/1805] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:42:14.075984 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab320367-934d-4cd2-9b06-b98179bb1fe8 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:14.130379 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab320367-934d-4cd2-9b06-b98179bb1fe8 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:14.151171 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f8e38-3bf2-450f-875d-fce5725ed758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:14.154734 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f8e38-3bf2-450f-875d-fce5725ed758 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:14.155263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f8e38-3bf2-450f-875d-fce5725ed758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:14.155795 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f8e38-3bf2-450f-875d-fce5725ed758 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:14.156850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f8e38-3bf2-450f-875d-fce5725ed758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:14.172692 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f8e38-3bf2-450f-875d-fce5725ed758 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:14.197264 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d02d40-b2a7-4317-8a0f-97991a9bd39b admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:14.212443 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624611e-6e6f-4b47-8284-9119d2011696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:14.229521 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624611e-6e6f-4b47-8284-9119d2011696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:14.232774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624611e-6e6f-4b47-8284-9119d2011696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:14.234036 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624611e-6e6f-4b47-8284-9119d2011696 admin admin] PATH_INFO: `/v3/users/f3259af8a69f4f72a191981c078388f7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:14.240926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:14.245413 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624611e-6e6f-4b47-8284-9119d2011696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3259af8a69f4f72a191981c078388f7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:14.253798 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624611e-6e6f-4b47-8284-9119d2011696 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:14.434852 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 891/1806] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:14 2022] POST /identity/v3/projects => generated 365 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:14.436689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa1f1a-e85b-468c-a98d-f1a5d7515390 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:14.437621 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa1f1a-e85b-468c-a98d-f1a5d7515390 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:14.439083 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa1f1a-e85b-468c-a98d-f1a5d7515390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:14.475207 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-4dfa1f1a-e85b-468c-a98d-f1a5d7515390 None None] MFA Rules not processed for user `2af2d348fc984ed897fd58196b433b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:14.477694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-4dfa1f1a-e85b-468c-a98d-f1a5d7515390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:14.568020 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 892/1807] 10.222.0.59 () {58 vars in 1015 bytes} [Tue Jul 12 14:42:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:14.569363 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa1f1a-e85b-468c-a98d-f1a5d7515390 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:14.571016 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-4dfa1f1a-e85b-468c-a98d-f1a5d7515390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:14.585107 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-8624611e-6e6f-4b47-8284-9119d2011696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3259af8a69f4f72a191981c078388f7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:14.628373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-8624611e-6e6f-4b47-8284-9119d2011696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3259af8a69f4f72a191981c078388f7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:14.675142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa1f1a-e85b-468c-a98d-f1a5d7515390 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:14.681486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6524d-7fcd-4797-a3fc-bf51c5109a48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:14.683932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6524d-7fcd-4797-a3fc-bf51c5109a48 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:14.684270 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6524d-7fcd-4797-a3fc-bf51c5109a48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:14.684524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6524d-7fcd-4797-a3fc-bf51c5109a48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:14.687022 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-dcb6524d-7fcd-4797-a3fc-bf51c5109a48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:14.743667 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-8624611e-6e6f-4b47-8284-9119d2011696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3259af8a69f4f72a191981c078388f7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:14.744483 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-8624611e-6e6f-4b47-8284-9119d2011696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3259af8a69f4f72a191981c078388f7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:14.757267 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-8624611e-6e6f-4b47-8284-9119d2011696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3259af8a69f4f72a191981c078388f7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:14.773177 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 916/1808] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:13 2022] DELETE /identity/v3/users/f3259af8a69f4f72a191981c078388f7 => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:14.775489 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624611e-6e6f-4b47-8284-9119d2011696 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:14.781179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:14.782604 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-8624611e-6e6f-4b47-8284-9119d2011696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:14.815623 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6524d-7fcd-4797-a3fc-bf51c5109a48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:14.817266 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6524d-7fcd-4797-a3fc-bf51c5109a48 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:14.847635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 893/1809] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:14.936880 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624611e-6e6f-4b47-8284-9119d2011696 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:14.940692 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:14.961022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf76b98-898a-4853-9434-4b604566c090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:14.962854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf76b98-898a-4853-9434-4b604566c090 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:14.963155 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf76b98-898a-4853-9434-4b604566c090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:14.966689 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf76b98-898a-4853-9434-4b604566c090 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:14.969630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf76b98-898a-4853-9434-4b604566c090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:14.976306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf76b98-898a-4853-9434-4b604566c090 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:15.072850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6524d-7fcd-4797-a3fc-bf51c5109a48 service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:15.074552 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-dcb6524d-7fcd-4797-a3fc-bf51c5109a48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:15.095167 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6524d-7fcd-4797-a3fc-bf51c5109a48 service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:15.153708 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 917/1810] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:14 2022] POST /identity/v3/users => generated 283 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:15.154680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf76b98-898a-4853-9434-4b604566c090 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:15.164585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-6bf76b98-898a-4853-9434-4b604566c090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:15.228631 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372aaef-3b89-4a31-9537-9ab94e3ab9e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:15.229133 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372aaef-3b89-4a31-9537-9ab94e3ab9e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:15.229481 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372aaef-3b89-4a31-9537-9ab94e3ab9e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:15.230036 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372aaef-3b89-4a31-9537-9ab94e3ab9e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:15.237424 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-8372aaef-3b89-4a31-9537-9ab94e3ab9e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:15.260055 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372aaef-3b89-4a31-9537-9ab94e3ab9e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:15.263517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372aaef-3b89-4a31-9537-9ab94e3ab9e9 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:15.279404 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 894/1811] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:42:15.280331 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372aaef-3b89-4a31-9537-9ab94e3ab9e9 service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:15.322317 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf76b98-898a-4853-9434-4b604566c090 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:15.331801 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372aaef-3b89-4a31-9537-9ab94e3ab9e9 service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:15.334051 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dfb10-d38b-42cb-827b-3a128a2ffda0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:15.334966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dfb10-d38b-42cb-827b-3a128a2ffda0 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:15.336872 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dfb10-d38b-42cb-827b-3a128a2ffda0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:15.337311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dfb10-d38b-42cb-827b-3a128a2ffda0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:15.344429 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7506f9-c766-480b-8aed-d6fdd991b6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:15.346590 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7506f9-c766-480b-8aed-d6fdd991b6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:15.346886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7506f9-c766-480b-8aed-d6fdd991b6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:15.349559 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7506f9-c766-480b-8aed-d6fdd991b6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:15.350584 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7506f9-c766-480b-8aed-d6fdd991b6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:15.356670 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dfb10-d38b-42cb-827b-3a128a2ffda0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:15.358164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dfb10-d38b-42cb-827b-3a128a2ffda0 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:15.358425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7506f9-c766-480b-8aed-d6fdd991b6e3 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:15.379408 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 918/1812] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:15.385761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 895/1813] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:15.394367 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dfb10-d38b-42cb-827b-3a128a2ffda0 service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:15.421041 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dfb10-d38b-42cb-827b-3a128a2ffda0 service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:15.426950 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dba531-d4db-4dd8-a844-50282eef6731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:15.429966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dba531-d4db-4dd8-a844-50282eef6731 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:15.429966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dba531-d4db-4dd8-a844-50282eef6731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:15.429966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dba531-d4db-4dd8-a844-50282eef6731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:15.429966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dba531-d4db-4dd8-a844-50282eef6731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:15.432659 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dba531-d4db-4dd8-a844-50282eef6731 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:15.448344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 919/1814] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:15.448916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7506f9-c766-480b-8aed-d6fdd991b6e3 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:15.465731 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7506f9-c766-480b-8aed-d6fdd991b6e3 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:15.478167 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51277b-2f11-4c14-b1fe-63c4cf61d14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:15.481130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51277b-2f11-4c14-b1fe-63c4cf61d14f admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:15.482572 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51277b-2f11-4c14-b1fe-63c4cf61d14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:15.496381 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51277b-2f11-4c14-b1fe-63c4cf61d14f admin admin] PATH_INFO: `/v3/projects/0b2ee2b8c9d34795bb2a6e4889439aea/users/54ba9d6dca25459ea0f82d53c3375e02/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:15.553034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51277b-2f11-4c14-b1fe-63c4cf61d14f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2ee2b8c9d34795bb2a6e4889439aea, user_id=54ba9d6dca25459ea0f82d53c3375e02, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:15.555806 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51277b-2f11-4c14-b1fe-63c4cf61d14f admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:15.635866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:15.654472 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 896/1815] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:15 2022] PUT /identity/v3/projects/0b2ee2b8c9d34795bb2a6e4889439aea/users/54ba9d6dca25459ea0f82d53c3375e02/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:15.656434 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f679e-d7f8-4269-b6c2-d1843780a04a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:15.659210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f679e-d7f8-4269-b6c2-d1843780a04a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:15.659673 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f679e-d7f8-4269-b6c2-d1843780a04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:15.743665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-f89f679e-d7f8-4269-b6c2-d1843780a04a None None] MFA Rules not processed for user `54ba9d6dca25459ea0f82d53c3375e02`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:15.757706 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f89f679e-d7f8-4269-b6c2-d1843780a04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:15.984560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 920/1816] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:15.990640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51277b-2f11-4c14-b1fe-63c4cf61d14f admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:16.040667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:16.191950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51277b-2f11-4c14-b1fe-63c4cf61d14f admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:16.207255 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb219d4-44e7-4fb6-ad43-96dfc5c413b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:16.208019 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb219d4-44e7-4fb6-ad43-96dfc5c413b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:16.208286 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb219d4-44e7-4fb6-ad43-96dfc5c413b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:16.208569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb219d4-44e7-4fb6-ad43-96dfc5c413b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:16.209284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb219d4-44e7-4fb6-ad43-96dfc5c413b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:16.212881 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb219d4-44e7-4fb6-ad43-96dfc5c413b0 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:16.342811 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 897/1817] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:15 2022] POST /identity/v3/projects => generated 365 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:16.346947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f679e-d7f8-4269-b6c2-d1843780a04a None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:16.368876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f679e-d7f8-4269-b6c2-d1843780a04a None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:16.483557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159c59d-b7b4-4d28-b1ce-21603581e803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:16.484506 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159c59d-b7b4-4d28-b1ce-21603581e803 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:16.484891 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159c59d-b7b4-4d28-b1ce-21603581e803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:16.485406 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159c59d-b7b4-4d28-b1ce-21603581e803 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:16.486567 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159c59d-b7b4-4d28-b1ce-21603581e803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:16.489079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159c59d-b7b4-4d28-b1ce-21603581e803 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:16.592948 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 921/1818] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:16 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:16.600757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb219d4-44e7-4fb6-ad43-96dfc5c413b0 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:16.654310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb219d4-44e7-4fb6-ad43-96dfc5c413b0 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:16.674682 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13d8c9-8ac1-4b16-b38f-538f2bb6e967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:16.677605 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13d8c9-8ac1-4b16-b38f-538f2bb6e967 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:16.677750 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13d8c9-8ac1-4b16-b38f-538f2bb6e967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:16.678300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13d8c9-8ac1-4b16-b38f-538f2bb6e967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:16.679304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13d8c9-8ac1-4b16-b38f-538f2bb6e967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:16.683334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13d8c9-8ac1-4b16-b38f-538f2bb6e967 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:16.720262 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 898/1819] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:16.721631 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159c59d-b7b4-4d28-b1ce-21603581e803 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:16.735861 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159c59d-b7b4-4d28-b1ce-21603581e803 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:16.750450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83b491-099a-4a5c-8f4a-a18ba340e3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:16.753819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83b491-099a-4a5c-8f4a-a18ba340e3fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:16.753819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83b491-099a-4a5c-8f4a-a18ba340e3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:16.754544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83b491-099a-4a5c-8f4a-a18ba340e3fe admin admin] PATH_INFO: `/v3/projects/f7d9c93f5bdc473796a506633751cb15/users/6266f157b963424b92f07d5461164f20/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:16.807100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83b491-099a-4a5c-8f4a-a18ba340e3fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d9c93f5bdc473796a506633751cb15, user_id=6266f157b963424b92f07d5461164f20, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:16.814093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83b491-099a-4a5c-8f4a-a18ba340e3fe admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:16.929591 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 922/1820] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:16 2022] PUT /identity/v3/projects/f7d9c93f5bdc473796a506633751cb15/users/6266f157b963424b92f07d5461164f20/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:16.934388 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13d8c9-8ac1-4b16-b38f-538f2bb6e967 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:16.954244 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13d8c9-8ac1-4b16-b38f-538f2bb6e967 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:17.033545 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83b491-099a-4a5c-8f4a-a18ba340e3fe admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:17.035750 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-fe83b491-099a-4a5c-8f4a-a18ba340e3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:17.184453 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f7a44-43a7-413d-8d15-f5ab52b125e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:17.185035 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f7a44-43a7-413d-8d15-f5ab52b125e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:17.191481 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f7a44-43a7-413d-8d15-f5ab52b125e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:17.191895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f7a44-43a7-413d-8d15-f5ab52b125e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:17.196812 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f7a44-43a7-413d-8d15-f5ab52b125e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:17.200575 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f7a44-43a7-413d-8d15-f5ab52b125e0 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:17.240943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 899/1821] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:17.245024 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f7a44-43a7-413d-8d15-f5ab52b125e0 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:17.276520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f7a44-43a7-413d-8d15-f5ab52b125e0 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:17.311582 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83b491-099a-4a5c-8f4a-a18ba340e3fe admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:17.324911 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d75cb-6dd6-46eb-a9c6-2a456be394a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:17.331599 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:17.331979 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d75cb-6dd6-46eb-a9c6-2a456be394a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:17.331979 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d75cb-6dd6-46eb-a9c6-2a456be394a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:17.331979 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d75cb-6dd6-46eb-a9c6-2a456be394a4 admin admin] PATH_INFO: `/v3/projects/1609cfd8eaf54756959598299df6df77` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:17.332181 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528deede-d904-4d8d-a78b-3d09d8f85265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:17.332266 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d75cb-6dd6-46eb-a9c6-2a456be394a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1609cfd8eaf54756959598299df6df77)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:17.332335 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528deede-d904-4d8d-a78b-3d09d8f85265 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:17.332335 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528deede-d904-4d8d-a78b-3d09d8f85265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:17.332335 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528deede-d904-4d8d-a78b-3d09d8f85265 admin admin] PATH_INFO: `/v3/projects/f7d9c93f5bdc473796a506633751cb15/users/6266f157b963424b92f07d5461164f20/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:17.335047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d75cb-6dd6-46eb-a9c6-2a456be394a4 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:17.340074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528deede-d904-4d8d-a78b-3d09d8f85265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d9c93f5bdc473796a506633751cb15, user_id=6266f157b963424b92f07d5461164f20, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:17.344202 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528deede-d904-4d8d-a78b-3d09d8f85265 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:17.367494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 900/1822] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:17 2022] PUT /identity/v3/projects/f7d9c93f5bdc473796a506633751cb15/users/6266f157b963424b92f07d5461164f20/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:17.373063 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:17.378416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e78ff-b99b-4ff7-abb9-6201f89300fa None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:17.383054 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e78ff-b99b-4ff7-abb9-6201f89300fa None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:17.383774 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e78ff-b99b-4ff7-abb9-6201f89300fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:17.461143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-130e78ff-b99b-4ff7-abb9-6201f89300fa None None] MFA Rules not processed for user `6266f157b963424b92f07d5461164f20`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:17.463522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-130e78ff-b99b-4ff7-abb9-6201f89300fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:17.568190 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f51d75cb-6dd6-46eb-a9c6-2a456be394a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1609cfd8eaf54756959598299df6df77', 'request_id': 'req-f51d75cb-6dd6-46eb-a9c6-2a456be394a4'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:17.601001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 901/1823] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:17 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:17.615579 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e78ff-b99b-4ff7-abb9-6201f89300fa None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:17.622962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-130e78ff-b99b-4ff7-abb9-6201f89300fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:17.648634 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f51d75cb-6dd6-46eb-a9c6-2a456be394a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1609cfd8eaf54756959598299df6df77', 'request_id': 'req-f51d75cb-6dd6-46eb-a9c6-2a456be394a4'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:17.656321 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f51d75cb-6dd6-46eb-a9c6-2a456be394a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1609cfd8eaf54756959598299df6df77', 'request_id': 'req-f51d75cb-6dd6-46eb-a9c6-2a456be394a4'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:17.682629 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f51d75cb-6dd6-46eb-a9c6-2a456be394a4 admin admin] The token cache is being invalidate because project 1609cfd8eaf54756959598299df6df77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:17.683222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f51d75cb-6dd6-46eb-a9c6-2a456be394a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:17.686132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f51d75cb-6dd6-46eb-a9c6-2a456be394a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:17.686132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 923/1824] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:17 2022] DELETE /identity/v3/projects/1609cfd8eaf54756959598299df6df77 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:42:17.688119 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d75cb-6dd6-46eb-a9c6-2a456be394a4 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:17.690495 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f51d75cb-6dd6-46eb-a9c6-2a456be394a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:17.766354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d75cb-6dd6-46eb-a9c6-2a456be394a4 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:17.770711 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55dc7d-bd16-4fd2-8d16-73055e484da0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:17.771825 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55dc7d-bd16-4fd2-8d16-73055e484da0 service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:17.772158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55dc7d-bd16-4fd2-8d16-73055e484da0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:17.772528 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55dc7d-bd16-4fd2-8d16-73055e484da0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:17.774725 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-5c55dc7d-bd16-4fd2-8d16-73055e484da0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:17.840798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e78ff-b99b-4ff7-abb9-6201f89300fa None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:17.852585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:17.943414 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55dc7d-bd16-4fd2-8d16-73055e484da0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:17.954813 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55dc7d-bd16-4fd2-8d16-73055e484da0 service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:17.989364 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 924/1825] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:17 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:17.991568 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540bc33-723a-43a8-b6ee-db7e0317f404 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:17.991872 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540bc33-723a-43a8-b6ee-db7e0317f404 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:17.992162 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540bc33-723a-43a8-b6ee-db7e0317f404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:18.019647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8ed6c-e56e-4beb-be92-2f16604e6a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:18.024943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8ed6c-e56e-4beb-be92-2f16604e6a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:18.024943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8ed6c-e56e-4beb-be92-2f16604e6a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:18.024943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8ed6c-e56e-4beb-be92-2f16604e6a02 admin admin] PATH_INFO: `/v3/users/f1805687e51e4d209dece879682eb0e5` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:18.027040 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8ed6c-e56e-4beb-be92-2f16604e6a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1805687e51e4d209dece879682eb0e5)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:18.029781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8ed6c-e56e-4beb-be92-2f16604e6a02 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:18.041672 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-f540bc33-723a-43a8-b6ee-db7e0317f404 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:18.044083 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f540bc33-723a-43a8-b6ee-db7e0317f404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:18.063614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 925/1826] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:18.066702 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb79683-3bff-4812-b5db-18b4768b5043 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:18.067739 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb79683-3bff-4812-b5db-18b4768b5043 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:18.068296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb79683-3bff-4812-b5db-18b4768b5043 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:18.072233 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 926/1827] 10.222.0.40 () {54 vars in 921 bytes} [Tue Jul 12 14:42:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:42:18.077814 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcf95f-bc94-4f10-9171-7f416bc16ac3 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:18.078260 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcf95f-bc94-4f10-9171-7f416bc16ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:18.078670 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcf95f-bc94-4f10-9171-7f416bc16ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:18.168740 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-a8bcf95f-bc94-4f10-9171-7f416bc16ac3 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:18.171925 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a8bcf95f-bc94-4f10-9171-7f416bc16ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:18.196853 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 927/1828] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:18.205381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcf95f-bc94-4f10-9171-7f416bc16ac3 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:18.242757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcf95f-bc94-4f10-9171-7f416bc16ac3 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:18.274316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607045a6-d8f4-4183-bc2e-0963ab782685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:18.275091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607045a6-d8f4-4183-bc2e-0963ab782685 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:18.275438 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607045a6-d8f4-4183-bc2e-0963ab782685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:18.277139 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607045a6-d8f4-4183-bc2e-0963ab782685 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:18.277139 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607045a6-d8f4-4183-bc2e-0963ab782685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:18.282651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607045a6-d8f4-4183-bc2e-0963ab782685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:18.290288 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607045a6-d8f4-4183-bc2e-0963ab782685 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:18.305452 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 928/1829] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:42:18.307448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fa303-fc12-4775-b9b4-c73a07f6e0cd None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:18.307448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fa303-fc12-4775-b9b4-c73a07f6e0cd None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:18.307643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fa303-fc12-4775-b9b4-c73a07f6e0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:18.334387 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-ae5fa303-fc12-4775-b9b4-c73a07f6e0cd None None] MFA Rules not processed for user `122fc227de9d4f87a66e4a0d86ff0b16`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:18.336394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ae5fa303-fc12-4775-b9b4-c73a07f6e0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:18.408954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-38b8ed6c-e56e-4beb-be92-2f16604e6a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1805687e51e4d209dece879682eb0e5'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:18.447790 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-38b8ed6c-e56e-4beb-be92-2f16604e6a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1805687e51e4d209dece879682eb0e5'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:18.457301 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-38b8ed6c-e56e-4beb-be92-2f16604e6a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1805687e51e4d209dece879682eb0e5'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:18.535724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 929/1830] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Jul 12 14:42:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:18.536620 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fa303-fc12-4775-b9b4-c73a07f6e0cd None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:18.545245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-38b8ed6c-e56e-4beb-be92-2f16604e6a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1805687e51e4d209dece879682eb0e5'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:18.546184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-38b8ed6c-e56e-4beb-be92-2f16604e6a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1805687e51e4d209dece879682eb0e5'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:18.555053 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 902/1831] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:17 2022] DELETE /identity/v3/users/f1805687e51e4d209dece879682eb0e5 => generated 0 bytes in 958 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:18.558946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8ed6c-e56e-4beb-be92-2f16604e6a02 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:18.562214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-38b8ed6c-e56e-4beb-be92-2f16604e6a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:18.570663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fa303-fc12-4775-b9b4-c73a07f6e0cd None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:18.658899 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbbc97-4410-4ebd-a3b5-3074d54aad39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:18.660018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbbc97-4410-4ebd-a3b5-3074d54aad39 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:18.660450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbbc97-4410-4ebd-a3b5-3074d54aad39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:18.660876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbbc97-4410-4ebd-a3b5-3074d54aad39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:18.661734 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbbc97-4410-4ebd-a3b5-3074d54aad39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:18.664072 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbbc97-4410-4ebd-a3b5-3074d54aad39 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:18.750812 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8ed6c-e56e-4beb-be92-2f16604e6a02 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:18.756631 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b36db-931b-4e10-9857-30d65c5f6ce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:18.758457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b36db-931b-4e10-9857-30d65c5f6ce7 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:18.764990 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b36db-931b-4e10-9857-30d65c5f6ce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:18.764990 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b36db-931b-4e10-9857-30d65c5f6ce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:18.765649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-082b36db-931b-4e10-9857-30d65c5f6ce7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:18.800740 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 930/1832] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:18 2022] POST /identity/v3/projects => generated 385 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:18.806012 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e6d00-d231-4863-946c-f7d0f32b48d9 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:18.807529 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e6d00-d231-4863-946c-f7d0f32b48d9 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:18.809938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e6d00-d231-4863-946c-f7d0f32b48d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:18.909913 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-e51e6d00-d231-4863-946c-f7d0f32b48d9 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:18.918113 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e51e6d00-d231-4863-946c-f7d0f32b48d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:19.041442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b36db-931b-4e10-9857-30d65c5f6ce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:19.051911 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b36db-931b-4e10-9857-30d65c5f6ce7 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:19.089612 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 903/1833] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:19.096221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 931/1834] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:19.097961 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e6d00-d231-4863-946c-f7d0f32b48d9 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:19.100227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e51e6d00-d231-4863-946c-f7d0f32b48d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:19.121111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e6d00-d231-4863-946c-f7d0f32b48d9 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:19.133854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45decd-6c6d-4966-912e-33785f7832bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:19.134940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45decd-6c6d-4966-912e-33785f7832bb admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.137590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45decd-6c6d-4966-912e-33785f7832bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.140322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45decd-6c6d-4966-912e-33785f7832bb admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.140322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45decd-6c6d-4966-912e-33785f7832bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:19.143572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45decd-6c6d-4966-912e-33785f7832bb admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:19.268194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b36db-931b-4e10-9857-30d65c5f6ce7 service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:19.276459 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-082b36db-931b-4e10-9857-30d65c5f6ce7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:19.300518 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 932/1835] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:19 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:19.304834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45decd-6c6d-4966-912e-33785f7832bb admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:19.338323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45decd-6c6d-4966-912e-33785f7832bb admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:19.351833 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff214bd4-275f-4745-a0d1-fb790b630fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:19.352644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff214bd4-275f-4745-a0d1-fb790b630fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.352931 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff214bd4-275f-4745-a0d1-fb790b630fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.355072 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff214bd4-275f-4745-a0d1-fb790b630fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.358042 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff214bd4-275f-4745-a0d1-fb790b630fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:19.381035 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff214bd4-275f-4745-a0d1-fb790b630fb5 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:19.402806 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 933/1836] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:19.407390 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff214bd4-275f-4745-a0d1-fb790b630fb5 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:19.408417 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b36db-931b-4e10-9857-30d65c5f6ce7 service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:19.458813 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff214bd4-275f-4745-a0d1-fb790b630fb5 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:19.476564 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f79cfc-d7bd-4d43-94bf-8375120347d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:19.477274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f79cfc-d7bd-4d43-94bf-8375120347d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.477561 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f79cfc-d7bd-4d43-94bf-8375120347d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.477881 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f79cfc-d7bd-4d43-94bf-8375120347d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.478902 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f79cfc-d7bd-4d43-94bf-8375120347d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:19.485643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f79cfc-d7bd-4d43-94bf-8375120347d8 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:19.504235 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 934/1837] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:19.509707 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f79cfc-d7bd-4d43-94bf-8375120347d8 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:19.532019 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f79cfc-d7bd-4d43-94bf-8375120347d8 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:19.547520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f838da-1df0-4ebc-bc00-688f32a1cdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:19.550617 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f838da-1df0-4ebc-bc00-688f32a1cdbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.551176 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f838da-1df0-4ebc-bc00-688f32a1cdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.551910 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f838da-1df0-4ebc-bc00-688f32a1cdbf admin admin] PATH_INFO: `/v3/projects/9aaac502c60842c5a00c84dd915f4f19/users/3e1f814def964ed7a993eb45e6be6fe7/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.575164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f838da-1df0-4ebc-bc00-688f32a1cdbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aaac502c60842c5a00c84dd915f4f19, user_id=3e1f814def964ed7a993eb45e6be6fe7, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:19.578473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f838da-1df0-4ebc-bc00-688f32a1cdbf admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:19.616848 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e72b0-f402-440a-91d2-4f9c1f09cc8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:19.617730 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e72b0-f402-440a-91d2-4f9c1f09cc8c service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.618250 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e72b0-f402-440a-91d2-4f9c1f09cc8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.618698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e72b0-f402-440a-91d2-4f9c1f09cc8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.635769 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e72b0-f402-440a-91d2-4f9c1f09cc8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:19.638136 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e72b0-f402-440a-91d2-4f9c1f09cc8c service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:19.653960 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 904/1838] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:19.655113 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e72b0-f402-440a-91d2-4f9c1f09cc8c service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:19.657079 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-cf4e72b0-f402-440a-91d2-4f9c1f09cc8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:19.703784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 935/1839] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:19 2022] PUT /identity/v3/projects/9aaac502c60842c5a00c84dd915f4f19/users/3e1f814def964ed7a993eb45e6be6fe7/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:19.706355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9742008-31d8-4ee1-9b11-1d900f7870bf None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:19.706780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9742008-31d8-4ee1-9b11-1d900f7870bf None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:19.707897 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9742008-31d8-4ee1-9b11-1d900f7870bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:19.788614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-d9742008-31d8-4ee1-9b11-1d900f7870bf None None] MFA Rules not processed for user `3e1f814def964ed7a993eb45e6be6fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:19.794063 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d9742008-31d8-4ee1-9b11-1d900f7870bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:19.889624 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e72b0-f402-440a-91d2-4f9c1f09cc8c service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:19.990297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 936/1840] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:19.994111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9742008-31d8-4ee1-9b11-1d900f7870bf None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:20.101244 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9638384-319f-4776-9c30-f1da4c929ad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:20.102580 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9638384-319f-4776-9c30-f1da4c929ad8 service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:20.104442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9638384-319f-4776-9c30-f1da4c929ad8 service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:20.108469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9742008-31d8-4ee1-9b11-1d900f7870bf None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:20.111075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9638384-319f-4776-9c30-f1da4c929ad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:20.115483 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-f9638384-319f-4776-9c30-f1da4c929ad8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:20.122280 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1a200-3d06-4c4b-859b-2eb4ba5f4343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:20.122280 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1a200-3d06-4c4b-859b-2eb4ba5f4343 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:20.122280 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1a200-3d06-4c4b-859b-2eb4ba5f4343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:20.122280 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1a200-3d06-4c4b-859b-2eb4ba5f4343 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:20.122764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1a200-3d06-4c4b-859b-2eb4ba5f4343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:20.125983 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1a200-3d06-4c4b-859b-2eb4ba5f4343 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:20.155621 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9638384-319f-4776-9c30-f1da4c929ad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:20.157858 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9638384-319f-4776-9c30-f1da4c929ad8 service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:20.196703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 905/1841] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:20.273453 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 937/1842] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:19 2022] POST /identity/v3/projects => generated 387 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:42:20.289503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9638384-319f-4776-9c30-f1da4c929ad8 service nova] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:20.297722 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:20.307248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9638384-319f-4776-9c30-f1da4c929ad8 service nova] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:20.429397 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b23dda-e19f-4772-b399-13f7f1fae1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:20.430178 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b23dda-e19f-4772-b399-13f7f1fae1fc admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:20.430471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b23dda-e19f-4772-b399-13f7f1fae1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:20.430751 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b23dda-e19f-4772-b399-13f7f1fae1fc admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:20.431703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b23dda-e19f-4772-b399-13f7f1fae1fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:20.440390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b23dda-e19f-4772-b399-13f7f1fae1fc admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:20.559471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 906/1843] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:20 2022] POST /identity/v3/users => generated 300 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:20.559674 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1a200-3d06-4c4b-859b-2eb4ba5f4343 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:20.581318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1a200-3d06-4c4b-859b-2eb4ba5f4343 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:20.611577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad9f30-eda8-41ab-a739-a0b701e1efb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:20.611577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad9f30-eda8-41ab-a739-a0b701e1efb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:20.611577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad9f30-eda8-41ab-a739-a0b701e1efb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:20.611577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad9f30-eda8-41ab-a739-a0b701e1efb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:20.620077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad9f30-eda8-41ab-a739-a0b701e1efb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:20.622635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad9f30-eda8-41ab-a739-a0b701e1efb9 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:20.665090 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 938/1844] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:20.671058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b23dda-e19f-4772-b399-13f7f1fae1fc admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:20.690205 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b23dda-e19f-4772-b399-13f7f1fae1fc admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:20.696887 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded31b8e-c3d2-4b37-85e1-87b1413cc101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:20.697955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded31b8e-c3d2-4b37-85e1-87b1413cc101 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:20.698306 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded31b8e-c3d2-4b37-85e1-87b1413cc101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:20.698744 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded31b8e-c3d2-4b37-85e1-87b1413cc101 admin admin] PATH_INFO: `/v3/projects/0b4b8a0429044a57a247816176c23182/users/b8cac247fb1c47d29be428510cc91f7b/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:20.720582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded31b8e-c3d2-4b37-85e1-87b1413cc101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4b8a0429044a57a247816176c23182, user_id=b8cac247fb1c47d29be428510cc91f7b, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:20.724126 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded31b8e-c3d2-4b37-85e1-87b1413cc101 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:20.845976 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 907/1845] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:20 2022] PUT /identity/v3/projects/0b4b8a0429044a57a247816176c23182/users/b8cac247fb1c47d29be428510cc91f7b/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:20.850418 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad9f30-eda8-41ab-a739-a0b701e1efb9 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:20.873128 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded31b8e-c3d2-4b37-85e1-87b1413cc101 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:20.881564 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ded31b8e-c3d2-4b37-85e1-87b1413cc101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:20.882564 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad9f30-eda8-41ab-a739-a0b701e1efb9 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:21.067018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded31b8e-c3d2-4b37-85e1-87b1413cc101 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:21.072981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf009b2-2083-48ab-bf73-fed6fec69958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:21.075819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf009b2-2083-48ab-bf73-fed6fec69958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:21.076267 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf009b2-2083-48ab-bf73-fed6fec69958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:21.076649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf009b2-2083-48ab-bf73-fed6fec69958 admin admin] PATH_INFO: `/v3/users/d11dbba443c1461dabb1f08d816a2106` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:21.078548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf009b2-2083-48ab-bf73-fed6fec69958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d11dbba443c1461dabb1f08d816a2106)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:21.081153 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf009b2-2083-48ab-bf73-fed6fec69958 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:21.113079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0221d-7773-4dbe-8c52-5dccbadaa39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:21.114967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0221d-7773-4dbe-8c52-5dccbadaa39a admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:21.114967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0221d-7773-4dbe-8c52-5dccbadaa39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:21.115171 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0221d-7773-4dbe-8c52-5dccbadaa39a admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:21.115925 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0221d-7773-4dbe-8c52-5dccbadaa39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:21.117564 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0221d-7773-4dbe-8c52-5dccbadaa39a admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:21.155729 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:21.156545 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 939/1846] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:21.158651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2c715-ff45-4c1e-b40e-93e2d82d4fe9 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:21.158945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2c715-ff45-4c1e-b40e-93e2d82d4fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:21.159228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2c715-ff45-4c1e-b40e-93e2d82d4fe9 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:21.160689 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 940/1847] 10.222.0.40 () {54 vars in 921 bytes} [Tue Jul 12 14:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:42:21.161840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2c715-ff45-4c1e-b40e-93e2d82d4fe9 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:21.203465 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2c715-ff45-4c1e-b40e-93e2d82d4fe9 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:21.210799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369f566-2637-4ed3-9c52-0d2894921ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:21.211764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369f566-2637-4ed3-9c52-0d2894921ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:21.212066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369f566-2637-4ed3-9c52-0d2894921ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:21.212438 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369f566-2637-4ed3-9c52-0d2894921ff8 admin admin] PATH_INFO: `/v3/projects/0b4b8a0429044a57a247816176c23182/users/b8cac247fb1c47d29be428510cc91f7b/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:21.215352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369f566-2637-4ed3-9c52-0d2894921ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4b8a0429044a57a247816176c23182, user_id=b8cac247fb1c47d29be428510cc91f7b, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:21.218166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369f566-2637-4ed3-9c52-0d2894921ff8 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:21.233385 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 941/1848] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:21 2022] PUT /identity/v3/projects/0b4b8a0429044a57a247816176c23182/users/b8cac247fb1c47d29be428510cc91f7b/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:21.235173 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f158624-f598-4c4d-a3fd-5c6454e35a42 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:21.235657 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f158624-f598-4c4d-a3fd-5c6454e35a42 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:21.243300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f158624-f598-4c4d-a3fd-5c6454e35a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:21.313424 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-3f158624-f598-4c4d-a3fd-5c6454e35a42 None None] MFA Rules not processed for user `122fc227de9d4f87a66e4a0d86ff0b16`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:21.317370 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-3f158624-f598-4c4d-a3fd-5c6454e35a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:21.334704 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8cf009b2-2083-48ab-bf73-fed6fec69958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd11dbba443c1461dabb1f08d816a2106'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:21.397388 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8cf009b2-2083-48ab-bf73-fed6fec69958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd11dbba443c1461dabb1f08d816a2106'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:21.421625 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8cf009b2-2083-48ab-bf73-fed6fec69958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd11dbba443c1461dabb1f08d816a2106'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:21.516862 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 942/1849] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Jul 12 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:21.518604 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4e17c-f5c2-432d-a033-f4eea1a2ae3a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:21.521197 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4e17c-f5c2-432d-a033-f4eea1a2ae3a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:21.521562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4e17c-f5c2-432d-a033-f4eea1a2ae3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:21.538677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8cf009b2-2083-48ab-bf73-fed6fec69958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd11dbba443c1461dabb1f08d816a2106'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:21.539368 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8cf009b2-2083-48ab-bf73-fed6fec69958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd11dbba443c1461dabb1f08d816a2106'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:21.548949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 908/1850] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:20 2022] DELETE /identity/v3/users/d11dbba443c1461dabb1f08d816a2106 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:21.563295 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36ccf8-92a6-468f-960a-3349bd31597d None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:21.563714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36ccf8-92a6-468f-960a-3349bd31597d None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:21.563930 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36ccf8-92a6-468f-960a-3349bd31597d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:21.578875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-d8e4e17c-f5c2-432d-a033-f4eea1a2ae3a None None] MFA Rules not processed for user `b8cac247fb1c47d29be428510cc91f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:21.584987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d8e4e17c-f5c2-432d-a033-f4eea1a2ae3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:21.614595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-1b36ccf8-92a6-468f-960a-3349bd31597d None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:21.619378 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-1b36ccf8-92a6-468f-960a-3349bd31597d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:21.691270 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 943/1851] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:21.705818 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4e17c-f5c2-432d-a033-f4eea1a2ae3a None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:21.707846 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d8e4e17c-f5c2-432d-a033-f4eea1a2ae3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:21.751325 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 909/1852] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:21.802764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4e17c-f5c2-432d-a033-f4eea1a2ae3a None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:21.810010 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eda32b-49a2-4506-b7ae-49911928e1be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:21.812708 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eda32b-49a2-4506-b7ae-49911928e1be service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:21.813172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eda32b-49a2-4506-b7ae-49911928e1be service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:21.813639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eda32b-49a2-4506-b7ae-49911928e1be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:21.830526 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eda32b-49a2-4506-b7ae-49911928e1be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:21.832880 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eda32b-49a2-4506-b7ae-49911928e1be service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:21.860230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36ccf8-92a6-468f-960a-3349bd31597d None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:21.866959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-1b36ccf8-92a6-468f-960a-3349bd31597d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:21.894067 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 944/1853] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:42:21.983962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eda32b-49a2-4506-b7ae-49911928e1be service cinder] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:22.000677 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-29eda32b-49a2-4506-b7ae-49911928e1be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:22.032755 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eda32b-49a2-4506-b7ae-49911928e1be service cinder] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:22.041133 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36ccf8-92a6-468f-960a-3349bd31597d None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:22.046432 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924dd61-3352-4d58-9e48-3bae7e4b917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:22.048089 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924dd61-3352-4d58-9e48-3bae7e4b917a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:22.049237 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924dd61-3352-4d58-9e48-3bae7e4b917a admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:22.050579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924dd61-3352-4d58-9e48-3bae7e4b917a admin admin] PATH_INFO: `/v3/users/3e1f814def964ed7a993eb45e6be6fe7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:22.055050 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d563bec-abb3-419d-be57-b3348954cabc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:22.056632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d563bec-abb3-419d-be57-b3348954cabc service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:22.061688 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924dd61-3352-4d58-9e48-3bae7e4b917a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1f814def964ed7a993eb45e6be6fe7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:22.061815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d563bec-abb3-419d-be57-b3348954cabc service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:22.061815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d563bec-abb3-419d-be57-b3348954cabc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:22.064945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924dd61-3352-4d58-9e48-3bae7e4b917a admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:22.083565 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d563bec-abb3-419d-be57-b3348954cabc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:22.086066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d563bec-abb3-419d-be57-b3348954cabc service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:22.112241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 910/1854] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:22.114583 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d563bec-abb3-419d-be57-b3348954cabc service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:22.124056 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5d563bec-abb3-419d-be57-b3348954cabc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:22.275868 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d563bec-abb3-419d-be57-b3348954cabc service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:22.284608 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78f826-45b5-493b-b972-d0a8967e9bef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:22.286078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78f826-45b5-493b-b972-d0a8967e9bef service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:22.287080 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78f826-45b5-493b-b972-d0a8967e9bef service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:22.287261 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78f826-45b5-493b-b972-d0a8967e9bef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:22.289875 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5e78f826-45b5-493b-b972-d0a8967e9bef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:22.305399 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-d924dd61-3352-4d58-9e48-3bae7e4b917a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1f814def964ed7a993eb45e6be6fe7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:22.347167 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-d924dd61-3352-4d58-9e48-3bae7e4b917a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1f814def964ed7a993eb45e6be6fe7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:22.350737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78f826-45b5-493b-b972-d0a8967e9bef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:22.353512 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78f826-45b5-493b-b972-d0a8967e9bef service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:22.377337 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 911/1855] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:22.447240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-d924dd61-3352-4d58-9e48-3bae7e4b917a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1f814def964ed7a993eb45e6be6fe7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:22.447843 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-d924dd61-3352-4d58-9e48-3bae7e4b917a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1f814def964ed7a993eb45e6be6fe7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:22.459039 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-d924dd61-3352-4d58-9e48-3bae7e4b917a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1f814def964ed7a993eb45e6be6fe7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:22.475327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 945/1856] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:21 2022] DELETE /identity/v3/users/3e1f814def964ed7a993eb45e6be6fe7 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:22.480496 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf33b8-e59e-40d2-af3d-d9541296d6da None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:22.484429 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf33b8-e59e-40d2-af3d-d9541296d6da None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:22.484429 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf33b8-e59e-40d2-af3d-d9541296d6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:22.515905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-84cf33b8-e59e-40d2-af3d-d9541296d6da None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:22.517145 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-84cf33b8-e59e-40d2-af3d-d9541296d6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:22.668225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 912/1857] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:22.695022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924dd61-3352-4d58-9e48-3bae7e4b917a admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:22.697775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d924dd61-3352-4d58-9e48-3bae7e4b917a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:22.788719 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924dd61-3352-4d58-9e48-3bae7e4b917a admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:22.804372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c36569-fc84-47ae-879f-067151d418bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:22.808398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c36569-fc84-47ae-879f-067151d418bc service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:22.808398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c36569-fc84-47ae-879f-067151d418bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:22.808398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c36569-fc84-47ae-879f-067151d418bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:22.825901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c36569-fc84-47ae-879f-067151d418bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:22.831131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c36569-fc84-47ae-879f-067151d418bc service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:22.839633 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 946/1858] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:23.448948 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf33b8-e59e-40d2-af3d-d9541296d6da None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:23.450285 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-84cf33b8-e59e-40d2-af3d-d9541296d6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:23.465778 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf33b8-e59e-40d2-af3d-d9541296d6da None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:23.478135 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd8997-4155-46cc-b893-22dd0e644e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:23.479319 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd8997-4155-46cc-b893-22dd0e644e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:23.479865 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd8997-4155-46cc-b893-22dd0e644e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:23.480333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd8997-4155-46cc-b893-22dd0e644e72 admin admin] PATH_INFO: `/v3/projects/9fb86e27e3a64add9a400e9e89504d0d` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:23.482883 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd8997-4155-46cc-b893-22dd0e644e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fb86e27e3a64add9a400e9e89504d0d)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:23.485020 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd8997-4155-46cc-b893-22dd0e644e72 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:23.493467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:23.618235 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:23.695622 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-76cd8997-4155-46cc-b893-22dd0e644e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fb86e27e3a64add9a400e9e89504d0d', 'request_id': 'req-76cd8997-4155-46cc-b893-22dd0e644e72'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:23.716039 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-76cd8997-4155-46cc-b893-22dd0e644e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fb86e27e3a64add9a400e9e89504d0d', 'request_id': 'req-76cd8997-4155-46cc-b893-22dd0e644e72'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:23.732316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-76cd8997-4155-46cc-b893-22dd0e644e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fb86e27e3a64add9a400e9e89504d0d', 'request_id': 'req-76cd8997-4155-46cc-b893-22dd0e644e72'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:23.842129 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-76cd8997-4155-46cc-b893-22dd0e644e72 admin admin] The token cache is being invalidate because project 9fb86e27e3a64add9a400e9e89504d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:23.842368 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-76cd8997-4155-46cc-b893-22dd0e644e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:23.843637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-76cd8997-4155-46cc-b893-22dd0e644e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:23.851110 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 913/1859] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:23 2022] DELETE /identity/v3/projects/9fb86e27e3a64add9a400e9e89504d0d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:23.852034 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c36569-fc84-47ae-879f-067151d418bc service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:23.866625 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c36569-fc84-47ae-879f-067151d418bc service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:24.013769 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45796b-c418-4d19-9b08-f37af16a6177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:24.020813 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45796b-c418-4d19-9b08-f37af16a6177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:24.020813 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45796b-c418-4d19-9b08-f37af16a6177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:24.020813 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45796b-c418-4d19-9b08-f37af16a6177 admin admin] PATH_INFO: `/v3/users/97361fdf73d94ff3b7cc7aad1233b139` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:24.020813 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45796b-c418-4d19-9b08-f37af16a6177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97361fdf73d94ff3b7cc7aad1233b139)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:24.020813 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45796b-c418-4d19-9b08-f37af16a6177 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:24.210828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd8997-4155-46cc-b893-22dd0e644e72 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:24.212406 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-76cd8997-4155-46cc-b893-22dd0e644e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:24.236504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd8997-4155-46cc-b893-22dd0e644e72 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:24.258072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cdb75-7994-4bd9-8102-d3eb89aa3a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:24.258978 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cdb75-7994-4bd9-8102-d3eb89aa3a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:24.259464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cdb75-7994-4bd9-8102-d3eb89aa3a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:24.259745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cdb75-7994-4bd9-8102-d3eb89aa3a45 admin admin] PATH_INFO: `/v3/projects/6238d1a246ba4c6897e1a231fe56794b` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:24.266851 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7cdb75-7994-4bd9-8102-d3eb89aa3a45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6238d1a246ba4c6897e1a231fe56794b)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:24.279314 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7cdb75-7994-4bd9-8102-d3eb89aa3a45 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:24.305157 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7a45796b-c418-4d19-9b08-f37af16a6177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97361fdf73d94ff3b7cc7aad1233b139'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:24.331765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7a45796b-c418-4d19-9b08-f37af16a6177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97361fdf73d94ff3b7cc7aad1233b139'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:24.423445 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7a45796b-c418-4d19-9b08-f37af16a6177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97361fdf73d94ff3b7cc7aad1233b139'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:24.424199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7a45796b-c418-4d19-9b08-f37af16a6177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97361fdf73d94ff3b7cc7aad1233b139'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:24.437648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7a45796b-c418-4d19-9b08-f37af16a6177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97361fdf73d94ff3b7cc7aad1233b139'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:24.459229 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-fa7cdb75-7994-4bd9-8102-d3eb89aa3a45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6238d1a246ba4c6897e1a231fe56794b', 'request_id': 'req-fa7cdb75-7994-4bd9-8102-d3eb89aa3a45'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:24.467580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 947/1860] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:23 2022] DELETE /identity/v3/users/97361fdf73d94ff3b7cc7aad1233b139 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:24.467982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-fa7cdb75-7994-4bd9-8102-d3eb89aa3a45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6238d1a246ba4c6897e1a231fe56794b', 'request_id': 'req-fa7cdb75-7994-4bd9-8102-d3eb89aa3a45'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:24.496715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-fa7cdb75-7994-4bd9-8102-d3eb89aa3a45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6238d1a246ba4c6897e1a231fe56794b', 'request_id': 'req-fa7cdb75-7994-4bd9-8102-d3eb89aa3a45'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:24.606165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-fa7cdb75-7994-4bd9-8102-d3eb89aa3a45 admin admin] The token cache is being invalidate because project 6238d1a246ba4c6897e1a231fe56794b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:24.609887 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-fa7cdb75-7994-4bd9-8102-d3eb89aa3a45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:24.609887 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-fa7cdb75-7994-4bd9-8102-d3eb89aa3a45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:24.609887 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 914/1861] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:24 2022] DELETE /identity/v3/projects/6238d1a246ba4c6897e1a231fe56794b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:24.613150 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45796b-c418-4d19-9b08-f37af16a6177 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:24.614959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7a45796b-c418-4d19-9b08-f37af16a6177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:24.647650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cdb75-7994-4bd9-8102-d3eb89aa3a45 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:24.649337 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fa7cdb75-7994-4bd9-8102-d3eb89aa3a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:24.801225 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45796b-c418-4d19-9b08-f37af16a6177 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:24.811561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cdb75-7994-4bd9-8102-d3eb89aa3a45 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:24.818423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e81752-7573-436d-9f9c-b8e49f66ca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:24.819370 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e81752-7573-436d-9f9c-b8e49f66ca14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:24.819659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e81752-7573-436d-9f9c-b8e49f66ca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:24.820107 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e81752-7573-436d-9f9c-b8e49f66ca14 admin admin] PATH_INFO: `/v3/projects/9aaac502c60842c5a00c84dd915f4f19` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:24.822403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e81752-7573-436d-9f9c-b8e49f66ca14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aaac502c60842c5a00c84dd915f4f19)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:24.823506 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c77ca2-bf95-4a3b-ab8d-8443f0f64aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:24.824777 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e81752-7573-436d-9f9c-b8e49f66ca14 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:24.825064 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c77ca2-bf95-4a3b-ab8d-8443f0f64aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:24.825546 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c77ca2-bf95-4a3b-ab8d-8443f0f64aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:24.826022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c77ca2-bf95-4a3b-ab8d-8443f0f64aeb admin admin] PATH_INFO: `/v3/users/1147492f975d4dcdb6cd6afd9cb7d249` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:24.827905 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c77ca2-bf95-4a3b-ab8d-8443f0f64aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1147492f975d4dcdb6cd6afd9cb7d249)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:24.830862 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c77ca2-bf95-4a3b-ab8d-8443f0f64aeb admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:25.020133 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-f4e81752-7573-436d-9f9c-b8e49f66ca14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aaac502c60842c5a00c84dd915f4f19', 'request_id': 'req-f4e81752-7573-436d-9f9c-b8e49f66ca14'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.046525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-f4e81752-7573-436d-9f9c-b8e49f66ca14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aaac502c60842c5a00c84dd915f4f19', 'request_id': 'req-f4e81752-7573-436d-9f9c-b8e49f66ca14'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.059462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-f4e81752-7573-436d-9f9c-b8e49f66ca14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aaac502c60842c5a00c84dd915f4f19', 'request_id': 'req-f4e81752-7573-436d-9f9c-b8e49f66ca14'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.229239 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-f4e81752-7573-436d-9f9c-b8e49f66ca14 admin admin] The token cache is being invalidate because project 9aaac502c60842c5a00c84dd915f4f19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:25.229239 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-f4e81752-7573-436d-9f9c-b8e49f66ca14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.232038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-f4e81752-7573-436d-9f9c-b8e49f66ca14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.244962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 915/1862] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:24 2022] DELETE /identity/v3/projects/9aaac502c60842c5a00c84dd915f4f19 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:25.262952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e81752-7573-436d-9f9c-b8e49f66ca14 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:25.262952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-f4e81752-7573-436d-9f9c-b8e49f66ca14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:25.263112 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-80c77ca2-bf95-4a3b-ab8d-8443f0f64aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1147492f975d4dcdb6cd6afd9cb7d249'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.279109 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-80c77ca2-bf95-4a3b-ab8d-8443f0f64aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1147492f975d4dcdb6cd6afd9cb7d249'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.353286 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e81752-7573-436d-9f9c-b8e49f66ca14 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:25.359417 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d0936-dae5-49f4-bd27-824fdc5238dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:25.360449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d0936-dae5-49f4-bd27-824fdc5238dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:25.360870 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d0936-dae5-49f4-bd27-824fdc5238dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:25.361374 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d0936-dae5-49f4-bd27-824fdc5238dc admin admin] PATH_INFO: `/v3/users/b8cac247fb1c47d29be428510cc91f7b` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:25.363043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d0936-dae5-49f4-bd27-824fdc5238dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8cac247fb1c47d29be428510cc91f7b)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:25.365433 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d0936-dae5-49f4-bd27-824fdc5238dc admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:25.415328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-80c77ca2-bf95-4a3b-ab8d-8443f0f64aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1147492f975d4dcdb6cd6afd9cb7d249'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.416211 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-80c77ca2-bf95-4a3b-ab8d-8443f0f64aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1147492f975d4dcdb6cd6afd9cb7d249'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.448681 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-80c77ca2-bf95-4a3b-ab8d-8443f0f64aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1147492f975d4dcdb6cd6afd9cb7d249'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.456674 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 948/1863] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:24 2022] DELETE /identity/v3/users/1147492f975d4dcdb6cd6afd9cb7d249 => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:25.457694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c77ca2-bf95-4a3b-ab8d-8443f0f64aeb admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:25.461095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-80c77ca2-bf95-4a3b-ab8d-8443f0f64aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:25.546017 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:25.584851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c77ca2-bf95-4a3b-ab8d-8443f0f64aeb admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:25.595120 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e88d2-dc7f-4e5b-aa34-2afa5fac442b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:25.596711 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e88d2-dc7f-4e5b-aa34-2afa5fac442b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:25.597340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e88d2-dc7f-4e5b-aa34-2afa5fac442b admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:25.597644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e88d2-dc7f-4e5b-aa34-2afa5fac442b admin admin] PATH_INFO: `/v3/projects/bde67bc6177741c2bdf1b33c02b9014d` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:25.599377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e88d2-dc7f-4e5b-aa34-2afa5fac442b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bde67bc6177741c2bdf1b33c02b9014d)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:25.602710 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e88d2-dc7f-4e5b-aa34-2afa5fac442b admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:25.689446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-3f5d0936-dae5-49f4-bd27-824fdc5238dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8cac247fb1c47d29be428510cc91f7b'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.722471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-3f5d0936-dae5-49f4-bd27-824fdc5238dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8cac247fb1c47d29be428510cc91f7b'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.731999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-3f5d0936-dae5-49f4-bd27-824fdc5238dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8cac247fb1c47d29be428510cc91f7b'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.764138 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-310e88d2-dc7f-4e5b-aa34-2afa5fac442b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bde67bc6177741c2bdf1b33c02b9014d', 'request_id': 'req-310e88d2-dc7f-4e5b-aa34-2afa5fac442b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.819230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-3f5d0936-dae5-49f4-bd27-824fdc5238dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8cac247fb1c47d29be428510cc91f7b'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.819230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-3f5d0936-dae5-49f4-bd27-824fdc5238dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8cac247fb1c47d29be428510cc91f7b'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.828208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 916/1864] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:25 2022] DELETE /identity/v3/users/b8cac247fb1c47d29be428510cc91f7b => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:25.929417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-310e88d2-dc7f-4e5b-aa34-2afa5fac442b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bde67bc6177741c2bdf1b33c02b9014d', 'request_id': 'req-310e88d2-dc7f-4e5b-aa34-2afa5fac442b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.937786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-310e88d2-dc7f-4e5b-aa34-2afa5fac442b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bde67bc6177741c2bdf1b33c02b9014d', 'request_id': 'req-310e88d2-dc7f-4e5b-aa34-2afa5fac442b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.951213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-310e88d2-dc7f-4e5b-aa34-2afa5fac442b admin admin] The token cache is being invalidate because project bde67bc6177741c2bdf1b33c02b9014d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:25.951993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-310e88d2-dc7f-4e5b-aa34-2afa5fac442b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.953086 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-310e88d2-dc7f-4e5b-aa34-2afa5fac442b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:25.955403 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 949/1865] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:25 2022] DELETE /identity/v3/projects/bde67bc6177741c2bdf1b33c02b9014d => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:25.960101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a715c-cd8b-4717-a656-2f365a9f885d None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:25.960397 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a715c-cd8b-4717-a656-2f365a9f885d None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:25.960687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a715c-cd8b-4717-a656-2f365a9f885d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:25.983004 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-153a715c-cd8b-4717-a656-2f365a9f885d None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:25.984498 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-153a715c-cd8b-4717-a656-2f365a9f885d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:26.081102 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 917/1866] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:26.090108 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732869b-2a19-44d1-b31e-a57c6fd2405e None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:26.090404 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732869b-2a19-44d1-b31e-a57c6fd2405e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:26.090738 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732869b-2a19-44d1-b31e-a57c6fd2405e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:26.112772 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-1732869b-2a19-44d1-b31e-a57c6fd2405e None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:26.114042 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1732869b-2a19-44d1-b31e-a57c6fd2405e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:26.124002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 950/1867] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:26.130333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a715c-cd8b-4717-a656-2f365a9f885d None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:26.140762 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a715c-cd8b-4717-a656-2f365a9f885d None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:26.145535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148c18e-e724-44e8-a23a-9aff10070d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:26.146741 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148c18e-e724-44e8-a23a-9aff10070d02 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:26.146741 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148c18e-e724-44e8-a23a-9aff10070d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:26.146741 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148c18e-e724-44e8-a23a-9aff10070d02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:26.147660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148c18e-e724-44e8-a23a-9aff10070d02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:26.147851 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148c18e-e724-44e8-a23a-9aff10070d02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:26.149531 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148c18e-e724-44e8-a23a-9aff10070d02 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:26.162279 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 918/1868] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:42:26.166748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732869b-2a19-44d1-b31e-a57c6fd2405e None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:26.180077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732869b-2a19-44d1-b31e-a57c6fd2405e None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:26.186230 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1487c-d87d-4bef-b5d5-937a1fb64ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:26.186834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1487c-d87d-4bef-b5d5-937a1fb64ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:26.187124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1487c-d87d-4bef-b5d5-937a1fb64ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:26.187479 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1487c-d87d-4bef-b5d5-937a1fb64ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:26.188241 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1487c-d87d-4bef-b5d5-937a1fb64ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:26.190327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1487c-d87d-4bef-b5d5-937a1fb64ef0 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:26.202111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:26.303894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 951/1869] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:26 2022] POST /identity/v3/projects => generated 369 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:26.308945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148c18e-e724-44e8-a23a-9aff10070d02 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:26.326396 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148c18e-e724-44e8-a23a-9aff10070d02 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:26.364932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1487c-d87d-4bef-b5d5-937a1fb64ef0 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:26.374960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-2ab1487c-d87d-4bef-b5d5-937a1fb64ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:26.410602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f068d65-e45c-4524-b24a-ccc261747d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:26.411264 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f068d65-e45c-4524-b24a-ccc261747d8f admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:26.411586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f068d65-e45c-4524-b24a-ccc261747d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:26.411869 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f068d65-e45c-4524-b24a-ccc261747d8f admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:26.412800 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f068d65-e45c-4524-b24a-ccc261747d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:26.415063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f068d65-e45c-4524-b24a-ccc261747d8f admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:26.490844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1487c-d87d-4bef-b5d5-937a1fb64ef0 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:26.497037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34566d4-e121-45be-b519-de8c5db03533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:26.497932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34566d4-e121-45be-b519-de8c5db03533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:26.498225 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34566d4-e121-45be-b519-de8c5db03533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:26.498510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34566d4-e121-45be-b519-de8c5db03533 admin admin] PATH_INFO: `/v3/projects/069a544503ed45b5813f1afaaef849e1` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:26.499778 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34566d4-e121-45be-b519-de8c5db03533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=069a544503ed45b5813f1afaaef849e1)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:26.501848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34566d4-e121-45be-b519-de8c5db03533 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:26.518177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 919/1870] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:26 2022] POST /identity/v3/users => generated 285 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:26.522644 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f068d65-e45c-4524-b24a-ccc261747d8f admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:26.534147 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f068d65-e45c-4524-b24a-ccc261747d8f admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:26.538937 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd6d35-a9ba-4032-98a0-cb8acb0547d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:26.539650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd6d35-a9ba-4032-98a0-cb8acb0547d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:26.539940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd6d35-a9ba-4032-98a0-cb8acb0547d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:26.540241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd6d35-a9ba-4032-98a0-cb8acb0547d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:26.540962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd6d35-a9ba-4032-98a0-cb8acb0547d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:26.543749 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd6d35-a9ba-4032-98a0-cb8acb0547d6 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:26.554153 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 920/1871] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:42:26.558882 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd6d35-a9ba-4032-98a0-cb8acb0547d6 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:26.568917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd6d35-a9ba-4032-98a0-cb8acb0547d6 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:26.573651 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a04780-c028-44ea-8cab-279466f5d62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:26.574304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a04780-c028-44ea-8cab-279466f5d62b admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:26.574588 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a04780-c028-44ea-8cab-279466f5d62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:26.574866 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a04780-c028-44ea-8cab-279466f5d62b admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:26.575676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a04780-c028-44ea-8cab-279466f5d62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:26.577269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a04780-c028-44ea-8cab-279466f5d62b admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:26.603008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 921/1872] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:42:26.606300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a04780-c028-44ea-8cab-279466f5d62b admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:26.608706 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a34566d4-e121-45be-b519-de8c5db03533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069a544503ed45b5813f1afaaef849e1', 'request_id': 'req-a34566d4-e121-45be-b519-de8c5db03533'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:26.609014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-20a04780-c028-44ea-8cab-279466f5d62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:26.631989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a04780-c028-44ea-8cab-279466f5d62b admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:26.700647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47182d-1422-4473-9262-26ada4b8c0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:26.701504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47182d-1422-4473-9262-26ada4b8c0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:26.701787 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47182d-1422-4473-9262-26ada4b8c0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:26.702069 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47182d-1422-4473-9262-26ada4b8c0b0 admin admin] PATH_INFO: `/v3/projects/0b4b8a0429044a57a247816176c23182` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:26.703250 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47182d-1422-4473-9262-26ada4b8c0b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b4b8a0429044a57a247816176c23182)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:26.705176 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47182d-1422-4473-9262-26ada4b8c0b0 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:26.727901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a34566d4-e121-45be-b519-de8c5db03533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069a544503ed45b5813f1afaaef849e1', 'request_id': 'req-a34566d4-e121-45be-b519-de8c5db03533'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:26.736680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a34566d4-e121-45be-b519-de8c5db03533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069a544503ed45b5813f1afaaef849e1', 'request_id': 'req-a34566d4-e121-45be-b519-de8c5db03533'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:26.752600 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a34566d4-e121-45be-b519-de8c5db03533 admin admin] The token cache is being invalidate because project 069a544503ed45b5813f1afaaef849e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:26.752945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a34566d4-e121-45be-b519-de8c5db03533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:26.753630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a34566d4-e121-45be-b519-de8c5db03533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:26.755209 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 952/1873] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:26 2022] DELETE /identity/v3/projects/069a544503ed45b5813f1afaaef849e1 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:26.756112 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34566d4-e121-45be-b519-de8c5db03533 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:26.759446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a34566d4-e121-45be-b519-de8c5db03533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:26.773762 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34566d4-e121-45be-b519-de8c5db03533 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:26.780468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895b298-e64a-4665-a3e0-83192683c18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:26.781373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895b298-e64a-4665-a3e0-83192683c18f admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:26.781660 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895b298-e64a-4665-a3e0-83192683c18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:26.781940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895b298-e64a-4665-a3e0-83192683c18f admin admin] PATH_INFO: `/v3/projects/28334fc7cc064ad9a1a517ed58d3a800/users/766618154f3c41e1b1c82d6ee412014e/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:26.798746 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895b298-e64a-4665-a3e0-83192683c18f admin admin] RBAC: Authorizing `identity:create_grant(project_id=28334fc7cc064ad9a1a517ed58d3a800, user_id=766618154f3c41e1b1c82d6ee412014e, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:26.801352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895b298-e64a-4665-a3e0-83192683c18f admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:26.915987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 953/1874] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:26 2022] PUT /identity/v3/projects/28334fc7cc064ad9a1a517ed58d3a800/users/766618154f3c41e1b1c82d6ee412014e/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:26.917219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895b298-e64a-4665-a3e0-83192683c18f admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:26.922094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-9895b298-e64a-4665-a3e0-83192683c18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:26.939012 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-bb47182d-1422-4473-9262-26ada4b8c0b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b4b8a0429044a57a247816176c23182', 'request_id': 'req-bb47182d-1422-4473-9262-26ada4b8c0b0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:26.945640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-bb47182d-1422-4473-9262-26ada4b8c0b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b4b8a0429044a57a247816176c23182', 'request_id': 'req-bb47182d-1422-4473-9262-26ada4b8c0b0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:26.955253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-bb47182d-1422-4473-9262-26ada4b8c0b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b4b8a0429044a57a247816176c23182', 'request_id': 'req-bb47182d-1422-4473-9262-26ada4b8c0b0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:27.005671 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895b298-e64a-4665-a3e0-83192683c18f admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:27.083059 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b7595-84bc-4d3e-a31d-76d1c43048ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:27.083912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b7595-84bc-4d3e-a31d-76d1c43048ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:27.084494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b7595-84bc-4d3e-a31d-76d1c43048ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:27.085110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b7595-84bc-4d3e-a31d-76d1c43048ec admin admin] PATH_INFO: `/v3/users/36f2e435ca954640b31c8dfc259a2382` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:27.086701 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b7595-84bc-4d3e-a31d-76d1c43048ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=36f2e435ca954640b31c8dfc259a2382)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:27.090706 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b7595-84bc-4d3e-a31d-76d1c43048ec admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:27.144379 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-bb47182d-1422-4473-9262-26ada4b8c0b0 admin admin] The token cache is being invalidate because project 0b4b8a0429044a57a247816176c23182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:27.144949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-bb47182d-1422-4473-9262-26ada4b8c0b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:27.145728 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-bb47182d-1422-4473-9262-26ada4b8c0b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:27.147859 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 922/1875] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:26 2022] DELETE /identity/v3/projects/0b4b8a0429044a57a247816176c23182 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:27.160710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c14de2-695d-4463-a05e-c0e8c1bdf82f None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:27.161035 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c14de2-695d-4463-a05e-c0e8c1bdf82f None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:27.161838 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c14de2-695d-4463-a05e-c0e8c1bdf82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:27.200058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-14c14de2-695d-4463-a05e-c0e8c1bdf82f None None] MFA Rules not processed for user `766618154f3c41e1b1c82d6ee412014e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:27.201011 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-14c14de2-695d-4463-a05e-c0e8c1bdf82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:27.281897 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 923/1876] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:27.283665 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9d83d-a8fd-4536-b07f-d31f3911124b None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:27.284044 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9d83d-a8fd-4536-b07f-d31f3911124b None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:27.284438 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9d83d-a8fd-4536-b07f-d31f3911124b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:27.305012 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1f0b7595-84bc-4d3e-a31d-76d1c43048ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36f2e435ca954640b31c8dfc259a2382'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:27.309857 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-03d9d83d-a8fd-4536-b07f-d31f3911124b None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:27.311859 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-03d9d83d-a8fd-4536-b07f-d31f3911124b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:27.320884 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1f0b7595-84bc-4d3e-a31d-76d1c43048ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36f2e435ca954640b31c8dfc259a2382'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:27.325128 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 924/1877] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:27.326583 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9d83d-a8fd-4536-b07f-d31f3911124b None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:27.329178 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-03d9d83d-a8fd-4536-b07f-d31f3911124b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:27.343313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9d83d-a8fd-4536-b07f-d31f3911124b None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:27.348270 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f54728-a4ca-443f-a66c-16cee2325263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:27.349019 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f54728-a4ca-443f-a66c-16cee2325263 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:27.349373 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f54728-a4ca-443f-a66c-16cee2325263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:27.349768 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f54728-a4ca-443f-a66c-16cee2325263 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:27.350532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f54728-a4ca-443f-a66c-16cee2325263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:27.352631 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f54728-a4ca-443f-a66c-16cee2325263 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:27.376743 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1f0b7595-84bc-4d3e-a31d-76d1c43048ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36f2e435ca954640b31c8dfc259a2382'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:27.377509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1f0b7595-84bc-4d3e-a31d-76d1c43048ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36f2e435ca954640b31c8dfc259a2382'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:27.386940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1f0b7595-84bc-4d3e-a31d-76d1c43048ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36f2e435ca954640b31c8dfc259a2382'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:27.394024 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 954/1878] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:26 2022] DELETE /identity/v3/users/36f2e435ca954640b31c8dfc259a2382 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:27.395608 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff77cc-2e79-4e57-ac6b-3039fca1f4b5 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:27.396039 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff77cc-2e79-4e57-ac6b-3039fca1f4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:27.396597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff77cc-2e79-4e57-ac6b-3039fca1f4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:27.415806 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-b4ff77cc-2e79-4e57-ac6b-3039fca1f4b5 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:27.417113 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b4ff77cc-2e79-4e57-ac6b-3039fca1f4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:27.473136 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 925/1879] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:27 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:27.474242 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f54728-a4ca-443f-a66c-16cee2325263 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:27.476015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-58f54728-a4ca-443f-a66c-16cee2325263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:27.489161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 955/1880] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:27.493338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff77cc-2e79-4e57-ac6b-3039fca1f4b5 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:27.503370 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff77cc-2e79-4e57-ac6b-3039fca1f4b5 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:27.551692 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f54728-a4ca-443f-a66c-16cee2325263 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:27.561693 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1a483-a717-40a1-bb53-8cbeae71b085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:27.562412 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1a483-a717-40a1-bb53-8cbeae71b085 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:27.562704 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1a483-a717-40a1-bb53-8cbeae71b085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:27.563042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1a483-a717-40a1-bb53-8cbeae71b085 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:27.563789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1a483-a717-40a1-bb53-8cbeae71b085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:27.566025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1a483-a717-40a1-bb53-8cbeae71b085 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:27.589643 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc65b8-811f-4419-8296-6b6c87b7ea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:27.590698 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc65b8-811f-4419-8296-6b6c87b7ea1c admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:27.590896 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc65b8-811f-4419-8296-6b6c87b7ea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:27.591175 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc65b8-811f-4419-8296-6b6c87b7ea1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:27.591943 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc65b8-811f-4419-8296-6b6c87b7ea1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:27.592251 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc65b8-811f-4419-8296-6b6c87b7ea1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:27.594115 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc65b8-811f-4419-8296-6b6c87b7ea1c admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:27.595655 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:27.607196 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 956/1881] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:42:27.611660 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc65b8-811f-4419-8296-6b6c87b7ea1c admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:27.624656 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc65b8-811f-4419-8296-6b6c87b7ea1c admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:27.632898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d61d6-5d78-435e-b28d-76c62f0aaa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:27.633582 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d61d6-5d78-435e-b28d-76c62f0aaa23 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:27.634715 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d61d6-5d78-435e-b28d-76c62f0aaa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:27.634715 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d61d6-5d78-435e-b28d-76c62f0aaa23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:27.635379 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d61d6-5d78-435e-b28d-76c62f0aaa23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:27.638013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d61d6-5d78-435e-b28d-76c62f0aaa23 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:27.691481 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 926/1882] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:27 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:42:27.692992 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1a483-a717-40a1-bb53-8cbeae71b085 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:27.705132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1a483-a717-40a1-bb53-8cbeae71b085 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:27.710112 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae105e75-367e-4bf3-96ac-be8ae724c109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:27.710978 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae105e75-367e-4bf3-96ac-be8ae724c109 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:27.711446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae105e75-367e-4bf3-96ac-be8ae724c109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:27.711734 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae105e75-367e-4bf3-96ac-be8ae724c109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:27.712465 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae105e75-367e-4bf3-96ac-be8ae724c109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:27.714616 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae105e75-367e-4bf3-96ac-be8ae724c109 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:27.727908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 927/1883] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:27.736600 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae105e75-367e-4bf3-96ac-be8ae724c109 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:27.747828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae105e75-367e-4bf3-96ac-be8ae724c109 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:27.752828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2d243-8ada-48f7-9931-367f9bf492a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:27.753788 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2d243-8ada-48f7-9931-367f9bf492a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:27.754070 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2d243-8ada-48f7-9931-367f9bf492a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:27.754331 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2d243-8ada-48f7-9931-367f9bf492a6 admin admin] PATH_INFO: `/v3/projects/d49ccdc7beba4513905d5d9a8ce67372/users/6e1c8892a0b24d2690ba3fdd96e8d2d0/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:27.770829 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2d243-8ada-48f7-9931-367f9bf492a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d49ccdc7beba4513905d5d9a8ce67372, user_id=6e1c8892a0b24d2690ba3fdd96e8d2d0, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:27.773586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2d243-8ada-48f7-9931-367f9bf492a6 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:27.801401 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 957/1884] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:27 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:42:27.805613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d61d6-5d78-435e-b28d-76c62f0aaa23 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:27.868638 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d61d6-5d78-435e-b28d-76c62f0aaa23 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:27.874008 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb981dc-c423-4427-9c31-0127d69027b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:27.874682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb981dc-c423-4427-9c31-0127d69027b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:27.874967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb981dc-c423-4427-9c31-0127d69027b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:27.875245 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb981dc-c423-4427-9c31-0127d69027b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:27.875968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb981dc-c423-4427-9c31-0127d69027b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:27.877886 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb981dc-c423-4427-9c31-0127d69027b3 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:27.900634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 928/1885] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:27 2022] PUT /identity/v3/projects/d49ccdc7beba4513905d5d9a8ce67372/users/6e1c8892a0b24d2690ba3fdd96e8d2d0/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:27.901615 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2d243-8ada-48f7-9931-367f9bf492a6 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:27.903466 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-54c2d243-8ada-48f7-9931-367f9bf492a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:27.974863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 958/1886] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:27 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:42:27.977416 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb981dc-c423-4427-9c31-0127d69027b3 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:27.982695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2d243-8ada-48f7-9931-367f9bf492a6 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:27.986371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb981dc-c423-4427-9c31-0127d69027b3 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:27.987664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c154e-5535-4232-9b8b-8a20a7c909cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:27.988704 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c154e-5535-4232-9b8b-8a20a7c909cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:27.988995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c154e-5535-4232-9b8b-8a20a7c909cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:27.989272 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c154e-5535-4232-9b8b-8a20a7c909cd admin admin] PATH_INFO: `/v3/projects/32a8b574afd34c90bcfd81225b0b0d56` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:27.990665 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c154e-5535-4232-9b8b-8a20a7c909cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a8b574afd34c90bcfd81225b0b0d56)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:27.991205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08acd2-f1c4-41e8-8c1e-73faf69d5314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:27.991903 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08acd2-f1c4-41e8-8c1e-73faf69d5314 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:27.992191 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08acd2-f1c4-41e8-8c1e-73faf69d5314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:27.992470 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08acd2-f1c4-41e8-8c1e-73faf69d5314 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:27.992642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c154e-5535-4232-9b8b-8a20a7c909cd admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:27.993205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08acd2-f1c4-41e8-8c1e-73faf69d5314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:27.994803 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08acd2-f1c4-41e8-8c1e-73faf69d5314 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:28.005813 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 959/1887] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:28.006985 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08acd2-f1c4-41e8-8c1e-73faf69d5314 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:28.017411 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08acd2-f1c4-41e8-8c1e-73faf69d5314 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:28.022259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4109c26-9a89-492f-89e5-2b5bcc10ee4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:28.022932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4109c26-9a89-492f-89e5-2b5bcc10ee4f admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:28.023214 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4109c26-9a89-492f-89e5-2b5bcc10ee4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:28.023524 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4109c26-9a89-492f-89e5-2b5bcc10ee4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:28.024246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4109c26-9a89-492f-89e5-2b5bcc10ee4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:28.025836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4109c26-9a89-492f-89e5-2b5bcc10ee4f admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:28.036482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 960/1888] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:28.037425 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4109c26-9a89-492f-89e5-2b5bcc10ee4f admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:28.047596 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4109c26-9a89-492f-89e5-2b5bcc10ee4f admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:28.052908 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b831d5-04cf-41bc-bba5-155cb3511d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:28.058129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b831d5-04cf-41bc-bba5-155cb3511d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:28.058129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b831d5-04cf-41bc-bba5-155cb3511d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:28.058129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b831d5-04cf-41bc-bba5-155cb3511d7c admin admin] PATH_INFO: `/v3/projects/d49ccdc7beba4513905d5d9a8ce67372/users/6e1c8892a0b24d2690ba3fdd96e8d2d0/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:28.058129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b831d5-04cf-41bc-bba5-155cb3511d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d49ccdc7beba4513905d5d9a8ce67372, user_id=6e1c8892a0b24d2690ba3fdd96e8d2d0, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:28.060000 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b831d5-04cf-41bc-bba5-155cb3511d7c admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:28.071699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 961/1889] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:28 2022] PUT /identity/v3/projects/d49ccdc7beba4513905d5d9a8ce67372/users/6e1c8892a0b24d2690ba3fdd96e8d2d0/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:28.072065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b831d5-04cf-41bc-bba5-155cb3511d7c admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:28.130084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-167c154e-5535-4232-9b8b-8a20a7c909cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a8b574afd34c90bcfd81225b0b0d56', 'request_id': 'req-167c154e-5535-4232-9b8b-8a20a7c909cd'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:28.145952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-167c154e-5535-4232-9b8b-8a20a7c909cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a8b574afd34c90bcfd81225b0b0d56', 'request_id': 'req-167c154e-5535-4232-9b8b-8a20a7c909cd'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:28.149186 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b831d5-04cf-41bc-bba5-155cb3511d7c admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:28.153114 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-167c154e-5535-4232-9b8b-8a20a7c909cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a8b574afd34c90bcfd81225b0b0d56', 'request_id': 'req-167c154e-5535-4232-9b8b-8a20a7c909cd'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:28.227429 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51c6ea-66b8-4d0c-88ff-0241d95e4990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:28.228675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51c6ea-66b8-4d0c-88ff-0241d95e4990 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:28.229065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51c6ea-66b8-4d0c-88ff-0241d95e4990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:28.230216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51c6ea-66b8-4d0c-88ff-0241d95e4990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:28.231001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51c6ea-66b8-4d0c-88ff-0241d95e4990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:28.232807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51c6ea-66b8-4d0c-88ff-0241d95e4990 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:28.249147 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-167c154e-5535-4232-9b8b-8a20a7c909cd admin admin] The token cache is being invalidate because project 32a8b574afd34c90bcfd81225b0b0d56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:28.249440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-167c154e-5535-4232-9b8b-8a20a7c909cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:28.253635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 962/1890] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:28.255192 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ddfcd-629e-4dd0-bd85-5907c2fb5f31 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:28.255779 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ddfcd-629e-4dd0-bd85-5907c2fb5f31 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:28.259866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ddfcd-629e-4dd0-bd85-5907c2fb5f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:28.261917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-167c154e-5535-4232-9b8b-8a20a7c909cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:28.267806 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 929/1891] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:27 2022] DELETE /identity/v3/projects/32a8b574afd34c90bcfd81225b0b0d56 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:28.268962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c154e-5535-4232-9b8b-8a20a7c909cd admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:28.275707 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-167c154e-5535-4232-9b8b-8a20a7c909cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:28.290141 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c154e-5535-4232-9b8b-8a20a7c909cd admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:28.298079 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa3ccb-0f25-4da2-8cf5-e8848b7d864c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:28.299000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa3ccb-0f25-4da2-8cf5-e8848b7d864c admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:28.299324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa3ccb-0f25-4da2-8cf5-e8848b7d864c admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:28.299729 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa3ccb-0f25-4da2-8cf5-e8848b7d864c admin admin] PATH_INFO: `/v3/projects/b209a288d95240cfb21f166baaf58f1c/users/009ccc6b0aee4776841c8691f71d3ec0/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:28.309195 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-ca0ddfcd-629e-4dd0-bd85-5907c2fb5f31 None None] MFA Rules not processed for user `6e1c8892a0b24d2690ba3fdd96e8d2d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:28.310660 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ca0ddfcd-629e-4dd0-bd85-5907c2fb5f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:28.323822 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa3ccb-0f25-4da2-8cf5-e8848b7d864c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b209a288d95240cfb21f166baaf58f1c, user_id=009ccc6b0aee4776841c8691f71d3ec0, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:28.326628 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa3ccb-0f25-4da2-8cf5-e8848b7d864c admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:28.334827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:28.614168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 963/1892] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:28 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:28.614168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40473ac7-1909-42e6-b795-f8f5f7fce86b None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:28.614168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40473ac7-1909-42e6-b795-f8f5f7fce86b None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:28.614168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40473ac7-1909-42e6-b795-f8f5f7fce86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:28.614168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-40473ac7-1909-42e6-b795-f8f5f7fce86b None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:28.614168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-40473ac7-1909-42e6-b795-f8f5f7fce86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:28.616354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 964/1893] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:28.616354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40473ac7-1909-42e6-b795-f8f5f7fce86b None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:28.616354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-40473ac7-1909-42e6-b795-f8f5f7fce86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:28.616354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40473ac7-1909-42e6-b795-f8f5f7fce86b None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:28.617184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff09d6d-4fc5-4ec0-abea-061679904103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:28.617184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff09d6d-4fc5-4ec0-abea-061679904103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:28.617184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff09d6d-4fc5-4ec0-abea-061679904103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:28.617184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff09d6d-4fc5-4ec0-abea-061679904103 admin admin] PATH_INFO: `/v3/users/54ba9d6dca25459ea0f82d53c3375e02` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:28.617893 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff09d6d-4fc5-4ec0-abea-061679904103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ba9d6dca25459ea0f82d53c3375e02)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:28.617893 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff09d6d-4fc5-4ec0-abea-061679904103 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:28.666203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 930/1894] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:28 2022] PUT /identity/v3/projects/b209a288d95240cfb21f166baaf58f1c/users/009ccc6b0aee4776841c8691f71d3ec0/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:28.668757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa3ccb-0f25-4da2-8cf5-e8848b7d864c admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:28.669848 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-61aa3ccb-0f25-4da2-8cf5-e8848b7d864c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:28.697448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:28.732151 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa3ccb-0f25-4da2-8cf5-e8848b7d864c admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:28.736074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e7f8f-8379-4321-a0eb-317876583cd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:28.736738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e7f8f-8379-4321-a0eb-317876583cd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:28.737027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e7f8f-8379-4321-a0eb-317876583cd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:28.737315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e7f8f-8379-4321-a0eb-317876583cd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:28.822075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e7f8f-8379-4321-a0eb-317876583cd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:28.822075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e7f8f-8379-4321-a0eb-317876583cd9 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:28.831918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 931/1895] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:28 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:28.833304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2299b-06ac-41c6-a924-7d961e515330 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:28.833589 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2299b-06ac-41c6-a924-7d961e515330 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:28.833870 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2299b-06ac-41c6-a924-7d961e515330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:28.858785 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-eff09d6d-4fc5-4ec0-abea-061679904103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ba9d6dca25459ea0f82d53c3375e02'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:28.868062 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-28d2299b-06ac-41c6-a924-7d961e515330 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:28.869347 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-28d2299b-06ac-41c6-a924-7d961e515330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:28.879335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-eff09d6d-4fc5-4ec0-abea-061679904103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ba9d6dca25459ea0f82d53c3375e02'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:28.951760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 932/1896] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:28.951760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3de1b3-729e-4e49-8e21-1bbc58a1af24 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:28.951760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3de1b3-729e-4e49-8e21-1bbc58a1af24 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:28.951760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3de1b3-729e-4e49-8e21-1bbc58a1af24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:28.960827 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-eff09d6d-4fc5-4ec0-abea-061679904103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ba9d6dca25459ea0f82d53c3375e02'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:28.961932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-eff09d6d-4fc5-4ec0-abea-061679904103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ba9d6dca25459ea0f82d53c3375e02'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:28.974162 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-eff09d6d-4fc5-4ec0-abea-061679904103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ba9d6dca25459ea0f82d53c3375e02'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:28.983984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 965/1897] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:28 2022] DELETE /identity/v3/users/54ba9d6dca25459ea0f82d53c3375e02 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:28.985239 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff09d6d-4fc5-4ec0-abea-061679904103 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:28.986819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-eff09d6d-4fc5-4ec0-abea-061679904103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:28.993769 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-0e3de1b3-729e-4e49-8e21-1bbc58a1af24 None None] MFA Rules not processed for user `009ccc6b0aee4776841c8691f71d3ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:28.994999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0e3de1b3-729e-4e49-8e21-1bbc58a1af24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:29.064246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff09d6d-4fc5-4ec0-abea-061679904103 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:29.069573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0074c05-dc65-47bd-9964-faca65e4377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:29.072680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0074c05-dc65-47bd-9964-faca65e4377c admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:29.072680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0074c05-dc65-47bd-9964-faca65e4377c admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:29.072680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0074c05-dc65-47bd-9964-faca65e4377c admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:29.072680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0074c05-dc65-47bd-9964-faca65e4377c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:29.074097 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0074c05-dc65-47bd-9964-faca65e4377c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:29.075624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0074c05-dc65-47bd-9964-faca65e4377c admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:29.081751 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 933/1898] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:29.082312 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3de1b3-729e-4e49-8e21-1bbc58a1af24 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:29.083719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0e3de1b3-729e-4e49-8e21-1bbc58a1af24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:29.097200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 966/1899] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:42:29.097200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af489b8-88ab-47fd-bc63-d42462237967 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:29.097200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af489b8-88ab-47fd-bc63-d42462237967 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:29.097200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af489b8-88ab-47fd-bc63-d42462237967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:29.116151 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-9af489b8-88ab-47fd-bc63-d42462237967 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:29.117641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-9af489b8-88ab-47fd-bc63-d42462237967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:29.129852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 967/1900] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:29.129852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af489b8-88ab-47fd-bc63-d42462237967 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:29.134408 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-9af489b8-88ab-47fd-bc63-d42462237967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:29.148846 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af489b8-88ab-47fd-bc63-d42462237967 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:29.154199 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3de1b3-729e-4e49-8e21-1bbc58a1af24 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:29.158558 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183580b-b65a-4d8e-867c-708b2ea877d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:29.158558 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183580b-b65a-4d8e-867c-708b2ea877d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:29.158558 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183580b-b65a-4d8e-867c-708b2ea877d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:29.158558 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183580b-b65a-4d8e-867c-708b2ea877d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:29.159115 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183580b-b65a-4d8e-867c-708b2ea877d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:29.159234 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e4f54-11a2-459f-a802-196ae4f52e9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:29.159234 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e4f54-11a2-459f-a802-196ae4f52e9c service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:29.159456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183580b-b65a-4d8e-867c-708b2ea877d5 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:29.159546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e4f54-11a2-459f-a802-196ae4f52e9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:29.159546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e4f54-11a2-459f-a802-196ae4f52e9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:29.161302 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b67e4f54-11a2-459f-a802-196ae4f52e9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:29.224514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e4f54-11a2-459f-a802-196ae4f52e9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:29.225439 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e4f54-11a2-459f-a802-196ae4f52e9c service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:29.234475 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 934/1901] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:29.239417 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e4f54-11a2-459f-a802-196ae4f52e9c service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:29.246325 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e4f54-11a2-459f-a802-196ae4f52e9c service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:29.251747 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309f68f-9a84-4b99-a880-37b216f949c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:29.252430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309f68f-9a84-4b99-a880-37b216f949c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:29.252727 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309f68f-9a84-4b99-a880-37b216f949c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:29.252988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309f68f-9a84-4b99-a880-37b216f949c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:29.253687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309f68f-9a84-4b99-a880-37b216f949c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:29.255723 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309f68f-9a84-4b99-a880-37b216f949c1 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:29.269623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 968/1902] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:29 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:29.269623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183580b-b65a-4d8e-867c-708b2ea877d5 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:29.275594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-8183580b-b65a-4d8e-867c-708b2ea877d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:29.341696 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183580b-b65a-4d8e-867c-708b2ea877d5 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:29.345908 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dc6d1-4533-47f0-a660-c6f628f20e52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:29.346576 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dc6d1-4533-47f0-a660-c6f628f20e52 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:29.346863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dc6d1-4533-47f0-a660-c6f628f20e52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:29.347236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dc6d1-4533-47f0-a660-c6f628f20e52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:29.376554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 935/1903] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:29 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:29.377653 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309f68f-9a84-4b99-a880-37b216f949c1 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:29.440740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:29.462573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236dc6d1-4533-47f0-a660-c6f628f20e52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:29.465391 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236dc6d1-4533-47f0-a660-c6f628f20e52 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:29.477291 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 969/1904] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:29.478427 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dc6d1-4533-47f0-a660-c6f628f20e52 service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:29.491386 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dc6d1-4533-47f0-a660-c6f628f20e52 service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:29.497823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b5dda-8b99-4a8c-b6f9-326436db31fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:29.503876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b5dda-8b99-4a8c-b6f9-326436db31fc admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:29.503876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b5dda-8b99-4a8c-b6f9-326436db31fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:29.503876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b5dda-8b99-4a8c-b6f9-326436db31fc admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:29.503876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b5dda-8b99-4a8c-b6f9-326436db31fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:29.503876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b5dda-8b99-4a8c-b6f9-326436db31fc admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:29.504843 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309f68f-9a84-4b99-a880-37b216f949c1 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:29.513236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca8f3d-97fa-4c54-a3f9-88377480a722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:29.514086 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca8f3d-97fa-4c54-a3f9-88377480a722 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:29.514503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca8f3d-97fa-4c54-a3f9-88377480a722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:29.515016 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca8f3d-97fa-4c54-a3f9-88377480a722 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:29.516251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca8f3d-97fa-4c54-a3f9-88377480a722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:29.519142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca8f3d-97fa-4c54-a3f9-88377480a722 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:29.546463 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:29.610061 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 970/1905] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:29 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:29.614238 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b5dda-8b99-4a8c-b6f9-326436db31fc admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:29.628095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b5dda-8b99-4a8c-b6f9-326436db31fc admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:29.641565 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5e8d0-b0c0-4d17-b70e-3a5b1d58d700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:29.641565 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5e8d0-b0c0-4d17-b70e-3a5b1d58d700 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:29.641565 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5e8d0-b0c0-4d17-b70e-3a5b1d58d700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:29.641565 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5e8d0-b0c0-4d17-b70e-3a5b1d58d700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:29.641963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5e8d0-b0c0-4d17-b70e-3a5b1d58d700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:29.641963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5e8d0-b0c0-4d17-b70e-3a5b1d58d700 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:29.655036 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 936/1906] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:29 2022] POST /identity/v3/users => generated 297 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:29.656601 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca8f3d-97fa-4c54-a3f9-88377480a722 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:29.660446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 971/1907] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:42:29.661909 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5e8d0-b0c0-4d17-b70e-3a5b1d58d700 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:29.675232 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca8f3d-97fa-4c54-a3f9-88377480a722 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:29.675811 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5e8d0-b0c0-4d17-b70e-3a5b1d58d700 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:29.679501 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d969a-e3eb-4a5a-90ce-6388e3cd67e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:29.680187 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d969a-e3eb-4a5a-90ce-6388e3cd67e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:29.680474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d969a-e3eb-4a5a-90ce-6388e3cd67e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:29.680758 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d969a-e3eb-4a5a-90ce-6388e3cd67e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:29.681533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d969a-e3eb-4a5a-90ce-6388e3cd67e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:29.683438 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d969a-e3eb-4a5a-90ce-6388e3cd67e8 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:29.684698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1feabf-a4ed-4a2d-9e67-364fec2add4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:29.685394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1feabf-a4ed-4a2d-9e67-364fec2add4a admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:29.685684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1feabf-a4ed-4a2d-9e67-364fec2add4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:29.686031 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1feabf-a4ed-4a2d-9e67-364fec2add4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:29.687154 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1feabf-a4ed-4a2d-9e67-364fec2add4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:29.688837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1feabf-a4ed-4a2d-9e67-364fec2add4a admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:29.697441 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 972/1908] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:29.702258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d969a-e3eb-4a5a-90ce-6388e3cd67e8 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:29.704189 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 937/1909] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:42:29.708788 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1feabf-a4ed-4a2d-9e67-364fec2add4a admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:29.717077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d969a-e3eb-4a5a-90ce-6388e3cd67e8 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:29.721377 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1feabf-a4ed-4a2d-9e67-364fec2add4a admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:29.724205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c37d9-cf57-41ef-b581-e357f1d15c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:29.724205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c37d9-cf57-41ef-b581-e357f1d15c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:29.725508 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c37d9-cf57-41ef-b581-e357f1d15c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:29.725508 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c37d9-cf57-41ef-b581-e357f1d15c32 admin admin] PATH_INFO: `/v3/projects/f4e30a3ec3c5429a9ac1aed7ac200a36/users/3211a37eb04243459f73932fe7d7a4a4/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:29.738969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd9d92-ca5b-4b44-b1fd-858866cef6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:29.740596 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd9d92-ca5b-4b44-b1fd-858866cef6fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:29.740823 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd9d92-ca5b-4b44-b1fd-858866cef6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:29.740904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd9d92-ca5b-4b44-b1fd-858866cef6fb admin admin] PATH_INFO: `/v3/projects/6779bac41c2842f7a8765020232dc27f/users/9c0ffa00f9174066ad278f91316868ac/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:29.750216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c37d9-cf57-41ef-b581-e357f1d15c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e30a3ec3c5429a9ac1aed7ac200a36, user_id=3211a37eb04243459f73932fe7d7a4a4, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:29.755425 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c37d9-cf57-41ef-b581-e357f1d15c32 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:29.761877 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd9d92-ca5b-4b44-b1fd-858866cef6fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6779bac41c2842f7a8765020232dc27f, user_id=9c0ffa00f9174066ad278f91316868ac, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:29.764974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd9d92-ca5b-4b44-b1fd-858866cef6fb admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:29.866571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 938/1911] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:29 2022] PUT /identity/v3/projects/6779bac41c2842f7a8765020232dc27f/users/9c0ffa00f9174066ad278f91316868ac/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:42:29.872727 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd9d92-ca5b-4b44-b1fd-858866cef6fb admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:29.872862 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 973/1911] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:29 2022] PUT /identity/v3/projects/f4e30a3ec3c5429a9ac1aed7ac200a36/users/3211a37eb04243459f73932fe7d7a4a4/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:29.878698 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839e394-acfa-441f-92f5-49fdcc6e374a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:29.878992 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839e394-acfa-441f-92f5-49fdcc6e374a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:29.879312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839e394-acfa-441f-92f5-49fdcc6e374a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:29.918364 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-4839e394-acfa-441f-92f5-49fdcc6e374a None None] MFA Rules not processed for user `3211a37eb04243459f73932fe7d7a4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:29.919714 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-4839e394-acfa-441f-92f5-49fdcc6e374a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:29.952006 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd9d92-ca5b-4b44-b1fd-858866cef6fb admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:30.009070 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 974/1912] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:30.014817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839e394-acfa-441f-92f5-49fdcc6e374a None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:30.037605 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a9118-bf83-46e1-91b2-a3c103f8179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:30.038300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a9118-bf83-46e1-91b2-a3c103f8179c admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:30.038589 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a9118-bf83-46e1-91b2-a3c103f8179c admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:30.038882 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a9118-bf83-46e1-91b2-a3c103f8179c admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:30.039648 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a9118-bf83-46e1-91b2-a3c103f8179c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:30.041456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a9118-bf83-46e1-91b2-a3c103f8179c admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:30.060885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 939/1913] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:30.062680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a9118-bf83-46e1-91b2-a3c103f8179c admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:30.087798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a9118-bf83-46e1-91b2-a3c103f8179c admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:30.101708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b285b-6824-4372-a248-50a4121a4221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:30.103369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b285b-6824-4372-a248-50a4121a4221 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:30.104054 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b285b-6824-4372-a248-50a4121a4221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:30.104818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b285b-6824-4372-a248-50a4121a4221 admin admin] PATH_INFO: `/v3/projects/6779bac41c2842f7a8765020232dc27f/users/9c0ffa00f9174066ad278f91316868ac/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:30.110212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b285b-6824-4372-a248-50a4121a4221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6779bac41c2842f7a8765020232dc27f, user_id=9c0ffa00f9174066ad278f91316868ac, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:30.114672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b285b-6824-4372-a248-50a4121a4221 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:30.123973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839e394-acfa-441f-92f5-49fdcc6e374a None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:30.129611 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7491b-3827-4008-9285-c72bde89436d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:30.142128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7491b-3827-4008-9285-c72bde89436d admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:30.144087 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7491b-3827-4008-9285-c72bde89436d admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:30.145122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7491b-3827-4008-9285-c72bde89436d admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:30.145917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7491b-3827-4008-9285-c72bde89436d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:30.150502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7491b-3827-4008-9285-c72bde89436d admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:30.169560 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 940/1914] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:30 2022] PUT /identity/v3/projects/6779bac41c2842f7a8765020232dc27f/users/9c0ffa00f9174066ad278f91316868ac/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:30.171148 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b285b-6824-4372-a248-50a4121a4221 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:30.179761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-cb9b285b-6824-4372-a248-50a4121a4221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:30.254899 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 975/1915] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:30 2022] POST /identity/v3/projects => generated 383 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:42:30.256750 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be49377-d5e4-4119-a6d3-ae4883f5c7bb None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:30.257110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be49377-d5e4-4119-a6d3-ae4883f5c7bb None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:30.257455 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be49377-d5e4-4119-a6d3-ae4883f5c7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:30.272933 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b285b-6824-4372-a248-50a4121a4221 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:30.286025 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-6be49377-d5e4-4119-a6d3-ae4883f5c7bb None None] MFA Rules not processed for user `9c0ffa00f9174066ad278f91316868ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:30.287230 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-6be49377-d5e4-4119-a6d3-ae4883f5c7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:30.339119 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca20f14-ad07-4075-ac84-4bd077a21bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:30.340164 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca20f14-ad07-4075-ac84-4bd077a21bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:30.340446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca20f14-ad07-4075-ac84-4bd077a21bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:30.340824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca20f14-ad07-4075-ac84-4bd077a21bda admin admin] PATH_INFO: `/v3/projects/0b2ee2b8c9d34795bb2a6e4889439aea` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:30.342039 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca20f14-ad07-4075-ac84-4bd077a21bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2ee2b8c9d34795bb2a6e4889439aea)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:30.343991 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca20f14-ad07-4075-ac84-4bd077a21bda admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:30.365600 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 976/1916] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:30.366578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be49377-d5e4-4119-a6d3-ae4883f5c7bb None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:30.378376 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be49377-d5e4-4119-a6d3-ae4883f5c7bb None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:30.383208 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e75426-cae0-4631-98a9-2f9f0ef97ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:30.383910 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e75426-cae0-4631-98a9-2f9f0ef97ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:30.384218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e75426-cae0-4631-98a9-2f9f0ef97ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:30.384496 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e75426-cae0-4631-98a9-2f9f0ef97ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:30.385195 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e75426-cae0-4631-98a9-2f9f0ef97ca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:30.387868 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e75426-cae0-4631-98a9-2f9f0ef97ca7 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:30.496922 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 977/1917] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:30 2022] POST /identity/v3/users => generated 298 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:30.497117 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6ca20f14-ad07-4075-ac84-4bd077a21bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2ee2b8c9d34795bb2a6e4889439aea', 'request_id': 'req-6ca20f14-ad07-4075-ac84-4bd077a21bda'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:30.497243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e75426-cae0-4631-98a9-2f9f0ef97ca7 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:30.500668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6ca20f14-ad07-4075-ac84-4bd077a21bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2ee2b8c9d34795bb2a6e4889439aea', 'request_id': 'req-6ca20f14-ad07-4075-ac84-4bd077a21bda'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:30.507570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6ca20f14-ad07-4075-ac84-4bd077a21bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2ee2b8c9d34795bb2a6e4889439aea', 'request_id': 'req-6ca20f14-ad07-4075-ac84-4bd077a21bda'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:30.553391 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e75426-cae0-4631-98a9-2f9f0ef97ca7 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:30.589443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6ca20f14-ad07-4075-ac84-4bd077a21bda admin admin] The token cache is being invalidate because project 0b2ee2b8c9d34795bb2a6e4889439aea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:30.590626 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6ca20f14-ad07-4075-ac84-4bd077a21bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:30.591573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6ca20f14-ad07-4075-ac84-4bd077a21bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:30.593725 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 941/1918] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:30 2022] DELETE /identity/v3/projects/0b2ee2b8c9d34795bb2a6e4889439aea => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:30.594888 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca20f14-ad07-4075-ac84-4bd077a21bda admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:30.596776 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-6ca20f14-ad07-4075-ac84-4bd077a21bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:30.625899 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66379065-ddad-4ab6-a99f-d1f49630dd8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:30.626921 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66379065-ddad-4ab6-a99f-d1f49630dd8d service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:30.627356 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66379065-ddad-4ab6-a99f-d1f49630dd8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:30.627773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66379065-ddad-4ab6-a99f-d1f49630dd8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:30.630030 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-66379065-ddad-4ab6-a99f-d1f49630dd8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:30.687810 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca20f14-ad07-4075-ac84-4bd077a21bda admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:30.694339 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676bb48-f6ed-46d7-a61e-55b3525ec5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:30.695248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676bb48-f6ed-46d7-a61e-55b3525ec5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:30.695687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676bb48-f6ed-46d7-a61e-55b3525ec5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:30.696069 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676bb48-f6ed-46d7-a61e-55b3525ec5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:30.696912 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676bb48-f6ed-46d7-a61e-55b3525ec5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:30.699073 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676bb48-f6ed-46d7-a61e-55b3525ec5c3 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:30.715620 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 942/1919] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:30.716509 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676bb48-f6ed-46d7-a61e-55b3525ec5c3 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:30.718313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-e676bb48-f6ed-46d7-a61e-55b3525ec5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:30.719540 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66379065-ddad-4ab6-a99f-d1f49630dd8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:30.721080 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66379065-ddad-4ab6-a99f-d1f49630dd8d service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:30.732774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 978/1920] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:30.733620 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66379065-ddad-4ab6-a99f-d1f49630dd8d service cinder] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:30.733810 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676bb48-f6ed-46d7-a61e-55b3525ec5c3 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:30.739037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d101729-f983-4a11-9d25-dd0e677a978f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:30.740158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d101729-f983-4a11-9d25-dd0e677a978f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:30.740450 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d101729-f983-4a11-9d25-dd0e677a978f admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:30.740735 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d101729-f983-4a11-9d25-dd0e677a978f admin admin] PATH_INFO: `/v3/users/6266f157b963424b92f07d5461164f20` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:30.742134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d101729-f983-4a11-9d25-dd0e677a978f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6266f157b963424b92f07d5461164f20)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:30.744128 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d101729-f983-4a11-9d25-dd0e677a978f admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:30.746392 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66379065-ddad-4ab6-a99f-d1f49630dd8d service cinder] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:30.755114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685201ab-cd57-4e71-993b-77f5bf66c1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:30.765265 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685201ab-cd57-4e71-993b-77f5bf66c1e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:30.765265 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685201ab-cd57-4e71-993b-77f5bf66c1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:30.765265 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685201ab-cd57-4e71-993b-77f5bf66c1e1 admin admin] PATH_INFO: `/v3/projects/5255720b7c2340eba4e02970d20e918d/users/5f7d1179fbaa4ff68f39c89ce2e30d51/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:30.781179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685201ab-cd57-4e71-993b-77f5bf66c1e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5255720b7c2340eba4e02970d20e918d, user_id=5f7d1179fbaa4ff68f39c89ce2e30d51, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:30.783521 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:30.784004 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685201ab-cd57-4e71-993b-77f5bf66c1e1 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:30.906310 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 979/1921] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:30 2022] PUT /identity/v3/projects/5255720b7c2340eba4e02970d20e918d/users/5f7d1179fbaa4ff68f39c89ce2e30d51/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:30.910357 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685201ab-cd57-4e71-993b-77f5bf66c1e1 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:30.983227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685201ab-cd57-4e71-993b-77f5bf66c1e1 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:30.989407 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61e58c-fcce-42de-9e87-318faf6b60af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:30.989657 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61e58c-fcce-42de-9e87-318faf6b60af admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:30.990028 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61e58c-fcce-42de-9e87-318faf6b60af admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:30.990317 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61e58c-fcce-42de-9e87-318faf6b60af admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:30.991064 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61e58c-fcce-42de-9e87-318faf6b60af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:30.993453 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61e58c-fcce-42de-9e87-318faf6b60af admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:31.007079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 980/1922] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:42:31.011156 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61e58c-fcce-42de-9e87-318faf6b60af admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:31.012132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0d101729-f983-4a11-9d25-dd0e677a978f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6266f157b963424b92f07d5461164f20'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:31.023788 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61e58c-fcce-42de-9e87-318faf6b60af admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:31.029866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c2400-e57a-48ba-9cbc-ca389d66f2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:31.030796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c2400-e57a-48ba-9cbc-ca389d66f2da admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:31.031066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c2400-e57a-48ba-9cbc-ca389d66f2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:31.031385 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c2400-e57a-48ba-9cbc-ca389d66f2da admin admin] PATH_INFO: `/v3/projects/5255720b7c2340eba4e02970d20e918d/users/5f7d1179fbaa4ff68f39c89ce2e30d51/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:31.033405 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c2400-e57a-48ba-9cbc-ca389d66f2da admin admin] RBAC: Authorizing `identity:create_grant(project_id=5255720b7c2340eba4e02970d20e918d, user_id=5f7d1179fbaa4ff68f39c89ce2e30d51, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:31.036103 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c2400-e57a-48ba-9cbc-ca389d66f2da admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:31.047878 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0d101729-f983-4a11-9d25-dd0e677a978f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6266f157b963424b92f07d5461164f20'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:31.051438 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 981/1923] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:31 2022] PUT /identity/v3/projects/5255720b7c2340eba4e02970d20e918d/users/5f7d1179fbaa4ff68f39c89ce2e30d51/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:42:31.058329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0d101729-f983-4a11-9d25-dd0e677a978f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6266f157b963424b92f07d5461164f20'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:31.059031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba1931-9b89-4e81-9da5-49b9fc6ea641 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:31.059353 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba1931-9b89-4e81-9da5-49b9fc6ea641 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:31.059641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba1931-9b89-4e81-9da5-49b9fc6ea641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:31.068800 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:31.088411 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-84ba1931-9b89-4e81-9da5-49b9fc6ea641 None None] MFA Rules not processed for user `5f7d1179fbaa4ff68f39c89ce2e30d51`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:31.090338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-84ba1931-9b89-4e81-9da5-49b9fc6ea641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:31.125603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0d101729-f983-4a11-9d25-dd0e677a978f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6266f157b963424b92f07d5461164f20'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:31.126317 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0d101729-f983-4a11-9d25-dd0e677a978f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6266f157b963424b92f07d5461164f20'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:31.133553 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 943/1924] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:30 2022] DELETE /identity/v3/users/6266f157b963424b92f07d5461164f20 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:31.174580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 982/1925] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:31.186431 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d101729-f983-4a11-9d25-dd0e677a978f admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:31.187913 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0d101729-f983-4a11-9d25-dd0e677a978f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:31.264214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d101729-f983-4a11-9d25-dd0e677a978f admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:31.267969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d32076-9d9d-439b-a584-bae2eb4e19dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:31.272189 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d32076-9d9d-439b-a584-bae2eb4e19dc service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:31.272189 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d32076-9d9d-439b-a584-bae2eb4e19dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:31.272189 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d32076-9d9d-439b-a584-bae2eb4e19dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:31.363575 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d32076-9d9d-439b-a584-bae2eb4e19dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:31.365976 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d32076-9d9d-439b-a584-bae2eb4e19dc service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:31.383073 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 944/1926] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:31.703150 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba1931-9b89-4e81-9da5-49b9fc6ea641 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:31.705387 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d32076-9d9d-439b-a584-bae2eb4e19dc service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:31.706694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-84ba1931-9b89-4e81-9da5-49b9fc6ea641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:31.715528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d32076-9d9d-439b-a584-bae2eb4e19dc service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:31.721397 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54549401-46ec-442f-b448-5ec6fda9a75a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:31.726334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54549401-46ec-442f-b448-5ec6fda9a75a service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:31.726334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54549401-46ec-442f-b448-5ec6fda9a75a service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:31.726334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54549401-46ec-442f-b448-5ec6fda9a75a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:31.726334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-54549401-46ec-442f-b448-5ec6fda9a75a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:31.797107 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54549401-46ec-442f-b448-5ec6fda9a75a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:31.800000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54549401-46ec-442f-b448-5ec6fda9a75a service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:31.803967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba1931-9b89-4e81-9da5-49b9fc6ea641 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:31.815774 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 945/1927] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:31.926080 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fac41-08b6-4532-96e0-063ea273e61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:31.926981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fac41-08b6-4532-96e0-063ea273e61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:31.927351 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fac41-08b6-4532-96e0-063ea273e61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:31.927639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fac41-08b6-4532-96e0-063ea273e61f admin admin] PATH_INFO: `/v3/projects/f7d9c93f5bdc473796a506633751cb15` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:31.929528 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fac41-08b6-4532-96e0-063ea273e61f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7d9c93f5bdc473796a506633751cb15)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:31.934499 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fac41-08b6-4532-96e0-063ea273e61f admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:32.056241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54549401-46ec-442f-b448-5ec6fda9a75a service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:32.059300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-54549401-46ec-442f-b448-5ec6fda9a75a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:32.083987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-e37fac41-08b6-4532-96e0-063ea273e61f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d9c93f5bdc473796a506633751cb15', 'request_id': 'req-e37fac41-08b6-4532-96e0-063ea273e61f'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:32.145045 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54549401-46ec-442f-b448-5ec6fda9a75a service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:32.176205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-e37fac41-08b6-4532-96e0-063ea273e61f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d9c93f5bdc473796a506633751cb15', 'request_id': 'req-e37fac41-08b6-4532-96e0-063ea273e61f'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:32.185684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-e37fac41-08b6-4532-96e0-063ea273e61f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d9c93f5bdc473796a506633751cb15', 'request_id': 'req-e37fac41-08b6-4532-96e0-063ea273e61f'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:32.206364 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-e37fac41-08b6-4532-96e0-063ea273e61f admin admin] The token cache is being invalidate because project f7d9c93f5bdc473796a506633751cb15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:32.206584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-e37fac41-08b6-4532-96e0-063ea273e61f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:32.210347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-e37fac41-08b6-4532-96e0-063ea273e61f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:32.214839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 983/1928] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:31 2022] DELETE /identity/v3/projects/f7d9c93f5bdc473796a506633751cb15 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:32.220859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493683f-014b-4e87-9fd1-ab5dbff8d4ae None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:32.221152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493683f-014b-4e87-9fd1-ab5dbff8d4ae None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:32.221432 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493683f-014b-4e87-9fd1-ab5dbff8d4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:32.242259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-c493683f-014b-4e87-9fd1-ab5dbff8d4ae None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:32.243658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-c493683f-014b-4e87-9fd1-ab5dbff8d4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:32.269684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c6301-0357-46ba-b52f-fc7452f7a7f5 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c0ffa00f9174066ad278f91316868ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6779bac41c2842f7a8765020232dc27f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:32.270752 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c6301-0357-46ba-b52f-fc7452f7a7f5 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:32.270752 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c6301-0357-46ba-b52f-fc7452f7a7f5 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:32.271048 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c6301-0357-46ba-b52f-fc7452f7a7f5 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:32.271888 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c6301-0357-46ba-b52f-fc7452f7a7f5 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:32.272315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c6301-0357-46ba-b52f-fc7452f7a7f5 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:32.274262 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c6301-0357-46ba-b52f-fc7452f7a7f5 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:32.275066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:32.291394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 946/1929] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:42:32.292806 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c6301-0357-46ba-b52f-fc7452f7a7f5 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:32.294620 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-d47c6301-0357-46ba-b52f-fc7452f7a7f5 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:32.308049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c6301-0357-46ba-b52f-fc7452f7a7f5 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:32.312839 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130598af-f426-43f4-8443-b059d4b8abad tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c0ffa00f9174066ad278f91316868ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6779bac41c2842f7a8765020232dc27f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:32.313624 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130598af-f426-43f4-8443-b059d4b8abad tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:32.313974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130598af-f426-43f4-8443-b059d4b8abad tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:32.314318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130598af-f426-43f4-8443-b059d4b8abad tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:32.314737 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 984/1930] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:32.315092 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130598af-f426-43f4-8443-b059d4b8abad tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:32.317343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130598af-f426-43f4-8443-b059d4b8abad tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:32.325267 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993be53-3a3b-41b7-888f-ef3435fee7a4 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:32.325560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993be53-3a3b-41b7-888f-ef3435fee7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:32.325849 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993be53-3a3b-41b7-888f-ef3435fee7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:32.345637 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-1993be53-3a3b-41b7-888f-ef3435fee7a4 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:32.346874 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1993be53-3a3b-41b7-888f-ef3435fee7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:32.355577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 985/1931] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:32.361069 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993be53-3a3b-41b7-888f-ef3435fee7a4 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:32.369473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993be53-3a3b-41b7-888f-ef3435fee7a4 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:32.375108 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991baf34-892c-4b93-b529-3815604ef098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:32.375810 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991baf34-892c-4b93-b529-3815604ef098 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:32.376093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991baf34-892c-4b93-b529-3815604ef098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:32.376366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991baf34-892c-4b93-b529-3815604ef098 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:32.377099 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991baf34-892c-4b93-b529-3815604ef098 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:32.377410 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991baf34-892c-4b93-b529-3815604ef098 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:32.379149 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991baf34-892c-4b93-b529-3815604ef098 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:32.392663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 986/1932] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:42:32.397337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991baf34-892c-4b93-b529-3815604ef098 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:32.407364 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991baf34-892c-4b93-b529-3815604ef098 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:32.412011 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d8433-0d34-4d82-bec5-87722b6161b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:32.412681 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d8433-0d34-4d82-bec5-87722b6161b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:32.412964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d8433-0d34-4d82-bec5-87722b6161b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:32.413245 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d8433-0d34-4d82-bec5-87722b6161b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:32.413945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d8433-0d34-4d82-bec5-87722b6161b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:32.415897 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d8433-0d34-4d82-bec5-87722b6161b2 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:32.434463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 947/1933] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:32 2022] POST /identity/v3/projects => generated 352 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:32.438390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130598af-f426-43f4-8443-b059d4b8abad tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:32.501718 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 987/1934] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:32 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:42:32.502630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d8433-0d34-4d82-bec5-87722b6161b2 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:32.513219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130598af-f426-43f4-8443-b059d4b8abad tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:32.576217 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d8433-0d34-4d82-bec5-87722b6161b2 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:32.581605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913f996-ece4-4f20-9679-04c298611dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:32.582172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913f996-ece4-4f20-9679-04c298611dbc admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:32.582455 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913f996-ece4-4f20-9679-04c298611dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:32.582737 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913f996-ece4-4f20-9679-04c298611dbc admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:32.583473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913f996-ece4-4f20-9679-04c298611dbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:32.585462 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913f996-ece4-4f20-9679-04c298611dbc admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:32.595762 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:32.599903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73de267-7161-4104-8cc5-ab7bb08c8223 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c0ffa00f9174066ad278f91316868ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6779bac41c2842f7a8765020232dc27f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:32.604850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73de267-7161-4104-8cc5-ab7bb08c8223 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:32.604850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73de267-7161-4104-8cc5-ab7bb08c8223 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:32.604850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73de267-7161-4104-8cc5-ab7bb08c8223 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:32.604850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73de267-7161-4104-8cc5-ab7bb08c8223 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:32.604850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73de267-7161-4104-8cc5-ab7bb08c8223 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:32.605839 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73de267-7161-4104-8cc5-ab7bb08c8223 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:32.617537 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 948/1935] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:42:32.666172 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73de267-7161-4104-8cc5-ab7bb08c8223 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:32.677740 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73de267-7161-4104-8cc5-ab7bb08c8223 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:32.685137 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313365bd-54c8-45b4-bd26-ea361232e1c9 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c0ffa00f9174066ad278f91316868ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6779bac41c2842f7a8765020232dc27f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:32.686062 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313365bd-54c8-45b4-bd26-ea361232e1c9 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:32.686353 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313365bd-54c8-45b4-bd26-ea361232e1c9 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:32.686632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313365bd-54c8-45b4-bd26-ea361232e1c9 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] PATH_INFO: `/v3/projects/6d8d3fd6c4f94e79afd39d868f68f431` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:32.687887 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313365bd-54c8-45b4-bd26-ea361232e1c9 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6d8d3fd6c4f94e79afd39d868f68f431)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:32.690860 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313365bd-54c8-45b4-bd26-ea361232e1c9 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:32.716180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 988/1936] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:32 2022] POST /identity/v3/users => generated 285 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:32.722413 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913f996-ece4-4f20-9679-04c298611dbc admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:32.735946 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913f996-ece4-4f20-9679-04c298611dbc admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:32.740752 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297ddf9-80fd-4552-9ac6-3ce3a15649ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:32.741442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297ddf9-80fd-4552-9ac6-3ce3a15649ab admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:32.741715 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297ddf9-80fd-4552-9ac6-3ce3a15649ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:32.741997 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297ddf9-80fd-4552-9ac6-3ce3a15649ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:32.742755 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297ddf9-80fd-4552-9ac6-3ce3a15649ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:32.744425 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297ddf9-80fd-4552-9ac6-3ce3a15649ab admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:32.755177 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 989/1937] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:42:32.763993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297ddf9-80fd-4552-9ac6-3ce3a15649ab admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:32.774525 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297ddf9-80fd-4552-9ac6-3ce3a15649ab admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:32.779322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa4110-4abb-44e7-b6b9-15c8bd30d957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:32.779986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa4110-4abb-44e7-b6b9-15c8bd30d957 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:32.780270 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa4110-4abb-44e7-b6b9-15c8bd30d957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:32.782663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa4110-4abb-44e7-b6b9-15c8bd30d957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:32.782663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa4110-4abb-44e7-b6b9-15c8bd30d957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:32.783039 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa4110-4abb-44e7-b6b9-15c8bd30d957 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:32.793730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 990/1938] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:32.797720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa4110-4abb-44e7-b6b9-15c8bd30d957 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:32.812166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa4110-4abb-44e7-b6b9-15c8bd30d957 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:32.821788 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-313365bd-54c8-45b4-bd26-ea361232e1c9 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d8d3fd6c4f94e79afd39d868f68f431', 'request_id': 'req-313365bd-54c8-45b4-bd26-ea361232e1c9'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:32.828202 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-313365bd-54c8-45b4-bd26-ea361232e1c9 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d8d3fd6c4f94e79afd39d868f68f431', 'request_id': 'req-313365bd-54c8-45b4-bd26-ea361232e1c9'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:32.835170 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-313365bd-54c8-45b4-bd26-ea361232e1c9 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d8d3fd6c4f94e79afd39d868f68f431', 'request_id': 'req-313365bd-54c8-45b4-bd26-ea361232e1c9'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:32.870629 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930f606-4bc8-49ab-9d67-db9b49801cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:32.871607 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930f606-4bc8-49ab-9d67-db9b49801cef admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:32.871898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930f606-4bc8-49ab-9d67-db9b49801cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:32.872179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930f606-4bc8-49ab-9d67-db9b49801cef admin admin] PATH_INFO: `/v3/projects/43ff2c5b223449faa6a028d9888f9069/users/9fef55e1eb6f4fed9126887ec36e6556/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:32.888930 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930f606-4bc8-49ab-9d67-db9b49801cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ff2c5b223449faa6a028d9888f9069, user_id=9fef55e1eb6f4fed9126887ec36e6556, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:32.891650 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930f606-4bc8-49ab-9d67-db9b49801cef admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:32.928140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-313365bd-54c8-45b4-bd26-ea361232e1c9 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] The token cache is being invalidate because project 6d8d3fd6c4f94e79afd39d868f68f431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:32.928436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-313365bd-54c8-45b4-bd26-ea361232e1c9 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:32.929091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-313365bd-54c8-45b4-bd26-ea361232e1c9 tempest-VolumeQuotaClassesTest-1274810381 tempest-VolumeQuotaClassesTest-1274810381-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:32.930709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 949/1939] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:32 2022] DELETE /identity/v3/projects/6d8d3fd6c4f94e79afd39d868f68f431 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:42:33.080214 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 991/1940] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:32 2022] PUT /identity/v3/projects/43ff2c5b223449faa6a028d9888f9069/users/9fef55e1eb6f4fed9126887ec36e6556/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:42:33.084372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd0ccb-36f1-4f46-926b-0fe6c8191809 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:33.084815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd0ccb-36f1-4f46-926b-0fe6c8191809 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:33.085115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd0ccb-36f1-4f46-926b-0fe6c8191809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:33.117234 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-0bbd0ccb-36f1-4f46-926b-0fe6c8191809 None None] MFA Rules not processed for user `9fef55e1eb6f4fed9126887ec36e6556`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:33.118457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0bbd0ccb-36f1-4f46-926b-0fe6c8191809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:33.192718 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 950/1941] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:42:33.204700 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930f606-4bc8-49ab-9d67-db9b49801cef admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:33.206995 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-c930f606-4bc8-49ab-9d67-db9b49801cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:33.295730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930f606-4bc8-49ab-9d67-db9b49801cef admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:33.301721 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7472814-647e-4e2c-87d8-5f76201f2653 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37932500740c4ccb96358bd751d01598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:33.302483 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7472814-647e-4e2c-87d8-5f76201f2653 service glance] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:33.303409 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7472814-647e-4e2c-87d8-5f76201f2653 service glance] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:33.303673 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7472814-647e-4e2c-87d8-5f76201f2653 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:33.313487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7472814-647e-4e2c-87d8-5f76201f2653 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:33.315781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7472814-647e-4e2c-87d8-5f76201f2653 service glance] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:33.326283 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 992/1942] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:33.559007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:33.626534 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd0ccb-36f1-4f46-926b-0fe6c8191809 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:33.628222 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0bbd0ccb-36f1-4f46-926b-0fe6c8191809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:33.711045 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd0ccb-36f1-4f46-926b-0fe6c8191809 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:33.717635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d11e21-6d51-4897-b64e-2d867c8f6e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:33.718609 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d11e21-6d51-4897-b64e-2d867c8f6e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:33.718915 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d11e21-6d51-4897-b64e-2d867c8f6e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:33.719180 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d11e21-6d51-4897-b64e-2d867c8f6e5b admin admin] PATH_INFO: `/v3/users/009ccc6b0aee4776841c8691f71d3ec0` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:33.720595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d11e21-6d51-4897-b64e-2d867c8f6e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=009ccc6b0aee4776841c8691f71d3ec0)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:33.722623 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d11e21-6d51-4897-b64e-2d867c8f6e5b admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:34.967433 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-73d11e21-6d51-4897-b64e-2d867c8f6e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '009ccc6b0aee4776841c8691f71d3ec0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:34.992931 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-73d11e21-6d51-4897-b64e-2d867c8f6e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '009ccc6b0aee4776841c8691f71d3ec0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:35.002387 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-73d11e21-6d51-4897-b64e-2d867c8f6e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '009ccc6b0aee4776841c8691f71d3ec0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:35.076392 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a8a50-a562-44ec-b54c-9578f328b037 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:35.077232 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a8a50-a562-44ec-b54c-9578f328b037 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:35.077232 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a8a50-a562-44ec-b54c-9578f328b037 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:35.078416 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 993/1943] 10.222.0.40 () {54 vars in 921 bytes} [Tue Jul 12 14:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:42:35.090948 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9957e1-eba6-486b-9f66-56df19913d67 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:35.091331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9957e1-eba6-486b-9f66-56df19913d67 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:35.091539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9957e1-eba6-486b-9f66-56df19913d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:35.115685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-73d11e21-6d51-4897-b64e-2d867c8f6e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '009ccc6b0aee4776841c8691f71d3ec0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:35.116327 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-73d11e21-6d51-4897-b64e-2d867c8f6e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '009ccc6b0aee4776841c8691f71d3ec0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:35.120641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-dc9957e1-eba6-486b-9f66-56df19913d67 None None] MFA Rules not processed for user `122fc227de9d4f87a66e4a0d86ff0b16`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:35.122371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-dc9957e1-eba6-486b-9f66-56df19913d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:35.125681 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 951/1944] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:33 2022] DELETE /identity/v3/users/009ccc6b0aee4776841c8691f71d3ec0 => generated 0 bytes in 1499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:35.130290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b29d50-7323-4779-b85c-2ed9b55a1412 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:35.130668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b29d50-7323-4779-b85c-2ed9b55a1412 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:35.131081 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b29d50-7323-4779-b85c-2ed9b55a1412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:35.157327 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-d7b29d50-7323-4779-b85c-2ed9b55a1412 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:35.159471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-d7b29d50-7323-4779-b85c-2ed9b55a1412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:35.233349 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 994/1945] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Jul 12 14:42:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:42:35.252270 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9957e1-eba6-486b-9f66-56df19913d67 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:35.253740 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-dc9957e1-eba6-486b-9f66-56df19913d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:35.255985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 952/1946] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:42:35.266858 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b29d50-7323-4779-b85c-2ed9b55a1412 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:35.269139 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-d7b29d50-7323-4779-b85c-2ed9b55a1412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:35.273887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9957e1-eba6-486b-9f66-56df19913d67 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:35.284417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c76c55-3e44-4ea8-80d4-503181f217db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:35.285642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c76c55-3e44-4ea8-80d4-503181f217db service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:35.286000 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c76c55-3e44-4ea8-80d4-503181f217db service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:35.286286 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c76c55-3e44-4ea8-80d4-503181f217db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:35.296784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c76c55-3e44-4ea8-80d4-503181f217db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:35.299316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c76c55-3e44-4ea8-80d4-503181f217db service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:35.325143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 995/1947] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:35.375022 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b29d50-7323-4779-b85c-2ed9b55a1412 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:35.378786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3468ef-c180-4a7d-a2f7-3d00bfb312c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:35.379505 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3468ef-c180-4a7d-a2f7-3d00bfb312c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:35.379766 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3468ef-c180-4a7d-a2f7-3d00bfb312c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:35.380046 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3468ef-c180-4a7d-a2f7-3d00bfb312c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:35.390862 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3468ef-c180-4a7d-a2f7-3d00bfb312c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:35.392488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3468ef-c180-4a7d-a2f7-3d00bfb312c8 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:35.415373 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 953/1948] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:35.718145 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:36.020143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c76c55-3e44-4ea8-80d4-503181f217db service nova] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:36.020143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d2c76c55-3e44-4ea8-80d4-503181f217db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:36.034241 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c76c55-3e44-4ea8-80d4-503181f217db service nova] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:36.039430 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f3ac6-15ef-432c-82f7-ac2e46ad8d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:36.040308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f3ac6-15ef-432c-82f7-ac2e46ad8d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:36.040626 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f3ac6-15ef-432c-82f7-ac2e46ad8d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:36.040857 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f3ac6-15ef-432c-82f7-ac2e46ad8d60 admin admin] PATH_INFO: `/v3/projects/b209a288d95240cfb21f166baaf58f1c` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:36.042204 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f3ac6-15ef-432c-82f7-ac2e46ad8d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b209a288d95240cfb21f166baaf58f1c)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:36.044279 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f3ac6-15ef-432c-82f7-ac2e46ad8d60 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:36.089407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3468ef-c180-4a7d-a2f7-3d00bfb312c8 service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:36.090942 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ea3468ef-c180-4a7d-a2f7-3d00bfb312c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:36.105359 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3468ef-c180-4a7d-a2f7-3d00bfb312c8 service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:36.111159 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bca767-0b67-4a9a-8343-0d2f0cdd5f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:36.112234 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bca767-0b67-4a9a-8343-0d2f0cdd5f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:36.112499 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bca767-0b67-4a9a-8343-0d2f0cdd5f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:36.112780 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bca767-0b67-4a9a-8343-0d2f0cdd5f84 admin admin] PATH_INFO: `/v3/users/3211a37eb04243459f73932fe7d7a4a4` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:36.114132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bca767-0b67-4a9a-8343-0d2f0cdd5f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3211a37eb04243459f73932fe7d7a4a4)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:36.116088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bca767-0b67-4a9a-8343-0d2f0cdd5f84 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:36.156485 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-3b0f3ac6-15ef-432c-82f7-ac2e46ad8d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b209a288d95240cfb21f166baaf58f1c', 'request_id': 'req-3b0f3ac6-15ef-432c-82f7-ac2e46ad8d60'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.222801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-3b0f3ac6-15ef-432c-82f7-ac2e46ad8d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b209a288d95240cfb21f166baaf58f1c', 'request_id': 'req-3b0f3ac6-15ef-432c-82f7-ac2e46ad8d60'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.230824 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-3b0f3ac6-15ef-432c-82f7-ac2e46ad8d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b209a288d95240cfb21f166baaf58f1c', 'request_id': 'req-3b0f3ac6-15ef-432c-82f7-ac2e46ad8d60'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.245801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-3b0f3ac6-15ef-432c-82f7-ac2e46ad8d60 admin admin] The token cache is being invalidate because project b209a288d95240cfb21f166baaf58f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:36.246510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-3b0f3ac6-15ef-432c-82f7-ac2e46ad8d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.247504 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-3b0f3ac6-15ef-432c-82f7-ac2e46ad8d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.252329 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 996/1949] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:36 2022] DELETE /identity/v3/projects/b209a288d95240cfb21f166baaf58f1c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:36.253467 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f3ac6-15ef-432c-82f7-ac2e46ad8d60 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:36.254966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-3b0f3ac6-15ef-432c-82f7-ac2e46ad8d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:36.280394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:36.329840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-12bca767-0b67-4a9a-8343-0d2f0cdd5f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3211a37eb04243459f73932fe7d7a4a4'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.343431 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-12bca767-0b67-4a9a-8343-0d2f0cdd5f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3211a37eb04243459f73932fe7d7a4a4'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.350394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f3ac6-15ef-432c-82f7-ac2e46ad8d60 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:36.356606 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-12bca767-0b67-4a9a-8343-0d2f0cdd5f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3211a37eb04243459f73932fe7d7a4a4'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.364997 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369ddf0-b79e-41d8-bb9d-e5958d5ed74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:36.366284 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369ddf0-b79e-41d8-bb9d-e5958d5ed74c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:36.366648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369ddf0-b79e-41d8-bb9d-e5958d5ed74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:36.367040 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369ddf0-b79e-41d8-bb9d-e5958d5ed74c admin admin] PATH_INFO: `/v3/users/9c0ffa00f9174066ad278f91316868ac` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:36.368651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369ddf0-b79e-41d8-bb9d-e5958d5ed74c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c0ffa00f9174066ad278f91316868ac)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:36.371779 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369ddf0-b79e-41d8-bb9d-e5958d5ed74c admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:36.439314 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-12bca767-0b67-4a9a-8343-0d2f0cdd5f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3211a37eb04243459f73932fe7d7a4a4'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.439939 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-12bca767-0b67-4a9a-8343-0d2f0cdd5f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3211a37eb04243459f73932fe7d7a4a4'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.446503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 954/1950] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:36 2022] DELETE /identity/v3/users/3211a37eb04243459f73932fe7d7a4a4 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:42:36.451880 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8634836-d1cf-4b6c-8b9c-58f05f34a1af None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:36.452203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8634836-d1cf-4b6c-8b9c-58f05f34a1af None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:36.452579 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8634836-d1cf-4b6c-8b9c-58f05f34a1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:36.472185 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-c8634836-d1cf-4b6c-8b9c-58f05f34a1af None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:36.473421 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-c8634836-d1cf-4b6c-8b9c-58f05f34a1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:36.535755 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 955/1951] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:42:36.546591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8634836-d1cf-4b6c-8b9c-58f05f34a1af None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:36.548049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-c8634836-d1cf-4b6c-8b9c-58f05f34a1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:36.614327 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8634836-d1cf-4b6c-8b9c-58f05f34a1af None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:36.617912 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61611b-30a2-42d2-935d-ceca4f3cf963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:36.618579 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61611b-30a2-42d2-935d-ceca4f3cf963 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:36.618865 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61611b-30a2-42d2-935d-ceca4f3cf963 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:36.619149 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61611b-30a2-42d2-935d-ceca4f3cf963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:36.629377 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61611b-30a2-42d2-935d-ceca4f3cf963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:36.630828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61611b-30a2-42d2-935d-ceca4f3cf963 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:36.641399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 956/1952] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:42:36.642578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61611b-30a2-42d2-935d-ceca4f3cf963 service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:36.643865 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-3d61611b-30a2-42d2-935d-ceca4f3cf963 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:36.658615 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61611b-30a2-42d2-935d-ceca4f3cf963 service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:36.674648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a369ddf0-b79e-41d8-bb9d-e5958d5ed74c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c0ffa00f9174066ad278f91316868ac'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.682212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490787b-b785-4aaf-a1c0-e19ab7cf9e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:36.684221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490787b-b785-4aaf-a1c0-e19ab7cf9e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:36.684557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490787b-b785-4aaf-a1c0-e19ab7cf9e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:36.684841 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490787b-b785-4aaf-a1c0-e19ab7cf9e00 admin admin] PATH_INFO: `/v3/users/766618154f3c41e1b1c82d6ee412014e` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:36.686830 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490787b-b785-4aaf-a1c0-e19ab7cf9e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=766618154f3c41e1b1c82d6ee412014e)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:36.689765 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490787b-b785-4aaf-a1c0-e19ab7cf9e00 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:36.690929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a369ddf0-b79e-41d8-bb9d-e5958d5ed74c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c0ffa00f9174066ad278f91316868ac'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.783343 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a369ddf0-b79e-41d8-bb9d-e5958d5ed74c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c0ffa00f9174066ad278f91316868ac'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.783926 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a369ddf0-b79e-41d8-bb9d-e5958d5ed74c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c0ffa00f9174066ad278f91316868ac'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.794269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a369ddf0-b79e-41d8-bb9d-e5958d5ed74c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c0ffa00f9174066ad278f91316868ac'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.810913 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 997/1953] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:36 2022] DELETE /identity/v3/users/9c0ffa00f9174066ad278f91316868ac => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:36.983222 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-2490787b-b785-4aaf-a1c0-e19ab7cf9e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '766618154f3c41e1b1c82d6ee412014e'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:36.996098 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-2490787b-b785-4aaf-a1c0-e19ab7cf9e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '766618154f3c41e1b1c82d6ee412014e'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.004934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-2490787b-b785-4aaf-a1c0-e19ab7cf9e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '766618154f3c41e1b1c82d6ee412014e'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.122323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-2490787b-b785-4aaf-a1c0-e19ab7cf9e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '766618154f3c41e1b1c82d6ee412014e'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.123295 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-2490787b-b785-4aaf-a1c0-e19ab7cf9e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '766618154f3c41e1b1c82d6ee412014e'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.129776 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 957/1954] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:36 2022] DELETE /identity/v3/users/766618154f3c41e1b1c82d6ee412014e => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:37.135306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64734c-e8e4-48de-8e26-4dd568c76f01 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:37.135579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64734c-e8e4-48de-8e26-4dd568c76f01 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:37.135883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64734c-e8e4-48de-8e26-4dd568c76f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:37.155233 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-ec64734c-e8e4-48de-8e26-4dd568c76f01 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:37.156428 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ec64734c-e8e4-48de-8e26-4dd568c76f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:37.228659 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 998/1955] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:42:37.240175 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490787b-b785-4aaf-a1c0-e19ab7cf9e00 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:37.242175 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2490787b-b785-4aaf-a1c0-e19ab7cf9e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:37.273331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64734c-e8e4-48de-8e26-4dd568c76f01 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:37.275077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ec64734c-e8e4-48de-8e26-4dd568c76f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:37.299312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64734c-e8e4-48de-8e26-4dd568c76f01 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:37.310746 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543f3ae-38f6-4fad-9a77-68b6e27a40d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:37.310746 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543f3ae-38f6-4fad-9a77-68b6e27a40d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:37.310746 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543f3ae-38f6-4fad-9a77-68b6e27a40d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:37.311213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543f3ae-38f6-4fad-9a77-68b6e27a40d5 admin admin] PATH_INFO: `/v3/projects/f4e30a3ec3c5429a9ac1aed7ac200a36` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:37.312207 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543f3ae-38f6-4fad-9a77-68b6e27a40d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4e30a3ec3c5429a9ac1aed7ac200a36)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:37.314164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543f3ae-38f6-4fad-9a77-68b6e27a40d5 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:37.314766 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490787b-b785-4aaf-a1c0-e19ab7cf9e00 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:37.320614 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8841dd-d71e-4abc-868d-b03f215273df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:37.321736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8841dd-d71e-4abc-868d-b03f215273df service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:37.321736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8841dd-d71e-4abc-868d-b03f215273df service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:37.321908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8841dd-d71e-4abc-868d-b03f215273df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:37.332598 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8841dd-d71e-4abc-868d-b03f215273df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:37.335599 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8841dd-d71e-4abc-868d-b03f215273df service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:37.346125 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 958/1956] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:37.459749 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8841dd-d71e-4abc-868d-b03f215273df service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:37.466211 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ad8841dd-d71e-4abc-868d-b03f215273df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:37.469170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-8543f3ae-38f6-4fad-9a77-68b6e27a40d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4e30a3ec3c5429a9ac1aed7ac200a36', 'request_id': 'req-8543f3ae-38f6-4fad-9a77-68b6e27a40d5'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.487315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8841dd-d71e-4abc-868d-b03f215273df service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:37.548382 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-8543f3ae-38f6-4fad-9a77-68b6e27a40d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4e30a3ec3c5429a9ac1aed7ac200a36', 'request_id': 'req-8543f3ae-38f6-4fad-9a77-68b6e27a40d5'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.555211 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-8543f3ae-38f6-4fad-9a77-68b6e27a40d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4e30a3ec3c5429a9ac1aed7ac200a36', 'request_id': 'req-8543f3ae-38f6-4fad-9a77-68b6e27a40d5'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.567945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4d2b5-6b5e-44fe-a1e4-1d417c9c7a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:37.568855 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4d2b5-6b5e-44fe-a1e4-1d417c9c7a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:37.569146 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4d2b5-6b5e-44fe-a1e4-1d417c9c7a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:37.569639 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4d2b5-6b5e-44fe-a1e4-1d417c9c7a15 admin admin] PATH_INFO: `/v3/projects/6779bac41c2842f7a8765020232dc27f` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:37.570939 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4d2b5-6b5e-44fe-a1e4-1d417c9c7a15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6779bac41c2842f7a8765020232dc27f)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:37.574071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4d2b5-6b5e-44fe-a1e4-1d417c9c7a15 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:37.579322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-8543f3ae-38f6-4fad-9a77-68b6e27a40d5 admin admin] The token cache is being invalidate because project f4e30a3ec3c5429a9ac1aed7ac200a36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:37.579476 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-8543f3ae-38f6-4fad-9a77-68b6e27a40d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.584017 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-8543f3ae-38f6-4fad-9a77-68b6e27a40d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.584017 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 999/1957] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:37 2022] DELETE /identity/v3/projects/f4e30a3ec3c5429a9ac1aed7ac200a36 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:37.588997 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543f3ae-38f6-4fad-9a77-68b6e27a40d5 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:37.590668 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-8543f3ae-38f6-4fad-9a77-68b6e27a40d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:37.607219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543f3ae-38f6-4fad-9a77-68b6e27a40d5 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:37.612218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788b98f-2214-4484-a2d8-9a63cc205ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:37.613468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788b98f-2214-4484-a2d8-9a63cc205ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:37.613607 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788b98f-2214-4484-a2d8-9a63cc205ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:37.613827 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788b98f-2214-4484-a2d8-9a63cc205ac5 admin admin] PATH_INFO: `/v3/users/5f7d1179fbaa4ff68f39c89ce2e30d51` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:37.615120 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788b98f-2214-4484-a2d8-9a63cc205ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f7d1179fbaa4ff68f39c89ce2e30d51)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:37.617226 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788b98f-2214-4484-a2d8-9a63cc205ac5 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:37.751984 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-83b4d2b5-6b5e-44fe-a1e4-1d417c9c7a15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6779bac41c2842f7a8765020232dc27f', 'request_id': 'req-83b4d2b5-6b5e-44fe-a1e4-1d417c9c7a15'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.758347 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-83b4d2b5-6b5e-44fe-a1e4-1d417c9c7a15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6779bac41c2842f7a8765020232dc27f', 'request_id': 'req-83b4d2b5-6b5e-44fe-a1e4-1d417c9c7a15'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.766585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-83b4d2b5-6b5e-44fe-a1e4-1d417c9c7a15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6779bac41c2842f7a8765020232dc27f', 'request_id': 'req-83b4d2b5-6b5e-44fe-a1e4-1d417c9c7a15'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.845822 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-83b4d2b5-6b5e-44fe-a1e4-1d417c9c7a15 admin admin] The token cache is being invalidate because project 6779bac41c2842f7a8765020232dc27f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:37.846137 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-83b4d2b5-6b5e-44fe-a1e4-1d417c9c7a15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.847633 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-83b4d2b5-6b5e-44fe-a1e4-1d417c9c7a15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.849910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 959/1958] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:37 2022] DELETE /identity/v3/projects/6779bac41c2842f7a8765020232dc27f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:37.857948 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0788b98f-2214-4484-a2d8-9a63cc205ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f7d1179fbaa4ff68f39c89ce2e30d51'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.859312 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8f82-2985-4d81-a4b3-47f1c50adfd7 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:37.859599 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8f82-2985-4d81-a4b3-47f1c50adfd7 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:37.859878 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8f82-2985-4d81-a4b3-47f1c50adfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:37.873026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0788b98f-2214-4484-a2d8-9a63cc205ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f7d1179fbaa4ff68f39c89ce2e30d51'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.879379 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-712e8f82-2985-4d81-a4b3-47f1c50adfd7 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:37.880654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-712e8f82-2985-4d81-a4b3-47f1c50adfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:37.946688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 960/1959] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:37.949162 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e8f82-2985-4d81-a4b3-47f1c50adfd7 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:37.951041 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-712e8f82-2985-4d81-a4b3-47f1c50adfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:37.965851 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e8f82-2985-4d81-a4b3-47f1c50adfd7 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:37.972978 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239de5a-cc17-41ce-8f63-37e019fb5226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:37.976604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239de5a-cc17-41ce-8f63-37e019fb5226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:37.976604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239de5a-cc17-41ce-8f63-37e019fb5226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:37.976604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239de5a-cc17-41ce-8f63-37e019fb5226 admin admin] PATH_INFO: `/v3/projects/28334fc7cc064ad9a1a517ed58d3a800` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:37.976604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239de5a-cc17-41ce-8f63-37e019fb5226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28334fc7cc064ad9a1a517ed58d3a800)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:37.977822 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239de5a-cc17-41ce-8f63-37e019fb5226 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:37.997551 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0788b98f-2214-4484-a2d8-9a63cc205ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f7d1179fbaa4ff68f39c89ce2e30d51'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:37.998735 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0788b98f-2214-4484-a2d8-9a63cc205ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f7d1179fbaa4ff68f39c89ce2e30d51'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.004629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:38.013120 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0788b98f-2214-4484-a2d8-9a63cc205ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f7d1179fbaa4ff68f39c89ce2e30d51'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.021287 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1000/1960] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:37 2022] DELETE /identity/v3/users/5f7d1179fbaa4ff68f39c89ce2e30d51 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:38.022746 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce8754-5839-446a-86f0-da9bd17ff7e0 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:38.023222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce8754-5839-446a-86f0-da9bd17ff7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:38.023633 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce8754-5839-446a-86f0-da9bd17ff7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:38.044022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-37ce8754-5839-446a-86f0-da9bd17ff7e0 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:38.045529 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-37ce8754-5839-446a-86f0-da9bd17ff7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:38.151962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1001/1961] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:38.151962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce8754-5839-446a-86f0-da9bd17ff7e0 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:38.158411 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce8754-5839-446a-86f0-da9bd17ff7e0 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:38.161541 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-1239de5a-cc17-41ce-8f63-37e019fb5226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28334fc7cc064ad9a1a517ed58d3a800', 'request_id': 'req-1239de5a-cc17-41ce-8f63-37e019fb5226'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.172363 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-1239de5a-cc17-41ce-8f63-37e019fb5226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28334fc7cc064ad9a1a517ed58d3a800', 'request_id': 'req-1239de5a-cc17-41ce-8f63-37e019fb5226'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.185842 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-1239de5a-cc17-41ce-8f63-37e019fb5226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28334fc7cc064ad9a1a517ed58d3a800', 'request_id': 'req-1239de5a-cc17-41ce-8f63-37e019fb5226'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.226629 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4f278-5c8a-4cdf-978d-483df974f2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:38.228521 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4f278-5c8a-4cdf-978d-483df974f2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:38.229551 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4f278-5c8a-4cdf-978d-483df974f2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:38.230135 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4f278-5c8a-4cdf-978d-483df974f2b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:38.230783 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4f278-5c8a-4cdf-978d-483df974f2b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:38.231096 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4f278-5c8a-4cdf-978d-483df974f2b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:38.233029 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4f278-5c8a-4cdf-978d-483df974f2b0 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:38.251336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1002/1962] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:42:38.252732 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4f278-5c8a-4cdf-978d-483df974f2b0 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:38.266516 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4f278-5c8a-4cdf-978d-483df974f2b0 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:38.271579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095b5fd-76fc-4ef8-9ba0-30d836431b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:38.272245 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095b5fd-76fc-4ef8-9ba0-30d836431b51 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:38.272531 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095b5fd-76fc-4ef8-9ba0-30d836431b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:38.272812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095b5fd-76fc-4ef8-9ba0-30d836431b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:38.273532 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095b5fd-76fc-4ef8-9ba0-30d836431b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:38.275474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095b5fd-76fc-4ef8-9ba0-30d836431b51 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:38.284590 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-1239de5a-cc17-41ce-8f63-37e019fb5226 admin admin] The token cache is being invalidate because project 28334fc7cc064ad9a1a517ed58d3a800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:38.285103 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-1239de5a-cc17-41ce-8f63-37e019fb5226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.287141 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-1239de5a-cc17-41ce-8f63-37e019fb5226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.290707 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 961/1963] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:37 2022] DELETE /identity/v3/projects/28334fc7cc064ad9a1a517ed58d3a800 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:38.295505 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239de5a-cc17-41ce-8f63-37e019fb5226 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:38.297600 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-1239de5a-cc17-41ce-8f63-37e019fb5226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:38.316347 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239de5a-cc17-41ce-8f63-37e019fb5226 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:38.319265 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b0c47-90b5-4b43-b077-b33263ccd7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:38.320594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b0c47-90b5-4b43-b077-b33263ccd7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:38.321413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b0c47-90b5-4b43-b077-b33263ccd7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:38.321413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b0c47-90b5-4b43-b077-b33263ccd7bd admin admin] PATH_INFO: `/v3/users/6e1c8892a0b24d2690ba3fdd96e8d2d0` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:38.323016 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b0c47-90b5-4b43-b077-b33263ccd7bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e1c8892a0b24d2690ba3fdd96e8d2d0)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:38.325512 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b0c47-90b5-4b43-b077-b33263ccd7bd admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:38.395215 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1003/1964] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:38 2022] POST /identity/v3/projects => generated 361 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:38.397788 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095b5fd-76fc-4ef8-9ba0-30d836431b51 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:38.401852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:38.408583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7095b5fd-76fc-4ef8-9ba0-30d836431b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:38.495517 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095b5fd-76fc-4ef8-9ba0-30d836431b51 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:38.500108 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546035a-6db3-44a0-b6d2-1e3d6b4322b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:38.500889 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546035a-6db3-44a0-b6d2-1e3d6b4322b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:38.501249 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546035a-6db3-44a0-b6d2-1e3d6b4322b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:38.501617 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546035a-6db3-44a0-b6d2-1e3d6b4322b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:38.502268 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546035a-6db3-44a0-b6d2-1e3d6b4322b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:38.504227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546035a-6db3-44a0-b6d2-1e3d6b4322b8 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:38.551965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-584b0c47-90b5-4b43-b077-b33263ccd7bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e1c8892a0b24d2690ba3fdd96e8d2d0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.592043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-584b0c47-90b5-4b43-b077-b33263ccd7bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e1c8892a0b24d2690ba3fdd96e8d2d0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.594855 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-584b0c47-90b5-4b43-b077-b33263ccd7bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e1c8892a0b24d2690ba3fdd96e8d2d0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.660481 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1004/1965] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:38 2022] POST /identity/v3/users => generated 281 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:38.660481 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546035a-6db3-44a0-b6d2-1e3d6b4322b8 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:38.660481 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7546035a-6db3-44a0-b6d2-1e3d6b4322b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:38.674735 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546035a-6db3-44a0-b6d2-1e3d6b4322b8 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:38.680312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc140e-e9b3-4e93-b44b-cff9970f0102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:38.681239 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc140e-e9b3-4e93-b44b-cff9970f0102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:38.681591 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc140e-e9b3-4e93-b44b-cff9970f0102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:38.683823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc140e-e9b3-4e93-b44b-cff9970f0102 admin admin] PATH_INFO: `/v3/projects/5255720b7c2340eba4e02970d20e918d` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:38.687600 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc140e-e9b3-4e93-b44b-cff9970f0102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5255720b7c2340eba4e02970d20e918d)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:38.687600 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc140e-e9b3-4e93-b44b-cff9970f0102 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:38.739600 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-584b0c47-90b5-4b43-b077-b33263ccd7bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e1c8892a0b24d2690ba3fdd96e8d2d0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.750707 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-584b0c47-90b5-4b43-b077-b33263ccd7bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e1c8892a0b24d2690ba3fdd96e8d2d0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.751458 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 962/1966] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:38 2022] DELETE /identity/v3/users/6e1c8892a0b24d2690ba3fdd96e8d2d0 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:38.755376 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b0c47-90b5-4b43-b077-b33263ccd7bd admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:38.757184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-584b0c47-90b5-4b43-b077-b33263ccd7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:38.848425 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-50bc140e-e9b3-4e93-b44b-cff9970f0102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5255720b7c2340eba4e02970d20e918d', 'request_id': 'req-50bc140e-e9b3-4e93-b44b-cff9970f0102'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.860088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b0c47-90b5-4b43-b077-b33263ccd7bd admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:38.924479 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b92485-91e8-40d4-adda-638b09388c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:38.925155 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b92485-91e8-40d4-adda-638b09388c0a admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:38.925440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b92485-91e8-40d4-adda-638b09388c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:38.925715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b92485-91e8-40d4-adda-638b09388c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:38.926488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b92485-91e8-40d4-adda-638b09388c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:38.928122 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b92485-91e8-40d4-adda-638b09388c0a admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:38.945571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 963/1967] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:38.945571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b92485-91e8-40d4-adda-638b09388c0a admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:38.955513 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b92485-91e8-40d4-adda-638b09388c0a admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:38.960184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b6665-a235-4f00-98c2-cff6e126f9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:38.960863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b6665-a235-4f00-98c2-cff6e126f9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:38.961146 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b6665-a235-4f00-98c2-cff6e126f9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:38.961421 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b6665-a235-4f00-98c2-cff6e126f9a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:38.962162 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b6665-a235-4f00-98c2-cff6e126f9a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:38.963867 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b6665-a235-4f00-98c2-cff6e126f9a5 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:38.974471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 964/1968] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:42:38.978585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b6665-a235-4f00-98c2-cff6e126f9a5 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:38.988284 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-50bc140e-e9b3-4e93-b44b-cff9970f0102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5255720b7c2340eba4e02970d20e918d', 'request_id': 'req-50bc140e-e9b3-4e93-b44b-cff9970f0102'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.990575 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b6665-a235-4f00-98c2-cff6e126f9a5 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:38.995854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-50bc140e-e9b3-4e93-b44b-cff9970f0102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5255720b7c2340eba4e02970d20e918d', 'request_id': 'req-50bc140e-e9b3-4e93-b44b-cff9970f0102'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:38.996327 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b221735-40d3-43a7-8404-8d759d6a19d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:38.998649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b221735-40d3-43a7-8404-8d759d6a19d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:38.998649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b221735-40d3-43a7-8404-8d759d6a19d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:38.998649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b221735-40d3-43a7-8404-8d759d6a19d9 admin admin] PATH_INFO: `/v3/projects/97794f49e1344f248f0a0c2c12a965b5/users/281cccfd02f9407baf30c2d85c887e23/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:39.016406 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b221735-40d3-43a7-8404-8d759d6a19d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97794f49e1344f248f0a0c2c12a965b5, user_id=281cccfd02f9407baf30c2d85c887e23, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:39.016648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-50bc140e-e9b3-4e93-b44b-cff9970f0102 admin admin] The token cache is being invalidate because project 5255720b7c2340eba4e02970d20e918d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:39.016736 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-50bc140e-e9b3-4e93-b44b-cff9970f0102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:39.017943 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-50bc140e-e9b3-4e93-b44b-cff9970f0102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:39.019124 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b221735-40d3-43a7-8404-8d759d6a19d9 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:39.022701 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1005/1969] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:38 2022] DELETE /identity/v3/projects/5255720b7c2340eba4e02970d20e918d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:39.024172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7668ae-1d75-4777-b347-3b5a114ca11a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:39.024459 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7668ae-1d75-4777-b347-3b5a114ca11a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:39.024734 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7668ae-1d75-4777-b347-3b5a114ca11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:39.044806 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-df7668ae-1d75-4777-b347-3b5a114ca11a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:39.046072 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-df7668ae-1d75-4777-b347-3b5a114ca11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:39.061592 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1006/1970] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:39.063753 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6bc65-30ad-435a-964b-77a7ffe1a6c9 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:39.069253 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6bc65-30ad-435a-964b-77a7ffe1a6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:39.069253 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6bc65-30ad-435a-964b-77a7ffe1a6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:39.093357 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-27b6bc65-30ad-435a-964b-77a7ffe1a6c9 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:39.094852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-27b6bc65-30ad-435a-964b-77a7ffe1a6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:39.107318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1007/1971] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:39.111546 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6bc65-30ad-435a-964b-77a7ffe1a6c9 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:39.125665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6bc65-30ad-435a-964b-77a7ffe1a6c9 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:39.139804 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4aa44-8a0f-4e55-9c6e-a6776ea5f377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:39.140734 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4aa44-8a0f-4e55-9c6e-a6776ea5f377 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:39.141364 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4aa44-8a0f-4e55-9c6e-a6776ea5f377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:39.150667 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4aa44-8a0f-4e55-9c6e-a6776ea5f377 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:39.150667 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4aa44-8a0f-4e55-9c6e-a6776ea5f377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:39.150667 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4aa44-8a0f-4e55-9c6e-a6776ea5f377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:39.150667 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4aa44-8a0f-4e55-9c6e-a6776ea5f377 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:39.178462 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1008/1972] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:42:39.187862 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 965/1973] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:38 2022] PUT /identity/v3/projects/97794f49e1344f248f0a0c2c12a965b5/users/281cccfd02f9407baf30c2d85c887e23/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:42:39.192849 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4aa44-8a0f-4e55-9c6e-a6776ea5f377 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:39.214746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f711d-df9c-40d7-ba1c-993de3f18406 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:39.215039 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f711d-df9c-40d7-ba1c-993de3f18406 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:39.215345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f711d-df9c-40d7-ba1c-993de3f18406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:39.226256 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4aa44-8a0f-4e55-9c6e-a6776ea5f377 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:39.246188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-d26f711d-df9c-40d7-ba1c-993de3f18406 None None] MFA Rules not processed for user `281cccfd02f9407baf30c2d85c887e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:39.247537 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-d26f711d-df9c-40d7-ba1c-993de3f18406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:39.369482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c0d58-7c00-4122-90b0-a9ce5e3b1c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:39.371386 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c0d58-7c00-4122-90b0-a9ce5e3b1c26 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:39.371842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c0d58-7c00-4122-90b0-a9ce5e3b1c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:39.372935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c0d58-7c00-4122-90b0-a9ce5e3b1c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:39.376297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c0d58-7c00-4122-90b0-a9ce5e3b1c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:39.379234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c0d58-7c00-4122-90b0-a9ce5e3b1c26 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:39.421245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 966/1974] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:39.457272 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f711d-df9c-40d7-ba1c-993de3f18406 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:39.458689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-d26f711d-df9c-40d7-ba1c-993de3f18406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:39.514491 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1009/1975] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:39 2022] POST /identity/v3/projects => generated 389 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:39.515469 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c0d58-7c00-4122-90b0-a9ce5e3b1c26 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:39.517501 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-2b1c0d58-7c00-4122-90b0-a9ce5e3b1c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:39.544453 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f711d-df9c-40d7-ba1c-993de3f18406 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:39.644667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc91a13-94a2-412a-8572-60d71c4c296d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:39.645448 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91a13-94a2-412a-8572-60d71c4c296d service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:39.645665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c0d58-7c00-4122-90b0-a9ce5e3b1c26 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:39.645818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91a13-94a2-412a-8572-60d71c4c296d service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:39.647640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91a13-94a2-412a-8572-60d71c4c296d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:39.652597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c6df1-e586-485c-8600-4e25fa7841ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:39.654592 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c6df1-e586-485c-8600-4e25fa7841ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:39.654892 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c6df1-e586-485c-8600-4e25fa7841ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:39.655176 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c6df1-e586-485c-8600-4e25fa7841ca admin admin] PATH_INFO: `/v3/projects/d49ccdc7beba4513905d5d9a8ce67372` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:39.660165 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c6df1-e586-485c-8600-4e25fa7841ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=d49ccdc7beba4513905d5d9a8ce67372)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:39.662210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c6df1-e586-485c-8600-4e25fa7841ca admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:39.736708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc91a13-94a2-412a-8572-60d71c4c296d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:39.739484 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc91a13-94a2-412a-8572-60d71c4c296d service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:39.759812 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 967/1976] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:42:39.762283 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc91a13-94a2-412a-8572-60d71c4c296d service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:39.785882 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc91a13-94a2-412a-8572-60d71c4c296d service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:39.801537 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779acdd7-c9c4-42a3-ac05-1bd4f5ecd31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:39.803583 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779acdd7-c9c4-42a3-ac05-1bd4f5ecd31e admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:39.806369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779acdd7-c9c4-42a3-ac05-1bd4f5ecd31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:39.806369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779acdd7-c9c4-42a3-ac05-1bd4f5ecd31e admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:39.806369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779acdd7-c9c4-42a3-ac05-1bd4f5ecd31e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:39.810263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779acdd7-c9c4-42a3-ac05-1bd4f5ecd31e admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:39.818357 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dc0c6df1-e586-485c-8600-4e25fa7841ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd49ccdc7beba4513905d5d9a8ce67372', 'request_id': 'req-dc0c6df1-e586-485c-8600-4e25fa7841ca'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:39.936088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 968/1977] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:39 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:39.936286 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dc0c6df1-e586-485c-8600-4e25fa7841ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd49ccdc7beba4513905d5d9a8ce67372', 'request_id': 'req-dc0c6df1-e586-485c-8600-4e25fa7841ca'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:39.936369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779acdd7-c9c4-42a3-ac05-1bd4f5ecd31e admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:39.937954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-779acdd7-c9c4-42a3-ac05-1bd4f5ecd31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:39.942818 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dc0c6df1-e586-485c-8600-4e25fa7841ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd49ccdc7beba4513905d5d9a8ce67372', 'request_id': 'req-dc0c6df1-e586-485c-8600-4e25fa7841ca'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:39.953235 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779acdd7-c9c4-42a3-ac05-1bd4f5ecd31e admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:39.957155 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:39.963028 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dc0c6df1-e586-485c-8600-4e25fa7841ca admin admin] The token cache is being invalidate because project d49ccdc7beba4513905d5d9a8ce67372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:39.963885 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dc0c6df1-e586-485c-8600-4e25fa7841ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:39.964575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dc0c6df1-e586-485c-8600-4e25fa7841ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:39.966465 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1010/1978] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:39 2022] DELETE /identity/v3/projects/d49ccdc7beba4513905d5d9a8ce67372 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:39.967630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c6df1-e586-485c-8600-4e25fa7841ca admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:39.969311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-dc0c6df1-e586-485c-8600-4e25fa7841ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:40.047758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6ea27-1f5c-4c63-91a2-5385f45df2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:40.048755 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6ea27-1f5c-4c63-91a2-5385f45df2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:40.049044 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6ea27-1f5c-4c63-91a2-5385f45df2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:40.049392 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6ea27-1f5c-4c63-91a2-5385f45df2d7 admin admin] PATH_INFO: `/v3/users/281cccfd02f9407baf30c2d85c887e23` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:40.051356 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6ea27-1f5c-4c63-91a2-5385f45df2d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=281cccfd02f9407baf30c2d85c887e23)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:40.054102 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6ea27-1f5c-4c63-91a2-5385f45df2d7 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:40.069930 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c6df1-e586-485c-8600-4e25fa7841ca admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:40.079769 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6634f2-91a0-4a1f-b0e9-921ac544826a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:40.080620 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6634f2-91a0-4a1f-b0e9-921ac544826a admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:40.091900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6634f2-91a0-4a1f-b0e9-921ac544826a admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:40.091900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6634f2-91a0-4a1f-b0e9-921ac544826a admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:40.091900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6634f2-91a0-4a1f-b0e9-921ac544826a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:40.091900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6634f2-91a0-4a1f-b0e9-921ac544826a admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:40.108038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1011/1979] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:40.109946 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff9967-9680-4759-8f24-40e479654065 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:40.110502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff9967-9680-4759-8f24-40e479654065 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:40.111390 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff9967-9680-4759-8f24-40e479654065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:40.142240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-17ff9967-9680-4759-8f24-40e479654065 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:40.144310 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-17ff9967-9680-4759-8f24-40e479654065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:40.155938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1012/1980] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:40.155938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff9967-9680-4759-8f24-40e479654065 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:40.168013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff9967-9680-4759-8f24-40e479654065 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:40.172980 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c446c1-f315-4bce-96bb-11330a7d8993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:40.173708 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c446c1-f315-4bce-96bb-11330a7d8993 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:40.173949 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c446c1-f315-4bce-96bb-11330a7d8993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:40.174283 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c446c1-f315-4bce-96bb-11330a7d8993 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:40.175025 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c446c1-f315-4bce-96bb-11330a7d8993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:40.176680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c446c1-f315-4bce-96bb-11330a7d8993 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:40.189198 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1013/1981] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:40.192762 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1538e-15c6-43d5-915d-0d62e72ea3a8 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:40.193294 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1538e-15c6-43d5-915d-0d62e72ea3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:40.193647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1538e-15c6-43d5-915d-0d62e72ea3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:40.214063 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-30c1538e-15c6-43d5-915d-0d62e72ea3a8 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:40.215304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-30c1538e-15c6-43d5-915d-0d62e72ea3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:40.223501 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1014/1982] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:40.224460 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1538e-15c6-43d5-915d-0d62e72ea3a8 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:40.238436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1538e-15c6-43d5-915d-0d62e72ea3a8 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:40.244092 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae2ab1-d1ec-4e60-9aa0-94f124623b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:40.246068 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae2ab1-d1ec-4e60-9aa0-94f124623b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:40.246448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae2ab1-d1ec-4e60-9aa0-94f124623b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:40.246659 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae2ab1-d1ec-4e60-9aa0-94f124623b2a admin admin] PATH_INFO: `/v3/projects/e327484b5a8f47c0a53c315921d26ca6/users/d13950b22ef0425d9bd2ea13022aa997/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:40.264621 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae2ab1-d1ec-4e60-9aa0-94f124623b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e327484b5a8f47c0a53c315921d26ca6, user_id=d13950b22ef0425d9bd2ea13022aa997, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:40.267401 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae2ab1-d1ec-4e60-9aa0-94f124623b2a admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:40.316052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-51c6ea27-1f5c-4c63-91a2-5385f45df2d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '281cccfd02f9407baf30c2d85c887e23'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:40.331650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-51c6ea27-1f5c-4c63-91a2-5385f45df2d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '281cccfd02f9407baf30c2d85c887e23'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:40.339757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-51c6ea27-1f5c-4c63-91a2-5385f45df2d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '281cccfd02f9407baf30c2d85c887e23'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:40.349111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1015/1983] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:40 2022] PUT /identity/v3/projects/e327484b5a8f47c0a53c315921d26ca6/users/d13950b22ef0425d9bd2ea13022aa997/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:40.350815 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae2ab1-d1ec-4e60-9aa0-94f124623b2a admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:40.435613 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-51c6ea27-1f5c-4c63-91a2-5385f45df2d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '281cccfd02f9407baf30c2d85c887e23'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:40.436481 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-51c6ea27-1f5c-4c63-91a2-5385f45df2d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '281cccfd02f9407baf30c2d85c887e23'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:40.444074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 969/1984] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:39 2022] DELETE /identity/v3/users/281cccfd02f9407baf30c2d85c887e23 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:40.445555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81638159-99c4-4f40-aea5-37e18bf9d676 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:40.445854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81638159-99c4-4f40-aea5-37e18bf9d676 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:40.446140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81638159-99c4-4f40-aea5-37e18bf9d676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:40.456733 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae2ab1-d1ec-4e60-9aa0-94f124623b2a admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:40.486723 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-81638159-99c4-4f40-aea5-37e18bf9d676 None None] MFA Rules not processed for user `d13950b22ef0425d9bd2ea13022aa997`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:40.493004 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-81638159-99c4-4f40-aea5-37e18bf9d676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:40.566510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1364b1-8294-447b-bc1d-24438dc2a113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:40.567542 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1364b1-8294-447b-bc1d-24438dc2a113 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:40.567974 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1364b1-8294-447b-bc1d-24438dc2a113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:40.568400 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1364b1-8294-447b-bc1d-24438dc2a113 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:40.569434 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1364b1-8294-447b-bc1d-24438dc2a113 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:40.569906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1364b1-8294-447b-bc1d-24438dc2a113 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:40.572229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1364b1-8294-447b-bc1d-24438dc2a113 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:40.591869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1016/1985] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:42:40.594010 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fae37-1739-4435-a483-9a1a45af1832 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:40.597928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fae37-1739-4435-a483-9a1a45af1832 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:40.597928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fae37-1739-4435-a483-9a1a45af1832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:40.613798 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:40.643066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 970/1986] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:40.643066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81638159-99c4-4f40-aea5-37e18bf9d676 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:40.648916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-81638159-99c4-4f40-aea5-37e18bf9d676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:40.653831 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-e67fae37-1739-4435-a483-9a1a45af1832 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:40.659714 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e67fae37-1739-4435-a483-9a1a45af1832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:40.672119 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81638159-99c4-4f40-aea5-37e18bf9d676 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:40.679915 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef90459-8e8e-4271-8e41-fd1f754deccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:40.680610 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef90459-8e8e-4271-8e41-fd1f754deccd admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:40.681031 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef90459-8e8e-4271-8e41-fd1f754deccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:40.685104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1017/1987] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:40.686570 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fae37-1739-4435-a483-9a1a45af1832 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:40.689806 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef90459-8e8e-4271-8e41-fd1f754deccd admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:40.690633 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef90459-8e8e-4271-8e41-fd1f754deccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:40.692167 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e67fae37-1739-4435-a483-9a1a45af1832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:40.692722 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef90459-8e8e-4271-8e41-fd1f754deccd admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:40.714683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fae37-1739-4435-a483-9a1a45af1832 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:40.722876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd2d41-e6f4-49e6-a376-3517323616e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:40.724136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd2d41-e6f4-49e6-a376-3517323616e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:40.724136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd2d41-e6f4-49e6-a376-3517323616e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:40.724326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd2d41-e6f4-49e6-a376-3517323616e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:40.725767 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd2d41-e6f4-49e6-a376-3517323616e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:40.728153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd2d41-e6f4-49e6-a376-3517323616e5 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:40.804152 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 971/1988] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:40 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:40.804152 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef90459-8e8e-4271-8e41-fd1f754deccd admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:40.804152 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-9ef90459-8e8e-4271-8e41-fd1f754deccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:40.831614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1018/1989] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:40 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:40.831614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd2d41-e6f4-49e6-a376-3517323616e5 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:40.880634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef90459-8e8e-4271-8e41-fd1f754deccd admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:40.903832 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd2d41-e6f4-49e6-a376-3517323616e5 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:40.910636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff8552-c0d9-4126-906b-ac9683fd7117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:40.911529 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff8552-c0d9-4126-906b-ac9683fd7117 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:40.911914 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff8552-c0d9-4126-906b-ac9683fd7117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:40.912442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff8552-c0d9-4126-906b-ac9683fd7117 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:40.913621 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff8552-c0d9-4126-906b-ac9683fd7117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:40.922530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff8552-c0d9-4126-906b-ac9683fd7117 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:40.947391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd4746-bbfa-4233-850c-2165d80ded2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:40.948681 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd4746-bbfa-4233-850c-2165d80ded2f service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:40.948961 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd4746-bbfa-4233-850c-2165d80ded2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:40.949242 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd4746-bbfa-4233-850c-2165d80ded2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:40.961946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd4746-bbfa-4233-850c-2165d80ded2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:40.963626 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd4746-bbfa-4233-850c-2165d80ded2f service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:40.973992 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 972/1990] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:40.974883 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd4746-bbfa-4233-850c-2165d80ded2f service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:40.985656 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd4746-bbfa-4233-850c-2165d80ded2f service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:40.990538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43d5c3-ff55-459a-be81-0a3894476857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:40.991240 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43d5c3-ff55-459a-be81-0a3894476857 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:40.991617 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43d5c3-ff55-459a-be81-0a3894476857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:40.991895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43d5c3-ff55-459a-be81-0a3894476857 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:40.992617 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43d5c3-ff55-459a-be81-0a3894476857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:40.995207 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43d5c3-ff55-459a-be81-0a3894476857 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:41.051656 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1019/1991] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:40 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:41.055989 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff8552-c0d9-4126-906b-ac9683fd7117 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:41.070907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff8552-c0d9-4126-906b-ac9683fd7117 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:41.078318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5ad3b-bff0-4f0e-b197-7e559167e78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:41.079018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5ad3b-bff0-4f0e-b197-7e559167e78e admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:41.079322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5ad3b-bff0-4f0e-b197-7e559167e78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:41.079609 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5ad3b-bff0-4f0e-b197-7e559167e78e admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:41.080356 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5ad3b-bff0-4f0e-b197-7e559167e78e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:41.082225 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5ad3b-bff0-4f0e-b197-7e559167e78e admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:41.100251 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1020/1992] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:41.101264 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5ad3b-bff0-4f0e-b197-7e559167e78e admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:41.114736 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5ad3b-bff0-4f0e-b197-7e559167e78e admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:41.129471 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd229ca8-d650-4aa6-9eb1-66aa7f621715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:41.130429 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd229ca8-d650-4aa6-9eb1-66aa7f621715 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:41.130639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd229ca8-d650-4aa6-9eb1-66aa7f621715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:41.130918 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd229ca8-d650-4aa6-9eb1-66aa7f621715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:41.131953 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd229ca8-d650-4aa6-9eb1-66aa7f621715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:41.133785 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd229ca8-d650-4aa6-9eb1-66aa7f621715 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:41.150662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 973/1993] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:40 2022] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:41.155194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43d5c3-ff55-459a-be81-0a3894476857 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:41.170667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43d5c3-ff55-459a-be81-0a3894476857 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:41.171429 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1021/1994] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:41.172562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd229ca8-d650-4aa6-9eb1-66aa7f621715 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:41.184501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131e69d-9529-4dce-bbc7-4b355fde07d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:41.185264 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131e69d-9529-4dce-bbc7-4b355fde07d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:41.185473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd229ca8-d650-4aa6-9eb1-66aa7f621715 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:41.185745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131e69d-9529-4dce-bbc7-4b355fde07d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:41.186609 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131e69d-9529-4dce-bbc7-4b355fde07d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:41.187176 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131e69d-9529-4dce-bbc7-4b355fde07d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:41.190674 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131e69d-9529-4dce-bbc7-4b355fde07d1 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:41.191067 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545c4ff-9ea6-406a-8c2a-abfdcabbe5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:41.192288 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545c4ff-9ea6-406a-8c2a-abfdcabbe5c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:41.193276 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545c4ff-9ea6-406a-8c2a-abfdcabbe5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:41.193756 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545c4ff-9ea6-406a-8c2a-abfdcabbe5c0 admin admin] PATH_INFO: `/v3/projects/04ed0d6f9a8e4fd8849f47813c9fad12/users/d8498d8c8b0146d1bb5165a213757369/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:41.207846 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 974/1995] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:41.211031 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131e69d-9529-4dce-bbc7-4b355fde07d1 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:41.220934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545c4ff-9ea6-406a-8c2a-abfdcabbe5c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ed0d6f9a8e4fd8849f47813c9fad12, user_id=d8498d8c8b0146d1bb5165a213757369, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:41.224290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545c4ff-9ea6-406a-8c2a-abfdcabbe5c0 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:41.225400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131e69d-9529-4dce-bbc7-4b355fde07d1 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:41.234624 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9a752-1d6d-4154-9790-2265631ef1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:41.235743 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9a752-1d6d-4154-9790-2265631ef1ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:41.236144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9a752-1d6d-4154-9790-2265631ef1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:41.236543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9a752-1d6d-4154-9790-2265631ef1ed admin admin] PATH_INFO: `/v3/projects/b7d2dea769ae414fad9c91439d3652fc/users/8a9a8eec87444c5193462c47e02f6b94/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:41.258254 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9a752-1d6d-4154-9790-2265631ef1ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d2dea769ae414fad9c91439d3652fc, user_id=8a9a8eec87444c5193462c47e02f6b94, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:41.261687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9a752-1d6d-4154-9790-2265631ef1ed admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:41.291187 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:41.291584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1022/1996] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:41 2022] PUT /identity/v3/projects/04ed0d6f9a8e4fd8849f47813c9fad12/users/d8498d8c8b0146d1bb5165a213757369/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:41.303032 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345614e9-ca20-4a3b-9f43-ac1767de5776 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:41.303550 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345614e9-ca20-4a3b-9f43-ac1767de5776 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:41.303907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345614e9-ca20-4a3b-9f43-ac1767de5776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:41.333846 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-345614e9-ca20-4a3b-9f43-ac1767de5776 None None] MFA Rules not processed for user `d8498d8c8b0146d1bb5165a213757369`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:41.335254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-345614e9-ca20-4a3b-9f43-ac1767de5776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:41.383450 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 975/1997] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:41 2022] PUT /identity/v3/projects/b7d2dea769ae414fad9c91439d3652fc/users/8a9a8eec87444c5193462c47e02f6b94/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:41.384848 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9a752-1d6d-4154-9790-2265631ef1ed admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:41.421747 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1023/1998] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:41.427362 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345614e9-ca20-4a3b-9f43-ac1767de5776 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:41.461784 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9a752-1d6d-4154-9790-2265631ef1ed admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:41.466978 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e239c2-12bd-4d94-bcfa-a2557b6eadc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:41.467689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e239c2-12bd-4d94-bcfa-a2557b6eadc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:41.467980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e239c2-12bd-4d94-bcfa-a2557b6eadc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:41.468262 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e239c2-12bd-4d94-bcfa-a2557b6eadc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:41.468997 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e239c2-12bd-4d94-bcfa-a2557b6eadc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:41.470623 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e239c2-12bd-4d94-bcfa-a2557b6eadc3 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:41.481612 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 976/1999] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:41.486063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e239c2-12bd-4d94-bcfa-a2557b6eadc3 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:41.497553 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e239c2-12bd-4d94-bcfa-a2557b6eadc3 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:41.497764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345614e9-ca20-4a3b-9f43-ac1767de5776 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:41.502579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e13ed0-2d62-4082-96c8-8f092db718fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:41.502704 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e9315-69c5-470f-a144-9e4edd08967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:41.503417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e13ed0-2d62-4082-96c8-8f092db718fc admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:41.503561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e9315-69c5-470f-a144-9e4edd08967c admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:41.503717 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e13ed0-2d62-4082-96c8-8f092db718fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:41.503853 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e9315-69c5-470f-a144-9e4edd08967c admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:41.503997 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e13ed0-2d62-4082-96c8-8f092db718fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:41.504136 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e9315-69c5-470f-a144-9e4edd08967c admin admin] PATH_INFO: `/v3/projects/b7d2dea769ae414fad9c91439d3652fc/users/8a9a8eec87444c5193462c47e02f6b94/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:41.504705 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e13ed0-2d62-4082-96c8-8f092db718fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:41.506452 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e9315-69c5-470f-a144-9e4edd08967c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d2dea769ae414fad9c91439d3652fc, user_id=8a9a8eec87444c5193462c47e02f6b94, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:41.506890 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e13ed0-2d62-4082-96c8-8f092db718fc admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:41.509157 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e9315-69c5-470f-a144-9e4edd08967c admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:41.520313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 977/2000] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:41 2022] PUT /identity/v3/projects/b7d2dea769ae414fad9c91439d3652fc/users/8a9a8eec87444c5193462c47e02f6b94/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:42:41.531750 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e9315-69c5-470f-a144-9e4edd08967c admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:41.533609 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-917e9315-69c5-470f-a144-9e4edd08967c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:41.608784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1024/2001] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:41 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:42:41.610007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393d315-d654-49f0-8bf3-97b08b134c7f None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:41.610295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393d315-d654-49f0-8bf3-97b08b134c7f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:41.610570 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393d315-d654-49f0-8bf3-97b08b134c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:41.612776 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e9315-69c5-470f-a144-9e4edd08967c admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:41.638134 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-b393d315-d654-49f0-8bf3-97b08b134c7f None None] MFA Rules not processed for user `8a9a8eec87444c5193462c47e02f6b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:41.639415 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b393d315-d654-49f0-8bf3-97b08b134c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:41.681520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f279c69-89f9-4f4b-9aee-cbfbd4e642f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:41.683623 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f279c69-89f9-4f4b-9aee-cbfbd4e642f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:41.683922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f279c69-89f9-4f4b-9aee-cbfbd4e642f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:41.684210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f279c69-89f9-4f4b-9aee-cbfbd4e642f8 admin admin] PATH_INFO: `/v3/projects/97794f49e1344f248f0a0c2c12a965b5` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:41.685579 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f279c69-89f9-4f4b-9aee-cbfbd4e642f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97794f49e1344f248f0a0c2c12a965b5)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:41.687618 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f279c69-89f9-4f4b-9aee-cbfbd4e642f8 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:41.718963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1025/2002] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:41.723404 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393d315-d654-49f0-8bf3-97b08b134c7f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:41.740148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393d315-d654-49f0-8bf3-97b08b134c7f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:41.746422 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594fb6f-6a52-4dff-aa81-4e3c69e62ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:41.747179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594fb6f-6a52-4dff-aa81-4e3c69e62ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:41.747439 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594fb6f-6a52-4dff-aa81-4e3c69e62ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:41.747725 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594fb6f-6a52-4dff-aa81-4e3c69e62ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:41.748443 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594fb6f-6a52-4dff-aa81-4e3c69e62ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:41.750382 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594fb6f-6a52-4dff-aa81-4e3c69e62ed2 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:41.824044 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6f279c69-89f9-4f4b-9aee-cbfbd4e642f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97794f49e1344f248f0a0c2c12a965b5', 'request_id': 'req-6f279c69-89f9-4f4b-9aee-cbfbd4e642f8'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:41.836548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6f279c69-89f9-4f4b-9aee-cbfbd4e642f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97794f49e1344f248f0a0c2c12a965b5', 'request_id': 'req-6f279c69-89f9-4f4b-9aee-cbfbd4e642f8'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:41.837784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1026/2003] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:41 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:41.837933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594fb6f-6a52-4dff-aa81-4e3c69e62ed2 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:41.840919 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7594fb6f-6a52-4dff-aa81-4e3c69e62ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:41.844739 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6f279c69-89f9-4f4b-9aee-cbfbd4e642f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97794f49e1344f248f0a0c2c12a965b5', 'request_id': 'req-6f279c69-89f9-4f4b-9aee-cbfbd4e642f8'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:41.913439 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594fb6f-6a52-4dff-aa81-4e3c69e62ed2 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:41.940005 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6f279c69-89f9-4f4b-9aee-cbfbd4e642f8 admin admin] The token cache is being invalidate because project 97794f49e1344f248f0a0c2c12a965b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:41.940439 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6f279c69-89f9-4f4b-9aee-cbfbd4e642f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:41.941216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6f279c69-89f9-4f4b-9aee-cbfbd4e642f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:41.943466 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 978/2004] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:41 2022] DELETE /identity/v3/projects/97794f49e1344f248f0a0c2c12a965b5 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:42:41.944314 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f279c69-89f9-4f4b-9aee-cbfbd4e642f8 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:41.947769 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-6f279c69-89f9-4f4b-9aee-cbfbd4e642f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:41.966335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:41.978389 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba0d49-1dbf-4633-a749-335d33a6b837 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:41.980560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba0d49-1dbf-4633-a749-335d33a6b837 service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:41.980560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba0d49-1dbf-4633-a749-335d33a6b837 service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:41.980560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba0d49-1dbf-4633-a749-335d33a6b837 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:41.983747 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1fba0d49-1dbf-4633-a749-335d33a6b837 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:42.031676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f279c69-89f9-4f4b-9aee-cbfbd4e642f8 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:42.037240 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd36a6-3dc8-4fae-a4c7-9c1a2fd9a0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:42.043136 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd36a6-3dc8-4fae-a4c7-9c1a2fd9a0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:42.043136 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd36a6-3dc8-4fae-a4c7-9c1a2fd9a0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:42.043136 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd36a6-3dc8-4fae-a4c7-9c1a2fd9a0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:42.043136 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd36a6-3dc8-4fae-a4c7-9c1a2fd9a0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:42.043136 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd36a6-3dc8-4fae-a4c7-9c1a2fd9a0c1 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:42.056652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 979/2005] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:42.058727 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545eab6-bc93-4329-a346-7b8f2d474aeb None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:42.059142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545eab6-bc93-4329-a346-7b8f2d474aeb None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:42.059543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545eab6-bc93-4329-a346-7b8f2d474aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:42.079589 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba0d49-1dbf-4633-a749-335d33a6b837 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:42.080390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-e545eab6-bc93-4329-a346-7b8f2d474aeb None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:42.081184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba0d49-1dbf-4633-a749-335d33a6b837 service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:42.081609 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-e545eab6-bc93-4329-a346-7b8f2d474aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:42.090805 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 980/2006] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:42.091761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545eab6-bc93-4329-a346-7b8f2d474aeb None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:42.094386 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1027/2007] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:42.100186 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cc031-f44a-48be-b4d8-c3342aeab526 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:42.100472 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cc031-f44a-48be-b4d8-c3342aeab526 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:42.100765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cc031-f44a-48be-b4d8-c3342aeab526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:42.103621 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:42.109962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545eab6-bc93-4329-a346-7b8f2d474aeb None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:42.117392 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f2f54-93d8-4066-bd69-dd064f1cbc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:42.118954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f2f54-93d8-4066-bd69-dd064f1cbc23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:42.120004 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f2f54-93d8-4066-bd69-dd064f1cbc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:42.120557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f2f54-93d8-4066-bd69-dd064f1cbc23 admin admin] PATH_INFO: `/v3/projects/22e37ccc1db142279d095f767b694e41/users/1bb667b12f784a7aac6179553f1404fd/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:42.133621 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-b89cc031-f44a-48be-b4d8-c3342aeab526 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:42.141973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b89cc031-f44a-48be-b4d8-c3342aeab526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:42.142071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f2f54-93d8-4066-bd69-dd064f1cbc23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e37ccc1db142279d095f767b694e41, user_id=1bb667b12f784a7aac6179553f1404fd, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:42.143453 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f2f54-93d8-4066-bd69-dd064f1cbc23 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:42.153685 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1028/2008] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:42:42.155989 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cc031-f44a-48be-b4d8-c3342aeab526 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:42.162852 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:42.166517 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cc031-f44a-48be-b4d8-c3342aeab526 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:42.171608 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a16462-f623-498d-bf40-7c583ccd7714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:42.172329 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a16462-f623-498d-bf40-7c583ccd7714 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:42.172612 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a16462-f623-498d-bf40-7c583ccd7714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:42.172891 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a16462-f623-498d-bf40-7c583ccd7714 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:42.173625 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a16462-f623-498d-bf40-7c583ccd7714 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:42.173934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a16462-f623-498d-bf40-7c583ccd7714 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:42.176011 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a16462-f623-498d-bf40-7c583ccd7714 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:42.191325 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1029/2009] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:42:42.198828 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a16462-f623-498d-bf40-7c583ccd7714 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:42.212455 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a16462-f623-498d-bf40-7c583ccd7714 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:42.218081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cc879-99dd-47eb-8123-aa1b0f6d18cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:42.224246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cc879-99dd-47eb-8123-aa1b0f6d18cb admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:42.224246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cc879-99dd-47eb-8123-aa1b0f6d18cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:42.224246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cc879-99dd-47eb-8123-aa1b0f6d18cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:42.224246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cc879-99dd-47eb-8123-aa1b0f6d18cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:42.224246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cc879-99dd-47eb-8123-aa1b0f6d18cb admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:42.226791 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 981/2010] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:42 2022] PUT /identity/v3/projects/22e37ccc1db142279d095f767b694e41/users/1bb667b12f784a7aac6179553f1404fd/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:42.231686 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f2f54-93d8-4066-bd69-dd064f1cbc23 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:42.243291 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:42.306684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f2f54-93d8-4066-bd69-dd064f1cbc23 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:42.312003 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8d63e-4eaa-4289-903d-a74fbdffbc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:42.312679 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8d63e-4eaa-4289-903d-a74fbdffbc94 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:42.312964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8d63e-4eaa-4289-903d-a74fbdffbc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:42.313243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8d63e-4eaa-4289-903d-a74fbdffbc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:42.313975 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8d63e-4eaa-4289-903d-a74fbdffbc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:42.315608 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8d63e-4eaa-4289-903d-a74fbdffbc94 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:42.326842 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 982/2011] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:42:42.327992 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8d63e-4eaa-4289-903d-a74fbdffbc94 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:42.332964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-36b8d63e-4eaa-4289-903d-a74fbdffbc94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:42.345789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8d63e-4eaa-4289-903d-a74fbdffbc94 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:42.350417 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968e0eb-0644-47c7-85d4-a18ba6d771e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:42.351299 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968e0eb-0644-47c7-85d4-a18ba6d771e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:42.351608 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968e0eb-0644-47c7-85d4-a18ba6d771e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:42.351888 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968e0eb-0644-47c7-85d4-a18ba6d771e4 admin admin] PATH_INFO: `/v3/users/d13950b22ef0425d9bd2ea13022aa997` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:42.353105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968e0eb-0644-47c7-85d4-a18ba6d771e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d13950b22ef0425d9bd2ea13022aa997)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:42.355301 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968e0eb-0644-47c7-85d4-a18ba6d771e4 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:42.358686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1030/2012] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:42 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:42.360776 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cc879-99dd-47eb-8123-aa1b0f6d18cb admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:42.444163 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:42.462408 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cc879-99dd-47eb-8123-aa1b0f6d18cb admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:42.468361 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f1200-f085-4081-87c9-0087662278bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:42.469895 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f1200-f085-4081-87c9-0087662278bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:42.469895 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f1200-f085-4081-87c9-0087662278bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:42.470199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f1200-f085-4081-87c9-0087662278bc admin admin] PATH_INFO: `/v3/projects/22e37ccc1db142279d095f767b694e41/users/1bb667b12f784a7aac6179553f1404fd/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:42.472839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f1200-f085-4081-87c9-0087662278bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e37ccc1db142279d095f767b694e41, user_id=1bb667b12f784a7aac6179553f1404fd, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:42.476452 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f1200-f085-4081-87c9-0087662278bc admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:42.489533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1031/2013] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:42 2022] PUT /identity/v3/projects/22e37ccc1db142279d095f767b694e41/users/1bb667b12f784a7aac6179553f1404fd/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:42.490543 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f1200-f085-4081-87c9-0087662278bc admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:42.584875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f1200-f085-4081-87c9-0087662278bc admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:42.598918 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:42.600015 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91122bc1-7a8b-4562-b191-5669cb42cac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:42.600911 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91122bc1-7a8b-4562-b191-5669cb42cac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:42.601299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91122bc1-7a8b-4562-b191-5669cb42cac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:42.601683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91122bc1-7a8b-4562-b191-5669cb42cac8 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:42.602637 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91122bc1-7a8b-4562-b191-5669cb42cac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:42.606774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91122bc1-7a8b-4562-b191-5669cb42cac8 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:42.611158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8968e0eb-0644-47c7-85d4-a18ba6d771e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd13950b22ef0425d9bd2ea13022aa997'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:42.625977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8968e0eb-0644-47c7-85d4-a18ba6d771e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd13950b22ef0425d9bd2ea13022aa997'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:42.634156 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8968e0eb-0644-47c7-85d4-a18ba6d771e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd13950b22ef0425d9bd2ea13022aa997'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:42.723130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1032/2014] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:42 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:42.723130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0eabe-295b-49d6-933b-19de161dda44 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:42.723130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0eabe-295b-49d6-933b-19de161dda44 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:42.723130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0eabe-295b-49d6-933b-19de161dda44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:42.739584 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8968e0eb-0644-47c7-85d4-a18ba6d771e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd13950b22ef0425d9bd2ea13022aa997'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:42.740324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8968e0eb-0644-47c7-85d4-a18ba6d771e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd13950b22ef0425d9bd2ea13022aa997'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:42.755439 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 983/2015] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:42 2022] DELETE /identity/v3/users/d13950b22ef0425d9bd2ea13022aa997 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:42.757366 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968e0eb-0644-47c7-85d4-a18ba6d771e4 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:42.759820 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-8968e0eb-0644-47c7-85d4-a18ba6d771e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:42.766849 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-55e0eabe-295b-49d6-933b-19de161dda44 None None] MFA Rules not processed for user `1bb667b12f784a7aac6179553f1404fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:42.768110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-55e0eabe-295b-49d6-933b-19de161dda44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:42.825875 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:42.852903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968e0eb-0644-47c7-85d4-a18ba6d771e4 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:42.862934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85cae7-73ac-41f1-8a34-dae0afe647e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:42.863753 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85cae7-73ac-41f1-8a34-dae0afe647e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:42.864099 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85cae7-73ac-41f1-8a34-dae0afe647e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:42.864382 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85cae7-73ac-41f1-8a34-dae0afe647e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:42.865130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85cae7-73ac-41f1-8a34-dae0afe647e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:42.866789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85cae7-73ac-41f1-8a34-dae0afe647e6 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:42.868903 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1033/2016] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:42.871427 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425a038-53fb-441d-9b23-9edab81d1169 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:42.872100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425a038-53fb-441d-9b23-9edab81d1169 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:42.872584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425a038-53fb-441d-9b23-9edab81d1169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:42.882000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 984/2017] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:42.889281 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85cae7-73ac-41f1-8a34-dae0afe647e6 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:42.901781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85cae7-73ac-41f1-8a34-dae0afe647e6 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:42.905046 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-0425a038-53fb-441d-9b23-9edab81d1169 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:42.906868 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0425a038-53fb-441d-9b23-9edab81d1169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:42.912549 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:42.914050 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d847f0d-f94d-426c-bb2a-938f6966314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:42.914841 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d847f0d-f94d-426c-bb2a-938f6966314a admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:42.915377 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d847f0d-f94d-426c-bb2a-938f6966314a admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:42.915934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d847f0d-f94d-426c-bb2a-938f6966314a admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:42.916925 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d847f0d-f94d-426c-bb2a-938f6966314a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:42.918949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d847f0d-f94d-426c-bb2a-938f6966314a admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:42.919769 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1034/2018] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:42.921054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425a038-53fb-441d-9b23-9edab81d1169 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:42.922479 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0425a038-53fb-441d-9b23-9edab81d1169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:42.951721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 985/2019] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:42.951721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d847f0d-f94d-426c-bb2a-938f6966314a admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:42.958076 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-9d847f0d-f94d-426c-bb2a-938f6966314a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:43.018780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425a038-53fb-441d-9b23-9edab81d1169 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:43.023836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0822e-4867-4938-bd6e-28f4ba91ad4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:43.024628 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0822e-4867-4938-bd6e-28f4ba91ad4b service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:43.024977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0822e-4867-4938-bd6e-28f4ba91ad4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:43.025318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0822e-4867-4938-bd6e-28f4ba91ad4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:43.028301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-90a0822e-4867-4938-bd6e-28f4ba91ad4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:43.042227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d847f0d-f94d-426c-bb2a-938f6966314a admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:43.046678 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bd5cb-d8a4-4cf8-86a2-a53aee115597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:43.047585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bd5cb-d8a4-4cf8-86a2-a53aee115597 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:43.048237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bd5cb-d8a4-4cf8-86a2-a53aee115597 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:43.048958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bd5cb-d8a4-4cf8-86a2-a53aee115597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:43.061630 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bd5cb-d8a4-4cf8-86a2-a53aee115597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:43.063849 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bd5cb-d8a4-4cf8-86a2-a53aee115597 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:43.088180 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 986/2020] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:43.089446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bd5cb-d8a4-4cf8-86a2-a53aee115597 service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:43.102187 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bd5cb-d8a4-4cf8-86a2-a53aee115597 service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:43.108085 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99d9d0-ed8c-43d4-883d-1029e3ee6220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:43.109252 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99d9d0-ed8c-43d4-883d-1029e3ee6220 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:43.109611 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99d9d0-ed8c-43d4-883d-1029e3ee6220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:43.109959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99d9d0-ed8c-43d4-883d-1029e3ee6220 admin admin] PATH_INFO: `/v3/projects/ef55b66bd11a49a7b794e22d74e1ab0b/users/8ba1d4a50fb94ee59189dbf835973e0a/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:43.110299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0822e-4867-4938-bd6e-28f4ba91ad4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:43.111865 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0822e-4867-4938-bd6e-28f4ba91ad4b service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:43.124558 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1035/2021] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:43.137216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99d9d0-ed8c-43d4-883d-1029e3ee6220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef55b66bd11a49a7b794e22d74e1ab0b, user_id=8ba1d4a50fb94ee59189dbf835973e0a, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:43.140623 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99d9d0-ed8c-43d4-883d-1029e3ee6220 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:43.152266 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:43.214971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 987/2022] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:43 2022] PUT /identity/v3/projects/ef55b66bd11a49a7b794e22d74e1ab0b/users/8ba1d4a50fb94ee59189dbf835973e0a/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:43.225145 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef89877-2785-4295-9c8b-3b7e330d862c None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:43.225663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef89877-2785-4295-9c8b-3b7e330d862c None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:43.226097 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef89877-2785-4295-9c8b-3b7e330d862c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:43.263457 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-cef89877-2785-4295-9c8b-3b7e330d862c None None] MFA Rules not processed for user `8ba1d4a50fb94ee59189dbf835973e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:43.265392 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-cef89877-2785-4295-9c8b-3b7e330d862c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:43.286533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:43.342317 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1036/2023] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:43.347110 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99d9d0-ed8c-43d4-883d-1029e3ee6220 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:43.461888 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99d9d0-ed8c-43d4-883d-1029e3ee6220 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:43.478201 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb789be-fbb1-4a8a-b5c5-baf828e965cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:43.480872 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb789be-fbb1-4a8a-b5c5-baf828e965cd admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:43.481359 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb789be-fbb1-4a8a-b5c5-baf828e965cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:43.481651 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb789be-fbb1-4a8a-b5c5-baf828e965cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:43.482392 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb789be-fbb1-4a8a-b5c5-baf828e965cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:43.484582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb789be-fbb1-4a8a-b5c5-baf828e965cd admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:43.561503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:43.590786 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 988/2024] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:43 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:43.594741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef89877-2785-4295-9c8b-3b7e330d862c None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:43.606135 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef89877-2785-4295-9c8b-3b7e330d862c None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:43.665209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb789be-fbb1-4a8a-b5c5-baf828e965cd admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:43.668392 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ecb789be-fbb1-4a8a-b5c5-baf828e965cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:43.674420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03978b-0313-4126-aac2-21d4c2c53388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:43.675396 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03978b-0313-4126-aac2-21d4c2c53388 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:43.675761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03978b-0313-4126-aac2-21d4c2c53388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:43.676094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03978b-0313-4126-aac2-21d4c2c53388 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:43.676902 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03978b-0313-4126-aac2-21d4c2c53388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:43.679144 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03978b-0313-4126-aac2-21d4c2c53388 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:43.695086 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb789be-fbb1-4a8a-b5c5-baf828e965cd admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:43.701535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224251e-03a3-46c3-8a40-fd8829014015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:43.702456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224251e-03a3-46c3-8a40-fd8829014015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:43.702746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224251e-03a3-46c3-8a40-fd8829014015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:43.703029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224251e-03a3-46c3-8a40-fd8829014015 admin admin] PATH_INFO: `/v3/projects/e327484b5a8f47c0a53c315921d26ca6` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:43.704278 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224251e-03a3-46c3-8a40-fd8829014015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e327484b5a8f47c0a53c315921d26ca6)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:43.706228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224251e-03a3-46c3-8a40-fd8829014015 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:43.774974 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1037/2025] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:43 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:43.777870 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03978b-0313-4126-aac2-21d4c2c53388 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:43.789083 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03978b-0313-4126-aac2-21d4c2c53388 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:43.796576 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418c59d-8e29-4694-b544-1abbc7f5ef0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:43.797253 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418c59d-8e29-4694-b544-1abbc7f5ef0a admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:43.797557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418c59d-8e29-4694-b544-1abbc7f5ef0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:43.797847 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418c59d-8e29-4694-b544-1abbc7f5ef0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:43.798585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418c59d-8e29-4694-b544-1abbc7f5ef0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:43.803777 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418c59d-8e29-4694-b544-1abbc7f5ef0a admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:43.811232 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1038/2026] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:43.815189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418c59d-8e29-4694-b544-1abbc7f5ef0a admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:43.829262 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418c59d-8e29-4694-b544-1abbc7f5ef0a admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:43.836266 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d2230-49de-4528-bc14-6e7cd0b2b981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:43.836266 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d2230-49de-4528-bc14-6e7cd0b2b981 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:43.836857 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d2230-49de-4528-bc14-6e7cd0b2b981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:43.837219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d2230-49de-4528-bc14-6e7cd0b2b981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:43.838032 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d2230-49de-4528-bc14-6e7cd0b2b981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:43.840630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d2230-49de-4528-bc14-6e7cd0b2b981 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:43.853625 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1039/2027] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:43.857909 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d2230-49de-4528-bc14-6e7cd0b2b981 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:43.885013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d2230-49de-4528-bc14-6e7cd0b2b981 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:43.920057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7eb23-c1e1-4341-9fb5-0bb2f06ea469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:43.922846 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7eb23-c1e1-4341-9fb5-0bb2f06ea469 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:43.923261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7eb23-c1e1-4341-9fb5-0bb2f06ea469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:43.923714 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7eb23-c1e1-4341-9fb5-0bb2f06ea469 admin admin] PATH_INFO: `/v3/projects/aee66891254a4b7db16138718930c0a5/users/ffa32afd39cf4d62aa3e1936d8508827/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:43.931461 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-3224251e-03a3-46c3-8a40-fd8829014015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e327484b5a8f47c0a53c315921d26ca6', 'request_id': 'req-3224251e-03a3-46c3-8a40-fd8829014015'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:43.938816 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-3224251e-03a3-46c3-8a40-fd8829014015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e327484b5a8f47c0a53c315921d26ca6', 'request_id': 'req-3224251e-03a3-46c3-8a40-fd8829014015'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:43.945981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7eb23-c1e1-4341-9fb5-0bb2f06ea469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee66891254a4b7db16138718930c0a5, user_id=ffa32afd39cf4d62aa3e1936d8508827, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:43.948253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-3224251e-03a3-46c3-8a40-fd8829014015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e327484b5a8f47c0a53c315921d26ca6', 'request_id': 'req-3224251e-03a3-46c3-8a40-fd8829014015'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:43.953895 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7eb23-c1e1-4341-9fb5-0bb2f06ea469 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:44.047085 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-3224251e-03a3-46c3-8a40-fd8829014015 admin admin] The token cache is being invalidate because project e327484b5a8f47c0a53c315921d26ca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:44.047410 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-3224251e-03a3-46c3-8a40-fd8829014015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:44.048125 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-3224251e-03a3-46c3-8a40-fd8829014015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:44.049697 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 989/2028] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:43 2022] DELETE /identity/v3/projects/e327484b5a8f47c0a53c315921d26ca6 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:44.053532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224251e-03a3-46c3-8a40-fd8829014015 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:44.055084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-3224251e-03a3-46c3-8a40-fd8829014015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:44.124640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224251e-03a3-46c3-8a40-fd8829014015 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:44.125558 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1040/2029] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:43 2022] PUT /identity/v3/projects/aee66891254a4b7db16138718930c0a5/users/ffa32afd39cf4d62aa3e1936d8508827/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:44.136605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2776237-396a-4391-9ecf-45e2dff53143 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:44.136922 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2776237-396a-4391-9ecf-45e2dff53143 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:44.137253 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2776237-396a-4391-9ecf-45e2dff53143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:44.171483 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-a2776237-396a-4391-9ecf-45e2dff53143 None None] MFA Rules not processed for user `ffa32afd39cf4d62aa3e1936d8508827`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:44.172761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a2776237-396a-4391-9ecf-45e2dff53143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:44.194761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab7d16-3bc7-4e11-9031-a1c73cd8f36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:44.195971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab7d16-3bc7-4e11-9031-a1c73cd8f36d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:44.196430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab7d16-3bc7-4e11-9031-a1c73cd8f36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:44.196715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab7d16-3bc7-4e11-9031-a1c73cd8f36d admin admin] PATH_INFO: `/v3/users/8a9a8eec87444c5193462c47e02f6b94` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:44.199002 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab7d16-3bc7-4e11-9031-a1c73cd8f36d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a9a8eec87444c5193462c47e02f6b94)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:44.201481 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab7d16-3bc7-4e11-9031-a1c73cd8f36d admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:44.250929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1041/2030] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:42:44.255451 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2776237-396a-4391-9ecf-45e2dff53143 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:44.257473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a2776237-396a-4391-9ecf-45e2dff53143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:44.274555 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:44.280398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2776237-396a-4391-9ecf-45e2dff53143 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:44.286244 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f566a1-1c38-4411-aeb9-18c5ead52f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:44.288046 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f566a1-1c38-4411-aeb9-18c5ead52f31 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:44.288046 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f566a1-1c38-4411-aeb9-18c5ead52f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:44.288046 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f566a1-1c38-4411-aeb9-18c5ead52f31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:44.290035 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f566a1-1c38-4411-aeb9-18c5ead52f31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:44.290299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f566a1-1c38-4411-aeb9-18c5ead52f31 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:44.391931 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1042/2031] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:44 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:42:44.395027 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f566a1-1c38-4411-aeb9-18c5ead52f31 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:44.425052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-94ab7d16-3bc7-4e11-9031-a1c73cd8f36d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a9a8eec87444c5193462c47e02f6b94'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:44.444465 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-94ab7d16-3bc7-4e11-9031-a1c73cd8f36d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a9a8eec87444c5193462c47e02f6b94'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:44.452132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-94ab7d16-3bc7-4e11-9031-a1c73cd8f36d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a9a8eec87444c5193462c47e02f6b94'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:44.462094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f566a1-1c38-4411-aeb9-18c5ead52f31 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:44.467042 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b797b-dd25-42b0-9a44-0808af49da64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:44.467761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b797b-dd25-42b0-9a44-0808af49da64 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:44.468041 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b797b-dd25-42b0-9a44-0808af49da64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:44.468317 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b797b-dd25-42b0-9a44-0808af49da64 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:44.469022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b797b-dd25-42b0-9a44-0808af49da64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:44.470953 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b797b-dd25-42b0-9a44-0808af49da64 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:44.533852 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-94ab7d16-3bc7-4e11-9031-a1c73cd8f36d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a9a8eec87444c5193462c47e02f6b94'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:44.534622 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-94ab7d16-3bc7-4e11-9031-a1c73cd8f36d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a9a8eec87444c5193462c47e02f6b94'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:44.541533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 990/2032] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:44 2022] DELETE /identity/v3/users/8a9a8eec87444c5193462c47e02f6b94 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:44.571882 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1043/2033] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:44 2022] POST /identity/v3/users => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:42:44.576517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab7d16-3bc7-4e11-9031-a1c73cd8f36d admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:44.577955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-94ab7d16-3bc7-4e11-9031-a1c73cd8f36d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:44.664662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab7d16-3bc7-4e11-9031-a1c73cd8f36d admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:44.669318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc967977-9397-4efb-a34b-914b086808fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:44.669990 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc967977-9397-4efb-a34b-914b086808fa admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:44.670273 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc967977-9397-4efb-a34b-914b086808fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:44.670549 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc967977-9397-4efb-a34b-914b086808fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:44.672709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc967977-9397-4efb-a34b-914b086808fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:44.672948 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc967977-9397-4efb-a34b-914b086808fa admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:44.684085 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 991/2034] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:44.688424 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b797b-dd25-42b0-9a44-0808af49da64 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:44.699430 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b797b-dd25-42b0-9a44-0808af49da64 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:44.704127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72c184-eb7d-436f-b234-5fda4480d09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:44.705048 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72c184-eb7d-436f-b234-5fda4480d09a admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:44.705324 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72c184-eb7d-436f-b234-5fda4480d09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:44.705593 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72c184-eb7d-436f-b234-5fda4480d09a admin admin] PATH_INFO: `/v3/projects/e00c329573b946a39081a7883d219d10/users/fb659e0219514a028a6314af73790a11/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:44.721229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72c184-eb7d-436f-b234-5fda4480d09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00c329573b946a39081a7883d219d10, user_id=fb659e0219514a028a6314af73790a11, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:44.724148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72c184-eb7d-436f-b234-5fda4480d09a admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:44.909663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1044/2035] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:44 2022] PUT /identity/v3/projects/e00c329573b946a39081a7883d219d10/users/fb659e0219514a028a6314af73790a11/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:42:44.913927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc967977-9397-4efb-a34b-914b086808fa admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:44.924064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc967977-9397-4efb-a34b-914b086808fa admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:44.991754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e6303-2081-42a3-b347-c308db643663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:44.991754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e6303-2081-42a3-b347-c308db643663 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:44.992085 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e6303-2081-42a3-b347-c308db643663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:44.992177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e6303-2081-42a3-b347-c308db643663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:44.993015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e6303-2081-42a3-b347-c308db643663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:44.994852 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e6303-2081-42a3-b347-c308db643663 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:45.006716 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 992/2036] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:45.013033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72c184-eb7d-436f-b234-5fda4480d09a admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:45.025422 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72c184-eb7d-436f-b234-5fda4480d09a admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:45.031642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bd52d-2e93-4bab-ae80-af99356e75a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:45.032846 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bd52d-2e93-4bab-ae80-af99356e75a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:45.033641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bd52d-2e93-4bab-ae80-af99356e75a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:45.034046 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bd52d-2e93-4bab-ae80-af99356e75a3 admin admin] PATH_INFO: `/v3/projects/e00c329573b946a39081a7883d219d10/users/fb659e0219514a028a6314af73790a11/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:45.036566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bd52d-2e93-4bab-ae80-af99356e75a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00c329573b946a39081a7883d219d10, user_id=fb659e0219514a028a6314af73790a11, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:45.048475 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bd52d-2e93-4bab-ae80-af99356e75a3 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:45.063741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1045/2037] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:45 2022] PUT /identity/v3/projects/e00c329573b946a39081a7883d219d10/users/fb659e0219514a028a6314af73790a11/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:45.065231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f236ec-4c84-4fb6-a810-638d3709c4bf None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:45.065526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f236ec-4c84-4fb6-a810-638d3709c4bf None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:45.065888 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f236ec-4c84-4fb6-a810-638d3709c4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:45.083125 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bd52d-2e93-4bab-ae80-af99356e75a3 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:45.086258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-5a2bd52d-2e93-4bab-ae80-af99356e75a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:45.149577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-71f236ec-4c84-4fb6-a810-638d3709c4bf None None] MFA Rules not processed for user `fb659e0219514a028a6314af73790a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:45.152004 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-71f236ec-4c84-4fb6-a810-638d3709c4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:45.275862 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bd52d-2e93-4bab-ae80-af99356e75a3 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:45.288603 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931f63f-85b2-44c2-b79c-f13937af1bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:45.289945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931f63f-85b2-44c2-b79c-f13937af1bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:45.290427 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931f63f-85b2-44c2-b79c-f13937af1bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:45.292242 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 993/2038] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:42:45.304326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931f63f-85b2-44c2-b79c-f13937af1bab admin admin] PATH_INFO: `/v3/projects/b7d2dea769ae414fad9c91439d3652fc` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:45.304326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931f63f-85b2-44c2-b79c-f13937af1bab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7d2dea769ae414fad9c91439d3652fc)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:45.304326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931f63f-85b2-44c2-b79c-f13937af1bab admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:45.327168 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f236ec-4c84-4fb6-a810-638d3709c4bf None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:45.328866 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-71f236ec-4c84-4fb6-a810-638d3709c4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:45.383812 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:45.428030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f236ec-4c84-4fb6-a810-638d3709c4bf None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:45.432706 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4cee5-80d6-4728-b33b-93af95ecaab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:45.433447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4cee5-80d6-4728-b33b-93af95ecaab4 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:45.437101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4cee5-80d6-4728-b33b-93af95ecaab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:45.437101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4cee5-80d6-4728-b33b-93af95ecaab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:45.437101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-90b4cee5-80d6-4728-b33b-93af95ecaab4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:45.457530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:45.461442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-2931f63f-85b2-44c2-b79c-f13937af1bab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d2dea769ae414fad9c91439d3652fc', 'request_id': 'req-2931f63f-85b2-44c2-b79c-f13937af1bab'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:45.521698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4cee5-80d6-4728-b33b-93af95ecaab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:45.523347 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4cee5-80d6-4728-b33b-93af95ecaab4 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:45.533699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-2931f63f-85b2-44c2-b79c-f13937af1bab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d2dea769ae414fad9c91439d3652fc', 'request_id': 'req-2931f63f-85b2-44c2-b79c-f13937af1bab'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:45.534413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 994/2039] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:42:45.544204 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-2931f63f-85b2-44c2-b79c-f13937af1bab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d2dea769ae414fad9c91439d3652fc', 'request_id': 'req-2931f63f-85b2-44c2-b79c-f13937af1bab'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:45.555627 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-2931f63f-85b2-44c2-b79c-f13937af1bab admin admin] The token cache is being invalidate because project b7d2dea769ae414fad9c91439d3652fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:45.555627 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-2931f63f-85b2-44c2-b79c-f13937af1bab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:45.556245 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-2931f63f-85b2-44c2-b79c-f13937af1bab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:45.562190 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1046/2040] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:45 2022] DELETE /identity/v3/projects/b7d2dea769ae414fad9c91439d3652fc => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:45.563908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3039d5b-2014-47d2-8b85-f945f83e1df2 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:45.564209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3039d5b-2014-47d2-8b85-f945f83e1df2 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:45.564495 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3039d5b-2014-47d2-8b85-f945f83e1df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:45.583126 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-a3039d5b-2014-47d2-8b85-f945f83e1df2 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:45.584516 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-a3039d5b-2014-47d2-8b85-f945f83e1df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:45.647903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 995/2041] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:45.655730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e90c9-639d-41a9-8feb-3998f65c497e None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:45.656263 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e90c9-639d-41a9-8feb-3998f65c497e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:45.656803 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e90c9-639d-41a9-8feb-3998f65c497e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:45.678377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-512e90c9-639d-41a9-8feb-3998f65c497e None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:45.679769 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-512e90c9-639d-41a9-8feb-3998f65c497e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:45.689274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1047/2042] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:45.693987 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3039d5b-2014-47d2-8b85-f945f83e1df2 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:45.705533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3039d5b-2014-47d2-8b85-f945f83e1df2 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:45.711269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d639a7-f011-4792-a53a-ce8f63ef2c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:45.712354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d639a7-f011-4792-a53a-ce8f63ef2c7a admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:45.712637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d639a7-f011-4792-a53a-ce8f63ef2c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:45.712908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d639a7-f011-4792-a53a-ce8f63ef2c7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:45.713857 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d639a7-f011-4792-a53a-ce8f63ef2c7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:45.714133 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d639a7-f011-4792-a53a-ce8f63ef2c7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:45.717452 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d639a7-f011-4792-a53a-ce8f63ef2c7a admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:45.731322 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 996/2043] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:42:45.735753 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e90c9-639d-41a9-8feb-3998f65c497e None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:45.747124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e90c9-639d-41a9-8feb-3998f65c497e None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:45.752313 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448835f3-4334-44e5-83d2-13fe4c81c935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:45.753320 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448835f3-4334-44e5-83d2-13fe4c81c935 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:45.753601 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448835f3-4334-44e5-83d2-13fe4c81c935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:45.753876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448835f3-4334-44e5-83d2-13fe4c81c935 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:45.754590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448835f3-4334-44e5-83d2-13fe4c81c935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:45.756825 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448835f3-4334-44e5-83d2-13fe4c81c935 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:45.863811 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1048/2044] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:45 2022] POST /identity/v3/projects => generated 407 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:45.868243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d639a7-f011-4792-a53a-ce8f63ef2c7a admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:45.878718 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d639a7-f011-4792-a53a-ce8f63ef2c7a admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:45.953659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1334250-fc8a-4368-8cdd-0184f23a1807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:45.954344 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1334250-fc8a-4368-8cdd-0184f23a1807 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:45.954632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1334250-fc8a-4368-8cdd-0184f23a1807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:45.954913 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1334250-fc8a-4368-8cdd-0184f23a1807 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:45.955715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1334250-fc8a-4368-8cdd-0184f23a1807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:45.957566 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1334250-fc8a-4368-8cdd-0184f23a1807 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:46.073039 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 997/2045] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:45 2022] POST /identity/v3/users => generated 304 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:46.077103 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448835f3-4334-44e5-83d2-13fe4c81c935 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:46.089299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448835f3-4334-44e5-83d2-13fe4c81c935 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:46.095871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38636816-5868-4d4b-bf27-8f11a543e72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:46.096550 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636816-5868-4d4b-bf27-8f11a543e72b admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:46.097230 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636816-5868-4d4b-bf27-8f11a543e72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:46.097505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636816-5868-4d4b-bf27-8f11a543e72b admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:46.098278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38636816-5868-4d4b-bf27-8f11a543e72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:46.100084 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38636816-5868-4d4b-bf27-8f11a543e72b admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:46.116521 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1049/2046] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:46.119017 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1334250-fc8a-4368-8cdd-0184f23a1807 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:46.129449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1334250-fc8a-4368-8cdd-0184f23a1807 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:46.134530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d176d-ec92-40e1-9f5d-215e1d486154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:46.135234 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d176d-ec92-40e1-9f5d-215e1d486154 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:46.135546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d176d-ec92-40e1-9f5d-215e1d486154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:46.135822 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d176d-ec92-40e1-9f5d-215e1d486154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:46.136567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d176d-ec92-40e1-9f5d-215e1d486154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:46.138243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d176d-ec92-40e1-9f5d-215e1d486154 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:46.146137 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:46.154054 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 998/2047] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:46.156015 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38636816-5868-4d4b-bf27-8f11a543e72b admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:46.167924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38636816-5868-4d4b-bf27-8f11a543e72b admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:46.171859 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d176d-ec92-40e1-9f5d-215e1d486154 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:46.171859 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-f54d176d-ec92-40e1-9f5d-215e1d486154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:46.173442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c6025-6f9d-4857-a70d-c729a79a7940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:46.174326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c6025-6f9d-4857-a70d-c729a79a7940 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:46.174607 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c6025-6f9d-4857-a70d-c729a79a7940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:46.174879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c6025-6f9d-4857-a70d-c729a79a7940 admin admin] PATH_INFO: `/v3/projects/e8c11dc48c454c1e8ddbd1e6c5ffa21e/users/a9298cc7f3cd42faaf6d21556f1d7d19/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:46.190179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c6025-6f9d-4857-a70d-c729a79a7940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c11dc48c454c1e8ddbd1e6c5ffa21e, user_id=a9298cc7f3cd42faaf6d21556f1d7d19, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:46.196808 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c6025-6f9d-4857-a70d-c729a79a7940 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:46.234132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d176d-ec92-40e1-9f5d-215e1d486154 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:46.237968 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91646ac5-b127-47fc-a89c-f4c0fef40fd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:46.238624 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91646ac5-b127-47fc-a89c-f4c0fef40fd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:46.238904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91646ac5-b127-47fc-a89c-f4c0fef40fd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:46.239179 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91646ac5-b127-47fc-a89c-f4c0fef40fd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:46.241019 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-91646ac5-b127-47fc-a89c-f4c0fef40fd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:46.318035 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1050/2048] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:46 2022] PUT /identity/v3/projects/e8c11dc48c454c1e8ddbd1e6c5ffa21e/users/a9298cc7f3cd42faaf6d21556f1d7d19/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:46.319741 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91646ac5-b127-47fc-a89c-f4c0fef40fd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:46.321294 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91646ac5-b127-47fc-a89c-f4c0fef40fd7 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:46.328938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc21a1-3047-47bb-8425-278316ae094c None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:46.329230 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc21a1-3047-47bb-8425-278316ae094c None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:46.329542 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc21a1-3047-47bb-8425-278316ae094c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:46.340013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 999/2049] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:42:46.364874 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-a9fc21a1-3047-47bb-8425-278316ae094c None None] MFA Rules not processed for user `a9298cc7f3cd42faaf6d21556f1d7d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:46.367715 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a9fc21a1-3047-47bb-8425-278316ae094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:46.411705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:46.544329 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1051/2050] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:42:46.549011 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91646ac5-b127-47fc-a89c-f4c0fef40fd7 service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:46.560457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91646ac5-b127-47fc-a89c-f4c0fef40fd7 service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:46.630691 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6727aa-ab9c-4609-8fa9-75e7e16ffde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:46.632962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6727aa-ab9c-4609-8fa9-75e7e16ffde2 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:46.632962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6727aa-ab9c-4609-8fa9-75e7e16ffde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:46.632962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6727aa-ab9c-4609-8fa9-75e7e16ffde2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:46.633545 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6727aa-ab9c-4609-8fa9-75e7e16ffde2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:46.636413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6727aa-ab9c-4609-8fa9-75e7e16ffde2 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:46.735878 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1000/2051] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:46 2022] POST /identity/v3/projects => generated 407 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:46.737022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc21a1-3047-47bb-8425-278316ae094c None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:46.749755 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc21a1-3047-47bb-8425-278316ae094c None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:46.806599 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea19c3-eebc-4907-b7f8-0d8a66563239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:46.807791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea19c3-eebc-4907-b7f8-0d8a66563239 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:46.808069 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea19c3-eebc-4907-b7f8-0d8a66563239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:46.808344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea19c3-eebc-4907-b7f8-0d8a66563239 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:46.809041 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea19c3-eebc-4907-b7f8-0d8a66563239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:46.811182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea19c3-eebc-4907-b7f8-0d8a66563239 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:46.813697 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:46.923557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1052/2052] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:46 2022] POST /identity/v3/users => generated 310 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:42:46.927467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6727aa-ab9c-4609-8fa9-75e7e16ffde2 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:46.938886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6727aa-ab9c-4609-8fa9-75e7e16ffde2 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:46.943959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217e1a0-f437-40ae-849e-238bddfe3e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:46.944809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217e1a0-f437-40ae-849e-238bddfe3e64 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:46.945295 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217e1a0-f437-40ae-849e-238bddfe3e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:46.945640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217e1a0-f437-40ae-849e-238bddfe3e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:46.946407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217e1a0-f437-40ae-849e-238bddfe3e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:46.948721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217e1a0-f437-40ae-849e-238bddfe3e64 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:46.960093 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1001/2053] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:46.964708 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea19c3-eebc-4907-b7f8-0d8a66563239 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:46.975138 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea19c3-eebc-4907-b7f8-0d8a66563239 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:46.980796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0566c6-286b-4e5c-ab02-afd24120cb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:46.981715 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0566c6-286b-4e5c-ab02-afd24120cb08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:46.982004 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0566c6-286b-4e5c-ab02-afd24120cb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:46.982293 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0566c6-286b-4e5c-ab02-afd24120cb08 admin admin] PATH_INFO: `/v3/projects/64e52a19df3846489e1eb1c381025274/users/0e0e4eafd0394426bd5cf3d8d6294d3d/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:46.999096 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0566c6-286b-4e5c-ab02-afd24120cb08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e52a19df3846489e1eb1c381025274, user_id=0e0e4eafd0394426bd5cf3d8d6294d3d, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:47.001832 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0566c6-286b-4e5c-ab02-afd24120cb08 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:47.141529 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1053/2054] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:46 2022] PUT /identity/v3/projects/64e52a19df3846489e1eb1c381025274/users/0e0e4eafd0394426bd5cf3d8d6294d3d/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:42:47.145652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217e1a0-f437-40ae-849e-238bddfe3e64 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:47.156054 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217e1a0-f437-40ae-849e-238bddfe3e64 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:47.212618 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af243c82-76a9-4fc5-bbf5-672726a1a675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:47.213710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af243c82-76a9-4fc5-bbf5-672726a1a675 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:47.214286 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af243c82-76a9-4fc5-bbf5-672726a1a675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:47.214801 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af243c82-76a9-4fc5-bbf5-672726a1a675 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:47.216662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:47.217149 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af243c82-76a9-4fc5-bbf5-672726a1a675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:47.218848 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af243c82-76a9-4fc5-bbf5-672726a1a675 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:47.229910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1002/2055] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:47.234262 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0566c6-286b-4e5c-ab02-afd24120cb08 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:47.246294 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0566c6-286b-4e5c-ab02-afd24120cb08 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:47.252452 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b982a-092d-49c2-ae46-51f965d0823a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:47.252452 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b982a-092d-49c2-ae46-51f965d0823a admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:47.252452 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b982a-092d-49c2-ae46-51f965d0823a admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:47.252900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b982a-092d-49c2-ae46-51f965d0823a admin admin] PATH_INFO: `/v3/projects/64e52a19df3846489e1eb1c381025274/users/0e0e4eafd0394426bd5cf3d8d6294d3d/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:47.254771 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b982a-092d-49c2-ae46-51f965d0823a admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e52a19df3846489e1eb1c381025274, user_id=0e0e4eafd0394426bd5cf3d8d6294d3d, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:47.257720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b982a-092d-49c2-ae46-51f965d0823a admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:47.268959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1054/2056] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:47 2022] PUT /identity/v3/projects/64e52a19df3846489e1eb1c381025274/users/0e0e4eafd0394426bd5cf3d8d6294d3d/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:47.280606 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a215d-940f-4ba7-8cd3-532b6d69df61 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:47.281224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a215d-940f-4ba7-8cd3-532b6d69df61 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:47.281383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a215d-940f-4ba7-8cd3-532b6d69df61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:47.313569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-e44a215d-940f-4ba7-8cd3-532b6d69df61 None None] MFA Rules not processed for user `0e0e4eafd0394426bd5cf3d8d6294d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:47.314893 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-e44a215d-940f-4ba7-8cd3-532b6d69df61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:47.392018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1003/2057] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:47 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:47.396913 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:47.404055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b982a-092d-49c2-ae46-51f965d0823a admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:47.406011 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7a0b982a-092d-49c2-ae46-51f965d0823a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:47.465128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b982a-092d-49c2-ae46-51f965d0823a admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:47.468900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80971938-cc20-4fd1-b6a1-984c66a907e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:47.469587 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80971938-cc20-4fd1-b6a1-984c66a907e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:47.469877 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80971938-cc20-4fd1-b6a1-984c66a907e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:47.470230 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80971938-cc20-4fd1-b6a1-984c66a907e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:47.482833 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80971938-cc20-4fd1-b6a1-984c66a907e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:47.484437 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80971938-cc20-4fd1-b6a1-984c66a907e2 service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:47.496977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1055/2058] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:47 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:47.609862 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:47.816857 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:47.897080 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a215d-940f-4ba7-8cd3-532b6d69df61 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:47.912854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a215d-940f-4ba7-8cd3-532b6d69df61 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:47.917808 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046ee3d-2e75-4822-a5f4-010d963700a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:47.918852 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046ee3d-2e75-4822-a5f4-010d963700a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:47.919235 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046ee3d-2e75-4822-a5f4-010d963700a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:47.919642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046ee3d-2e75-4822-a5f4-010d963700a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:47.986710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046ee3d-2e75-4822-a5f4-010d963700a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:47.988202 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046ee3d-2e75-4822-a5f4-010d963700a5 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:47.998615 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1004/2059] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:47 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:48.242290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:48.394240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:48.837495 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:48.867031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80971938-cc20-4fd1-b6a1-984c66a907e2 service cinder] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:48.876362 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80971938-cc20-4fd1-b6a1-984c66a907e2 service cinder] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:48.880129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb9992-f44a-4539-abd2-49bdf0e8fddb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:48.880978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb9992-f44a-4539-abd2-49bdf0e8fddb service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:48.881676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb9992-f44a-4539-abd2-49bdf0e8fddb service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:48.882122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb9992-f44a-4539-abd2-49bdf0e8fddb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:48.883959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-14bb9992-f44a-4539-abd2-49bdf0e8fddb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:48.938139 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:48.961198 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb9992-f44a-4539-abd2-49bdf0e8fddb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:48.962649 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb9992-f44a-4539-abd2-49bdf0e8fddb service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:48.972344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1056/2060] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:42:49.531370 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:49.848748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:50.121922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:50.566755 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:50.702407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046ee3d-2e75-4822-a5f4-010d963700a5 service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:50.711145 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046ee3d-2e75-4822-a5f4-010d963700a5 service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:50.715662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff29a7c-3947-4dc5-8d71-d86d1372a0a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:50.716476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff29a7c-3947-4dc5-8d71-d86d1372a0a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:50.716761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff29a7c-3947-4dc5-8d71-d86d1372a0a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:50.717037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff29a7c-3947-4dc5-8d71-d86d1372a0a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:50.719182 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0ff29a7c-3947-4dc5-8d71-d86d1372a0a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:50.795023 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff29a7c-3947-4dc5-8d71-d86d1372a0a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:50.796584 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff29a7c-3947-4dc5-8d71-d86d1372a0a3 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:50.812023 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1005/2061] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:50.985955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:51.440538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:51.546175 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:51.923831 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb9992-f44a-4539-abd2-49bdf0e8fddb service cinder] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:51.925491 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-14bb9992-f44a-4539-abd2-49bdf0e8fddb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:52.004360 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb9992-f44a-4539-abd2-49bdf0e8fddb service cinder] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:52.010229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d92e07-c269-41bc-9218-00a2348f9c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:52.012205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d92e07-c269-41bc-9218-00a2348f9c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:52.012504 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d92e07-c269-41bc-9218-00a2348f9c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:52.012790 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d92e07-c269-41bc-9218-00a2348f9c97 admin admin] PATH_INFO: `/v3/users/d8498d8c8b0146d1bb5165a213757369` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:52.014080 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d92e07-c269-41bc-9218-00a2348f9c97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8498d8c8b0146d1bb5165a213757369)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:52.016588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d92e07-c269-41bc-9218-00a2348f9c97 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:52.258434 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c4d92e07-c269-41bc-9218-00a2348f9c97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8498d8c8b0146d1bb5165a213757369'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:52.273366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c4d92e07-c269-41bc-9218-00a2348f9c97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8498d8c8b0146d1bb5165a213757369'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:52.426135 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c4d92e07-c269-41bc-9218-00a2348f9c97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8498d8c8b0146d1bb5165a213757369'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:52.426692 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c4d92e07-c269-41bc-9218-00a2348f9c97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8498d8c8b0146d1bb5165a213757369'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:52.434883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c4d92e07-c269-41bc-9218-00a2348f9c97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8498d8c8b0146d1bb5165a213757369'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:52.444813 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1057/2062] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:51 2022] DELETE /identity/v3/users/d8498d8c8b0146d1bb5165a213757369 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:52.446428 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4b640-fdb9-4074-9757-0f5aa11a8e0f None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:52.447265 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4b640-fdb9-4074-9757-0f5aa11a8e0f None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:52.448344 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4b640-fdb9-4074-9757-0f5aa11a8e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:52.474931 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-52d4b640-fdb9-4074-9757-0f5aa11a8e0f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:52.476651 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-52d4b640-fdb9-4074-9757-0f5aa11a8e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:52.593917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1006/2063] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:42:52.633190 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d92e07-c269-41bc-9218-00a2348f9c97 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:52.635061 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-c4d92e07-c269-41bc-9218-00a2348f9c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:52.715834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d92e07-c269-41bc-9218-00a2348f9c97 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:52.722680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b0801-87f2-4793-99c3-3db119bf03f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:52.723420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b0801-87f2-4793-99c3-3db119bf03f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:52.724156 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b0801-87f2-4793-99c3-3db119bf03f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:52.724156 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b0801-87f2-4793-99c3-3db119bf03f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:52.737405 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b0801-87f2-4793-99c3-3db119bf03f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:52.739130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b0801-87f2-4793-99c3-3db119bf03f8 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:52.750218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1058/2064] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:42:52.841390 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:52.945939 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:53.371699 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4b640-fdb9-4074-9757-0f5aa11a8e0f None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:53.373172 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-52d4b640-fdb9-4074-9757-0f5aa11a8e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:53.388098 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4b640-fdb9-4074-9757-0f5aa11a8e0f None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:53.395143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775a732-346f-46fa-89a1-e6957c6983bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:53.396662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775a732-346f-46fa-89a1-e6957c6983bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:53.396942 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775a732-346f-46fa-89a1-e6957c6983bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:53.397366 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775a732-346f-46fa-89a1-e6957c6983bb admin admin] PATH_INFO: `/v3/projects/04ed0d6f9a8e4fd8849f47813c9fad12` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:53.399532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775a732-346f-46fa-89a1-e6957c6983bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=04ed0d6f9a8e4fd8849f47813c9fad12)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:53.402880 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775a732-346f-46fa-89a1-e6957c6983bb admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:53.571103 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-1775a732-346f-46fa-89a1-e6957c6983bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04ed0d6f9a8e4fd8849f47813c9fad12', 'request_id': 'req-1775a732-346f-46fa-89a1-e6957c6983bb'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:53.577828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-1775a732-346f-46fa-89a1-e6957c6983bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04ed0d6f9a8e4fd8849f47813c9fad12', 'request_id': 'req-1775a732-346f-46fa-89a1-e6957c6983bb'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:53.585501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-1775a732-346f-46fa-89a1-e6957c6983bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04ed0d6f9a8e4fd8849f47813c9fad12', 'request_id': 'req-1775a732-346f-46fa-89a1-e6957c6983bb'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:53.637496 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:53.682898 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-1775a732-346f-46fa-89a1-e6957c6983bb admin admin] The token cache is being invalidate because project 04ed0d6f9a8e4fd8849f47813c9fad12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:53.683920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-1775a732-346f-46fa-89a1-e6957c6983bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:53.684915 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-1775a732-346f-46fa-89a1-e6957c6983bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:53.689084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1007/2065] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:53 2022] DELETE /identity/v3/projects/04ed0d6f9a8e4fd8849f47813c9fad12 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:53.693080 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b0801-87f2-4793-99c3-3db119bf03f8 service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:53.724510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b0801-87f2-4793-99c3-3db119bf03f8 service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:53.827500 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa67a3c-5ab2-4b1e-ab21-f9ebad828e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:53.829147 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa67a3c-5ab2-4b1e-ab21-f9ebad828e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:53.829578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa67a3c-5ab2-4b1e-ab21-f9ebad828e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:53.829980 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa67a3c-5ab2-4b1e-ab21-f9ebad828e5a admin admin] PATH_INFO: `/v3/users/1bb667b12f784a7aac6179553f1404fd` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:53.831520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa67a3c-5ab2-4b1e-ab21-f9ebad828e5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb667b12f784a7aac6179553f1404fd)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:53.833945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa67a3c-5ab2-4b1e-ab21-f9ebad828e5a admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:54.118565 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-8fa67a3c-5ab2-4b1e-ab21-f9ebad828e5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb667b12f784a7aac6179553f1404fd'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:54.136332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-8fa67a3c-5ab2-4b1e-ab21-f9ebad828e5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb667b12f784a7aac6179553f1404fd'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:54.251501 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-8fa67a3c-5ab2-4b1e-ab21-f9ebad828e5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb667b12f784a7aac6179553f1404fd'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:54.252205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-8fa67a3c-5ab2-4b1e-ab21-f9ebad828e5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb667b12f784a7aac6179553f1404fd'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:54.261991 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-8fa67a3c-5ab2-4b1e-ab21-f9ebad828e5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb667b12f784a7aac6179553f1404fd'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:54.268604 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1059/2066] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:53 2022] DELETE /identity/v3/users/1bb667b12f784a7aac6179553f1404fd => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:54.489167 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:54.794069 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:54.897101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775a732-346f-46fa-89a1-e6957c6983bb admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:54.899202 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-1775a732-346f-46fa-89a1-e6957c6983bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:54.923334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775a732-346f-46fa-89a1-e6957c6983bb admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:55.019820 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fac51-58ad-49a3-89c6-7c6b7d49ba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:55.021017 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fac51-58ad-49a3-89c6-7c6b7d49ba90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:55.021467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fac51-58ad-49a3-89c6-7c6b7d49ba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:55.021900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fac51-58ad-49a3-89c6-7c6b7d49ba90 admin admin] PATH_INFO: `/v3/projects/22e37ccc1db142279d095f767b694e41` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:55.024210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fac51-58ad-49a3-89c6-7c6b7d49ba90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22e37ccc1db142279d095f767b694e41)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:55.028389 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fac51-58ad-49a3-89c6-7c6b7d49ba90 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:55.247228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-c43fac51-58ad-49a3-89c6-7c6b7d49ba90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22e37ccc1db142279d095f767b694e41', 'request_id': 'req-c43fac51-58ad-49a3-89c6-7c6b7d49ba90'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:55.258863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-c43fac51-58ad-49a3-89c6-7c6b7d49ba90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22e37ccc1db142279d095f767b694e41', 'request_id': 'req-c43fac51-58ad-49a3-89c6-7c6b7d49ba90'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:55.268177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-c43fac51-58ad-49a3-89c6-7c6b7d49ba90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22e37ccc1db142279d095f767b694e41', 'request_id': 'req-c43fac51-58ad-49a3-89c6-7c6b7d49ba90'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:55.333733 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-c43fac51-58ad-49a3-89c6-7c6b7d49ba90 admin admin] The token cache is being invalidate because project 22e37ccc1db142279d095f767b694e41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:55.336647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-c43fac51-58ad-49a3-89c6-7c6b7d49ba90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:55.336647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-c43fac51-58ad-49a3-89c6-7c6b7d49ba90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:55.337989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1008/2067] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:54 2022] DELETE /identity/v3/projects/22e37ccc1db142279d095f767b694e41 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:55.346295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626612ec-c84f-4088-9e37-d5d8331bd6ca None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:55.346819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626612ec-c84f-4088-9e37-d5d8331bd6ca None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:55.347101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626612ec-c84f-4088-9e37-d5d8331bd6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:55.366514 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-626612ec-c84f-4088-9e37-d5d8331bd6ca None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:55.368006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-626612ec-c84f-4088-9e37-d5d8331bd6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:55.439002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1060/2068] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:55.448521 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c6c44-817f-4e74-afdf-8ca993fb3891 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:55.448809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c6c44-817f-4e74-afdf-8ca993fb3891 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:55.449091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c6c44-817f-4e74-afdf-8ca993fb3891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:55.473616 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-b56c6c44-817f-4e74-afdf-8ca993fb3891 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:55.476644 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b56c6c44-817f-4e74-afdf-8ca993fb3891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:55.486178 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1009/2069] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:55.490902 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626612ec-c84f-4088-9e37-d5d8331bd6ca None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:55.502476 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626612ec-c84f-4088-9e37-d5d8331bd6ca None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:55.509143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307850ba-2bcd-4cd8-ab3b-76cdfa298e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:55.509823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307850ba-2bcd-4cd8-ab3b-76cdfa298e7b admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:55.510606 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307850ba-2bcd-4cd8-ab3b-76cdfa298e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:55.511088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307850ba-2bcd-4cd8-ab3b-76cdfa298e7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:55.512452 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307850ba-2bcd-4cd8-ab3b-76cdfa298e7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:42:55.512774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307850ba-2bcd-4cd8-ab3b-76cdfa298e7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:55.514403 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307850ba-2bcd-4cd8-ab3b-76cdfa298e7b admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:55.529959 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1061/2070] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:42:55.533998 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c6c44-817f-4e74-afdf-8ca993fb3891 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:55.544292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c6c44-817f-4e74-afdf-8ca993fb3891 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:55.549235 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f03042-85d4-49f8-80a9-90c4a671b820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:55.549928 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f03042-85d4-49f8-80a9-90c4a671b820 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:55.550246 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f03042-85d4-49f8-80a9-90c4a671b820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:55.550531 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f03042-85d4-49f8-80a9-90c4a671b820 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:55.551258 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f03042-85d4-49f8-80a9-90c4a671b820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:55.553308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f03042-85d4-49f8-80a9-90c4a671b820 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:55.670820 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1010/2071] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:55 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:55.676203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307850ba-2bcd-4cd8-ab3b-76cdfa298e7b admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:55.691591 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307850ba-2bcd-4cd8-ab3b-76cdfa298e7b admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:55.769000 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b12470-2203-4a75-8b6a-c210fc97c189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:55.769860 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b12470-2203-4a75-8b6a-c210fc97c189 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:55.770224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b12470-2203-4a75-8b6a-c210fc97c189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:55.770562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b12470-2203-4a75-8b6a-c210fc97c189 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:55.771485 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b12470-2203-4a75-8b6a-c210fc97c189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:55.773511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b12470-2203-4a75-8b6a-c210fc97c189 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:55.916896 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1062/2072] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:55 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:55.921051 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f03042-85d4-49f8-80a9-90c4a671b820 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:55.932518 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f03042-85d4-49f8-80a9-90c4a671b820 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:55.938018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbc282-d7e7-4ae4-b839-f08d43db5727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:55.938821 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbc282-d7e7-4ae4-b839-f08d43db5727 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:55.943931 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbc282-d7e7-4ae4-b839-f08d43db5727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:55.943931 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbc282-d7e7-4ae4-b839-f08d43db5727 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:55.943931 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbc282-d7e7-4ae4-b839-f08d43db5727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:55.943931 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbc282-d7e7-4ae4-b839-f08d43db5727 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:55.957373 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1011/2073] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:55.958727 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b12470-2203-4a75-8b6a-c210fc97c189 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:55.970069 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b12470-2203-4a75-8b6a-c210fc97c189 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:55.975053 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b351c3-0241-4514-a286-5329fb147cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:55.975845 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b351c3-0241-4514-a286-5329fb147cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:55.976310 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b351c3-0241-4514-a286-5329fb147cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:55.976597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b351c3-0241-4514-a286-5329fb147cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:55.977341 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b351c3-0241-4514-a286-5329fb147cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:55.979495 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b351c3-0241-4514-a286-5329fb147cb4 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:55.990094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1063/2074] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:55.996975 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbc282-d7e7-4ae4-b839-f08d43db5727 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:56.009986 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbc282-d7e7-4ae4-b839-f08d43db5727 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:56.015980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb766894-3076-4de9-8c8d-ffb1a0a2923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:56.016898 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb766894-3076-4de9-8c8d-ffb1a0a2923d admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:56.017184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb766894-3076-4de9-8c8d-ffb1a0a2923d admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:56.017464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb766894-3076-4de9-8c8d-ffb1a0a2923d admin admin] PATH_INFO: `/v3/projects/b895cad6cb1b405496051f2d0ce3ff80/users/23a3d099a57d43779c8557b89fd7cfac/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:56.033683 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb766894-3076-4de9-8c8d-ffb1a0a2923d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b895cad6cb1b405496051f2d0ce3ff80, user_id=23a3d099a57d43779c8557b89fd7cfac, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:56.036472 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb766894-3076-4de9-8c8d-ffb1a0a2923d admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:56.161659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1012/2075] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:55 2022] PUT /identity/v3/projects/b895cad6cb1b405496051f2d0ce3ff80/users/23a3d099a57d43779c8557b89fd7cfac/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:56.173184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222b2ef-4bfb-4f8a-a1ef-4ca2713e164d None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:56.173483 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222b2ef-4bfb-4f8a-a1ef-4ca2713e164d None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:56.173843 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222b2ef-4bfb-4f8a-a1ef-4ca2713e164d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:56.185690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:56.210395 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-d222b2ef-4bfb-4f8a-a1ef-4ca2713e164d None None] MFA Rules not processed for user `23a3d099a57d43779c8557b89fd7cfac`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:56.210893 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d222b2ef-4bfb-4f8a-a1ef-4ca2713e164d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:56.290439 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1064/2076] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:56.296098 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb766894-3076-4de9-8c8d-ffb1a0a2923d admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:56.382289 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb766894-3076-4de9-8c8d-ffb1a0a2923d admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:56.389775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84ffca-9010-41ec-916c-438aa052bcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:56.394823 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84ffca-9010-41ec-916c-438aa052bcb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:56.394823 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84ffca-9010-41ec-916c-438aa052bcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:56.394823 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84ffca-9010-41ec-916c-438aa052bcb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:56.394823 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84ffca-9010-41ec-916c-438aa052bcb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:56.394823 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84ffca-9010-41ec-916c-438aa052bcb7 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:56.490016 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:56.500658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1013/2077] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:42:56 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:42:56.505404 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222b2ef-4bfb-4f8a-a1ef-4ca2713e164d None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:56.516980 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222b2ef-4bfb-4f8a-a1ef-4ca2713e164d None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:56.579874 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d912b-b1ce-4e8c-97b9-d59df26b51be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:56.580519 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d912b-b1ce-4e8c-97b9-d59df26b51be admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:56.580803 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d912b-b1ce-4e8c-97b9-d59df26b51be admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:56.581076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d912b-b1ce-4e8c-97b9-d59df26b51be admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:56.581784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d912b-b1ce-4e8c-97b9-d59df26b51be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:56.583824 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d912b-b1ce-4e8c-97b9-d59df26b51be admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:56.674494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1065/2078] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:42:56 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:42:56.678697 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84ffca-9010-41ec-916c-438aa052bcb7 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:56.690097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84ffca-9010-41ec-916c-438aa052bcb7 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:56.694803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91db0a8-4865-45a5-ae89-2ad5c3a79378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:56.695520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91db0a8-4865-45a5-ae89-2ad5c3a79378 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:56.695808 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91db0a8-4865-45a5-ae89-2ad5c3a79378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:56.696082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91db0a8-4865-45a5-ae89-2ad5c3a79378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:56.696829 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91db0a8-4865-45a5-ae89-2ad5c3a79378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:56.698839 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91db0a8-4865-45a5-ae89-2ad5c3a79378 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:56.711257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1014/2079] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:56.718425 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d912b-b1ce-4e8c-97b9-d59df26b51be admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:56.731465 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d912b-b1ce-4e8c-97b9-d59df26b51be admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:56.738835 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca37980-7664-4608-8d57-9e6fc64c8396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:56.743323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37980-7664-4608-8d57-9e6fc64c8396 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:56.743323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37980-7664-4608-8d57-9e6fc64c8396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:56.743323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37980-7664-4608-8d57-9e6fc64c8396 admin admin] PATH_INFO: `/v3/projects/0fd8b0df40864c5cb090c4c831ca9348/users/3d63702fa2954d7691fdd70bebfc94b1/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:56.759692 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca37980-7664-4608-8d57-9e6fc64c8396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd8b0df40864c5cb090c4c831ca9348, user_id=3d63702fa2954d7691fdd70bebfc94b1, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:56.763228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca37980-7664-4608-8d57-9e6fc64c8396 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:56.831234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1066/2080] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:56 2022] PUT /identity/v3/projects/0fd8b0df40864c5cb090c4c831ca9348/users/3d63702fa2954d7691fdd70bebfc94b1/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:56.836454 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91db0a8-4865-45a5-ae89-2ad5c3a79378 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:56.853134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91db0a8-4865-45a5-ae89-2ad5c3a79378 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:56.914706 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:56.952843 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845aeeb-cac4-4265-9156-399ae18a6c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:56.954189 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845aeeb-cac4-4265-9156-399ae18a6c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:56.954189 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845aeeb-cac4-4265-9156-399ae18a6c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:56.954189 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845aeeb-cac4-4265-9156-399ae18a6c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:56.954954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845aeeb-cac4-4265-9156-399ae18a6c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:56.956614 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845aeeb-cac4-4265-9156-399ae18a6c4c admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:56.968026 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1015/2081] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:42:56.972374 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca37980-7664-4608-8d57-9e6fc64c8396 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:56.984046 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca37980-7664-4608-8d57-9e6fc64c8396 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:56.989089 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9d33d-1ed6-4f89-92fa-3a8902ea3331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:56.990122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9d33d-1ed6-4f89-92fa-3a8902ea3331 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:56.990407 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9d33d-1ed6-4f89-92fa-3a8902ea3331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:56.990750 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9d33d-1ed6-4f89-92fa-3a8902ea3331 admin admin] PATH_INFO: `/v3/projects/0fd8b0df40864c5cb090c4c831ca9348/users/3d63702fa2954d7691fdd70bebfc94b1/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:56.992815 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9d33d-1ed6-4f89-92fa-3a8902ea3331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd8b0df40864c5cb090c4c831ca9348, user_id=3d63702fa2954d7691fdd70bebfc94b1, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:56.995706 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9d33d-1ed6-4f89-92fa-3a8902ea3331 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:57.007927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1067/2082] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:42:56 2022] PUT /identity/v3/projects/0fd8b0df40864c5cb090c4c831ca9348/users/3d63702fa2954d7691fdd70bebfc94b1/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:57.024038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4362f9-e918-42c7-8abc-e4368a5b31c7 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:57.024409 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4362f9-e918-42c7-8abc-e4368a5b31c7 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:57.024764 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4362f9-e918-42c7-8abc-e4368a5b31c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:57.064277 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-db4362f9-e918-42c7-8abc-e4368a5b31c7 None None] MFA Rules not processed for user `3d63702fa2954d7691fdd70bebfc94b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:57.065526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-db4362f9-e918-42c7-8abc-e4368a5b31c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:57.073576 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9d33d-1ed6-4f89-92fa-3a8902ea3331 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:57.075510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1dd9d33d-1ed6-4f89-92fa-3a8902ea3331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:57.143245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1016/2083] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:57.154401 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9d33d-1ed6-4f89-92fa-3a8902ea3331 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:57.156280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4362f9-e918-42c7-8abc-e4368a5b31c7 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:57.156965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244edfee-a313-4f5f-a267-2f8d3b07d7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:57.157984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244edfee-a313-4f5f-a267-2f8d3b07d7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:57.158337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244edfee-a313-4f5f-a267-2f8d3b07d7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:57.158642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-db4362f9-e918-42c7-8abc-e4368a5b31c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:57.158735 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244edfee-a313-4f5f-a267-2f8d3b07d7f8 admin admin] PATH_INFO: `/v3/users/8ba1d4a50fb94ee59189dbf835973e0a` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:57.160127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244edfee-a313-4f5f-a267-2f8d3b07d7f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ba1d4a50fb94ee59189dbf835973e0a)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:57.162315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244edfee-a313-4f5f-a267-2f8d3b07d7f8 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:57.226386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4362f9-e918-42c7-8abc-e4368a5b31c7 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:57.230972 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c712fd-75b2-450a-a2d4-5c9441cb1157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:57.231707 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c712fd-75b2-450a-a2d4-5c9441cb1157 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:57.231954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c712fd-75b2-450a-a2d4-5c9441cb1157 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:57.232232 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c712fd-75b2-450a-a2d4-5c9441cb1157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:57.242434 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c712fd-75b2-450a-a2d4-5c9441cb1157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:57.246299 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c712fd-75b2-450a-a2d4-5c9441cb1157 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:57.255808 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1017/2084] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:57.339760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:57.380912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-244edfee-a313-4f5f-a267-2f8d3b07d7f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ba1d4a50fb94ee59189dbf835973e0a'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:57.387331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:57.397892 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-244edfee-a313-4f5f-a267-2f8d3b07d7f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ba1d4a50fb94ee59189dbf835973e0a'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:57.454076 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:57.508991 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-244edfee-a313-4f5f-a267-2f8d3b07d7f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ba1d4a50fb94ee59189dbf835973e0a'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:57.512754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-244edfee-a313-4f5f-a267-2f8d3b07d7f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ba1d4a50fb94ee59189dbf835973e0a'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:57.518580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-244edfee-a313-4f5f-a267-2f8d3b07d7f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ba1d4a50fb94ee59189dbf835973e0a'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:57.526894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1068/2085] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:57 2022] DELETE /identity/v3/users/8ba1d4a50fb94ee59189dbf835973e0a => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:57.532668 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e9877-8013-4b98-bb57-0cd7e3022eae None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:57.532804 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e9877-8013-4b98-bb57-0cd7e3022eae None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:57.533131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e9877-8013-4b98-bb57-0cd7e3022eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:57.560323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-eb6e9877-8013-4b98-bb57-0cd7e3022eae None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:57.561868 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-eb6e9877-8013-4b98-bb57-0cd7e3022eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:57.639465 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1018/2086] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:57.648787 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244edfee-a313-4f5f-a267-2f8d3b07d7f8 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:57.650297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-244edfee-a313-4f5f-a267-2f8d3b07d7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:57.683194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:57.722079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244edfee-a313-4f5f-a267-2f8d3b07d7f8 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:57.727567 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c689c-99c5-4870-a411-533314188d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:57.728270 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c689c-99c5-4870-a411-533314188d7c service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:57.728564 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c689c-99c5-4870-a411-533314188d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:57.728826 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c689c-99c5-4870-a411-533314188d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:57.740392 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c689c-99c5-4870-a411-533314188d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:57.742014 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c689c-99c5-4870-a411-533314188d7c service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:57.754894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1069/2087] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:57.843719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:57.865236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e9877-8013-4b98-bb57-0cd7e3022eae None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:57.866669 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-eb6e9877-8013-4b98-bb57-0cd7e3022eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:57.878931 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e9877-8013-4b98-bb57-0cd7e3022eae None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:57.884408 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491ea02-8c2f-4b26-b014-3ae1195e0785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:57.885369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491ea02-8c2f-4b26-b014-3ae1195e0785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:57.886259 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491ea02-8c2f-4b26-b014-3ae1195e0785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:57.886640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491ea02-8c2f-4b26-b014-3ae1195e0785 admin admin] PATH_INFO: `/v3/users/23a3d099a57d43779c8557b89fd7cfac` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:57.887935 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491ea02-8c2f-4b26-b014-3ae1195e0785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a3d099a57d43779c8557b89fd7cfac)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:57.889932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491ea02-8c2f-4b26-b014-3ae1195e0785 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:58.108889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-4491ea02-8c2f-4b26-b014-3ae1195e0785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a3d099a57d43779c8557b89fd7cfac'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:58.132491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-4491ea02-8c2f-4b26-b014-3ae1195e0785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a3d099a57d43779c8557b89fd7cfac'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:58.140635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-4491ea02-8c2f-4b26-b014-3ae1195e0785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a3d099a57d43779c8557b89fd7cfac'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:58.269369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c689c-99c5-4870-a411-533314188d7c service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:58.270871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-191c689c-99c5-4870-a411-533314188d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:58.272489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-4491ea02-8c2f-4b26-b014-3ae1195e0785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a3d099a57d43779c8557b89fd7cfac'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:58.274503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-4491ea02-8c2f-4b26-b014-3ae1195e0785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a3d099a57d43779c8557b89fd7cfac'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:58.286663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c689c-99c5-4870-a411-533314188d7c service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:58.291060 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1019/2088] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:57 2022] DELETE /identity/v3/users/23a3d099a57d43779c8557b89fd7cfac => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:58.300441 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b5998-efb6-4e15-9df9-027839657db3 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:58.300981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b5998-efb6-4e15-9df9-027839657db3 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:58.301430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b5998-efb6-4e15-9df9-027839657db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:58.324578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-939b5998-efb6-4e15-9df9-027839657db3 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:58.326859 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-939b5998-efb6-4e15-9df9-027839657db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:58.364009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8ea9e-f783-43ce-92c9-2e0d9762d373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:58.365343 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8ea9e-f783-43ce-92c9-2e0d9762d373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:58.365343 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8ea9e-f783-43ce-92c9-2e0d9762d373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:58.365562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8ea9e-f783-43ce-92c9-2e0d9762d373 admin admin] PATH_INFO: `/v3/projects/ef55b66bd11a49a7b794e22d74e1ab0b` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:58.366770 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8ea9e-f783-43ce-92c9-2e0d9762d373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef55b66bd11a49a7b794e22d74e1ab0b)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:58.369051 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8ea9e-f783-43ce-92c9-2e0d9762d373 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:58.404092 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1020/2089] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:58.404985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b5998-efb6-4e15-9df9-027839657db3 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:58.406355 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-939b5998-efb6-4e15-9df9-027839657db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:58.419685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b5998-efb6-4e15-9df9-027839657db3 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:58.430355 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca40e7-c2dd-4c97-9057-1092adb06c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:58.431242 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca40e7-c2dd-4c97-9057-1092adb06c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:58.431558 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca40e7-c2dd-4c97-9057-1092adb06c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:58.431841 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca40e7-c2dd-4c97-9057-1092adb06c25 admin admin] PATH_INFO: `/v3/users/a9298cc7f3cd42faaf6d21556f1d7d19` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:58.433685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca40e7-c2dd-4c97-9057-1092adb06c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9298cc7f3cd42faaf6d21556f1d7d19)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:58.435796 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca40e7-c2dd-4c97-9057-1092adb06c25 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:58.476688 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-4bc8ea9e-f783-43ce-92c9-2e0d9762d373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef55b66bd11a49a7b794e22d74e1ab0b', 'request_id': 'req-4bc8ea9e-f783-43ce-92c9-2e0d9762d373'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:58.579591 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-4bc8ea9e-f783-43ce-92c9-2e0d9762d373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef55b66bd11a49a7b794e22d74e1ab0b', 'request_id': 'req-4bc8ea9e-f783-43ce-92c9-2e0d9762d373'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:58.583521 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:58.587102 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-4bc8ea9e-f783-43ce-92c9-2e0d9762d373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef55b66bd11a49a7b794e22d74e1ab0b', 'request_id': 'req-4bc8ea9e-f783-43ce-92c9-2e0d9762d373'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:58.600168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-4bc8ea9e-f783-43ce-92c9-2e0d9762d373 admin admin] The token cache is being invalidate because project ef55b66bd11a49a7b794e22d74e1ab0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:58.600463 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-4bc8ea9e-f783-43ce-92c9-2e0d9762d373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:58.601229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-4bc8ea9e-f783-43ce-92c9-2e0d9762d373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:58.602820 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1070/2090] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:58 2022] DELETE /identity/v3/projects/ef55b66bd11a49a7b794e22d74e1ab0b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:42:58.603613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8ea9e-f783-43ce-92c9-2e0d9762d373 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:58.606194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-4bc8ea9e-f783-43ce-92c9-2e0d9762d373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:58.665324 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8ea9e-f783-43ce-92c9-2e0d9762d373 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:58.668246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:58.671517 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbefd03-57c6-4791-91a3-c614e665f21a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:58.672178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbefd03-57c6-4791-91a3-c614e665f21a service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:58.672470 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbefd03-57c6-4791-91a3-c614e665f21a service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:58.673209 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbefd03-57c6-4791-91a3-c614e665f21a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:58.675059 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-fcbefd03-57c6-4791-91a3-c614e665f21a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:58.712636 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e2ca40e7-c2dd-4c97-9057-1092adb06c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9298cc7f3cd42faaf6d21556f1d7d19'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:58.728202 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e2ca40e7-c2dd-4c97-9057-1092adb06c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9298cc7f3cd42faaf6d21556f1d7d19'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:58.737056 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e2ca40e7-c2dd-4c97-9057-1092adb06c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9298cc7f3cd42faaf6d21556f1d7d19'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:58.747792 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:58.749940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbefd03-57c6-4791-91a3-c614e665f21a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:58.751529 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbefd03-57c6-4791-91a3-c614e665f21a service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:58.762722 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1071/2091] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:42:58.763619 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbefd03-57c6-4791-91a3-c614e665f21a service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:58.765010 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-fcbefd03-57c6-4791-91a3-c614e665f21a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:58.777743 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbefd03-57c6-4791-91a3-c614e665f21a service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:58.782744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e98ad-4c30-44dd-8e40-dd5791f54a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:58.783812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e98ad-4c30-44dd-8e40-dd5791f54a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:58.783967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e98ad-4c30-44dd-8e40-dd5791f54a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:58.784226 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e98ad-4c30-44dd-8e40-dd5791f54a64 admin admin] PATH_INFO: `/v3/users/ffa32afd39cf4d62aa3e1936d8508827` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:58.785666 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e98ad-4c30-44dd-8e40-dd5791f54a64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffa32afd39cf4d62aa3e1936d8508827)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:58.787717 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e98ad-4c30-44dd-8e40-dd5791f54a64 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:58.820994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e2ca40e7-c2dd-4c97-9057-1092adb06c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9298cc7f3cd42faaf6d21556f1d7d19'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:58.821650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e2ca40e7-c2dd-4c97-9057-1092adb06c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9298cc7f3cd42faaf6d21556f1d7d19'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:58.829748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1021/2092] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:58 2022] DELETE /identity/v3/users/a9298cc7f3cd42faaf6d21556f1d7d19 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:58.834246 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a501926-dc3d-4e3f-bca1-419d541cd894 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:58.834599 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a501926-dc3d-4e3f-bca1-419d541cd894 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:58.834905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a501926-dc3d-4e3f-bca1-419d541cd894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:58.856659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-9a501926-dc3d-4e3f-bca1-419d541cd894 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:42:58.857903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-9a501926-dc3d-4e3f-bca1-419d541cd894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:58.939717 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1022/2093] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:42:58.958380 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a501926-dc3d-4e3f-bca1-419d541cd894 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:58.958380 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-9a501926-dc3d-4e3f-bca1-419d541cd894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:59.047410 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a501926-dc3d-4e3f-bca1-419d541cd894 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:59.052331 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203543d9-fe1d-4e58-aa7b-8030c2cb6140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:59.052970 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203543d9-fe1d-4e58-aa7b-8030c2cb6140 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:59.053200 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203543d9-fe1d-4e58-aa7b-8030c2cb6140 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:59.053478 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203543d9-fe1d-4e58-aa7b-8030c2cb6140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:59.064035 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203543d9-fe1d-4e58-aa7b-8030c2cb6140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:59.065497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203543d9-fe1d-4e58-aa7b-8030c2cb6140 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:59.076625 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1023/2094] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:42:59.137790 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-345e98ad-4c30-44dd-8e40-dd5791f54a64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffa32afd39cf4d62aa3e1936d8508827'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:59.158144 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-345e98ad-4c30-44dd-8e40-dd5791f54a64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffa32afd39cf4d62aa3e1936d8508827'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:59.169551 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:42:59.281201 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203543d9-fe1d-4e58-aa7b-8030c2cb6140 service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:59.282886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-203543d9-fe1d-4e58-aa7b-8030c2cb6140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:59.293944 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-345e98ad-4c30-44dd-8e40-dd5791f54a64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffa32afd39cf4d62aa3e1936d8508827'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:59.295527 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-345e98ad-4c30-44dd-8e40-dd5791f54a64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffa32afd39cf4d62aa3e1936d8508827'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:59.301958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203543d9-fe1d-4e58-aa7b-8030c2cb6140 service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:59.308143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-345e98ad-4c30-44dd-8e40-dd5791f54a64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffa32afd39cf4d62aa3e1936d8508827'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:59.308873 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2e424-84b0-4bc3-9db7-e5c69a33d147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:59.309896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2e424-84b0-4bc3-9db7-e5c69a33d147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:59.310278 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2e424-84b0-4bc3-9db7-e5c69a33d147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:59.310652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2e424-84b0-4bc3-9db7-e5c69a33d147 admin admin] PATH_INFO: `/v3/projects/b895cad6cb1b405496051f2d0ce3ff80` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:59.312303 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2e424-84b0-4bc3-9db7-e5c69a33d147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b895cad6cb1b405496051f2d0ce3ff80)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:59.314800 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2e424-84b0-4bc3-9db7-e5c69a33d147 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:59.320113 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1072/2095] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:58 2022] DELETE /identity/v3/users/ffa32afd39cf4d62aa3e1936d8508827 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:59.548498 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-ecf2e424-84b0-4bc3-9db7-e5c69a33d147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b895cad6cb1b405496051f2d0ce3ff80', 'request_id': 'req-ecf2e424-84b0-4bc3-9db7-e5c69a33d147'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:59.557091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-ecf2e424-84b0-4bc3-9db7-e5c69a33d147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b895cad6cb1b405496051f2d0ce3ff80', 'request_id': 'req-ecf2e424-84b0-4bc3-9db7-e5c69a33d147'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:59.564928 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-ecf2e424-84b0-4bc3-9db7-e5c69a33d147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b895cad6cb1b405496051f2d0ce3ff80', 'request_id': 'req-ecf2e424-84b0-4bc3-9db7-e5c69a33d147'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:59.647459 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-ecf2e424-84b0-4bc3-9db7-e5c69a33d147 admin admin] The token cache is being invalidate because project b895cad6cb1b405496051f2d0ce3ff80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:42:59.647781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-ecf2e424-84b0-4bc3-9db7-e5c69a33d147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:59.648450 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-ecf2e424-84b0-4bc3-9db7-e5c69a33d147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:42:59.650013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1024/2096] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:59 2022] DELETE /identity/v3/projects/b895cad6cb1b405496051f2d0ce3ff80 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:42:59.654613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e98ad-4c30-44dd-8e40-dd5791f54a64 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:59.656143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-345e98ad-4c30-44dd-8e40-dd5791f54a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:59.722544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e98ad-4c30-44dd-8e40-dd5791f54a64 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:59.764995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2e424-84b0-4bc3-9db7-e5c69a33d147 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:42:59.766875 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ecf2e424-84b0-4bc3-9db7-e5c69a33d147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:42:59.788521 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e86b5-52f6-4e21-95e8-45305545c66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:59.789364 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e86b5-52f6-4e21-95e8-45305545c66e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:59.789594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e86b5-52f6-4e21-95e8-45305545c66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:59.789879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e86b5-52f6-4e21-95e8-45305545c66e admin admin] PATH_INFO: `/v3/users/3d63702fa2954d7691fdd70bebfc94b1` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:59.791160 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e86b5-52f6-4e21-95e8-45305545c66e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d63702fa2954d7691fdd70bebfc94b1)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:59.794704 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e86b5-52f6-4e21-95e8-45305545c66e admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:42:59.877986 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2e424-84b0-4bc3-9db7-e5c69a33d147 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:42:59.883066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bcec8-a675-4400-bd8d-2a06bbaa8518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:42:59.883969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bcec8-a675-4400-bd8d-2a06bbaa8518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:42:59.884259 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bcec8-a675-4400-bd8d-2a06bbaa8518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:42:59.884533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bcec8-a675-4400-bd8d-2a06bbaa8518 admin admin] PATH_INFO: `/v3/projects/e8c11dc48c454c1e8ddbd1e6c5ffa21e` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:42:59.886273 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bcec8-a675-4400-bd8d-2a06bbaa8518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8c11dc48c454c1e8ddbd1e6c5ffa21e)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:42:59.888226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bcec8-a675-4400-bd8d-2a06bbaa8518 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:00.009871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-d06e86b5-52f6-4e21-95e8-45305545c66e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d63702fa2954d7691fdd70bebfc94b1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.023632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-d06e86b5-52f6-4e21-95e8-45305545c66e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d63702fa2954d7691fdd70bebfc94b1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.033849 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:00.052747 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-862bcec8-a675-4400-bd8d-2a06bbaa8518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8c11dc48c454c1e8ddbd1e6c5ffa21e', 'request_id': 'req-862bcec8-a675-4400-bd8d-2a06bbaa8518'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.058632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-862bcec8-a675-4400-bd8d-2a06bbaa8518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8c11dc48c454c1e8ddbd1e6c5ffa21e', 'request_id': 'req-862bcec8-a675-4400-bd8d-2a06bbaa8518'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.065705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-862bcec8-a675-4400-bd8d-2a06bbaa8518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8c11dc48c454c1e8ddbd1e6c5ffa21e', 'request_id': 'req-862bcec8-a675-4400-bd8d-2a06bbaa8518'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.173998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-d06e86b5-52f6-4e21-95e8-45305545c66e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d63702fa2954d7691fdd70bebfc94b1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.174693 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-d06e86b5-52f6-4e21-95e8-45305545c66e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d63702fa2954d7691fdd70bebfc94b1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.183666 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-d06e86b5-52f6-4e21-95e8-45305545c66e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d63702fa2954d7691fdd70bebfc94b1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.189758 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1073/2097] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:42:59 2022] DELETE /identity/v3/users/3d63702fa2954d7691fdd70bebfc94b1 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:00.190555 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e86b5-52f6-4e21-95e8-45305545c66e admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:00.193738 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d06e86b5-52f6-4e21-95e8-45305545c66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:00.246853 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-862bcec8-a675-4400-bd8d-2a06bbaa8518 admin admin] The token cache is being invalidate because project e8c11dc48c454c1e8ddbd1e6c5ffa21e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:43:00.247483 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-862bcec8-a675-4400-bd8d-2a06bbaa8518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.248619 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-862bcec8-a675-4400-bd8d-2a06bbaa8518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.255538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1025/2098] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:42:59 2022] DELETE /identity/v3/projects/e8c11dc48c454c1e8ddbd1e6c5ffa21e => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:43:00.256687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bcec8-a675-4400-bd8d-2a06bbaa8518 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:00.258529 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-862bcec8-a675-4400-bd8d-2a06bbaa8518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:00.274145 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e86b5-52f6-4e21-95e8-45305545c66e admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:00.281200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350642d-ca7d-4b2a-9b28-68d121c3d611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:00.282129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350642d-ca7d-4b2a-9b28-68d121c3d611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:00.282421 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350642d-ca7d-4b2a-9b28-68d121c3d611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:00.282684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350642d-ca7d-4b2a-9b28-68d121c3d611 admin admin] PATH_INFO: `/v3/projects/aee66891254a4b7db16138718930c0a5` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:00.283967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350642d-ca7d-4b2a-9b28-68d121c3d611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee66891254a4b7db16138718930c0a5)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:00.286025 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350642d-ca7d-4b2a-9b28-68d121c3d611 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:00.331934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bcec8-a675-4400-bd8d-2a06bbaa8518 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:00.336880 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ea595-43ec-405b-a8ed-bd577d03cd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:00.337813 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ea595-43ec-405b-a8ed-bd577d03cd72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:00.338092 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ea595-43ec-405b-a8ed-bd577d03cd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:00.338489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ea595-43ec-405b-a8ed-bd577d03cd72 admin admin] PATH_INFO: `/v3/users/0e0e4eafd0394426bd5cf3d8d6294d3d` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:00.339774 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ea595-43ec-405b-a8ed-bd577d03cd72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e0e4eafd0394426bd5cf3d8d6294d3d)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:00.341789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ea595-43ec-405b-a8ed-bd577d03cd72 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:00.498298 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1350642d-ca7d-4b2a-9b28-68d121c3d611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee66891254a4b7db16138718930c0a5', 'request_id': 'req-1350642d-ca7d-4b2a-9b28-68d121c3d611'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.613574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1350642d-ca7d-4b2a-9b28-68d121c3d611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee66891254a4b7db16138718930c0a5', 'request_id': 'req-1350642d-ca7d-4b2a-9b28-68d121c3d611'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.621545 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1350642d-ca7d-4b2a-9b28-68d121c3d611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee66891254a4b7db16138718930c0a5', 'request_id': 'req-1350642d-ca7d-4b2a-9b28-68d121c3d611'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.630508 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-2f7ea595-43ec-405b-a8ed-bd577d03cd72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e0e4eafd0394426bd5cf3d8d6294d3d'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.633184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1350642d-ca7d-4b2a-9b28-68d121c3d611 admin admin] The token cache is being invalidate because project aee66891254a4b7db16138718930c0a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:43:00.633480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1350642d-ca7d-4b2a-9b28-68d121c3d611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.635720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1350642d-ca7d-4b2a-9b28-68d121c3d611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.640665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1074/2099] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:43:00 2022] DELETE /identity/v3/projects/aee66891254a4b7db16138718930c0a5 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:00.641759 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350642d-ca7d-4b2a-9b28-68d121c3d611 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:00.643143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1350642d-ca7d-4b2a-9b28-68d121c3d611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:00.647671 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-2f7ea595-43ec-405b-a8ed-bd577d03cd72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e0e4eafd0394426bd5cf3d8d6294d3d'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.655621 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-2f7ea595-43ec-405b-a8ed-bd577d03cd72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e0e4eafd0394426bd5cf3d8d6294d3d'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.711993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350642d-ca7d-4b2a-9b28-68d121c3d611 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:00.716918 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48bf21-ccbb-4d49-ac24-df8a1e5a4896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:00.717827 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48bf21-ccbb-4d49-ac24-df8a1e5a4896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:00.718238 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48bf21-ccbb-4d49-ac24-df8a1e5a4896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:00.718505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48bf21-ccbb-4d49-ac24-df8a1e5a4896 admin admin] PATH_INFO: `/v3/users/fb659e0219514a028a6314af73790a11` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:00.719782 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48bf21-ccbb-4d49-ac24-df8a1e5a4896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb659e0219514a028a6314af73790a11)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:00.721753 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48bf21-ccbb-4d49-ac24-df8a1e5a4896 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:00.727875 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-2f7ea595-43ec-405b-a8ed-bd577d03cd72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e0e4eafd0394426bd5cf3d8d6294d3d'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.728510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-2f7ea595-43ec-405b-a8ed-bd577d03cd72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e0e4eafd0394426bd5cf3d8d6294d3d'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.737238 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1026/2100] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:43:00 2022] DELETE /identity/v3/users/0e0e4eafd0394426bd5cf3d8d6294d3d => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:00.738594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ea595-43ec-405b-a8ed-bd577d03cd72 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:00.739530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2f7ea595-43ec-405b-a8ed-bd577d03cd72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:00.813702 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ea595-43ec-405b-a8ed-bd577d03cd72 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:00.818387 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45b0b6-a9df-4240-bc0a-b2c5909eabd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:00.819256 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45b0b6-a9df-4240-bc0a-b2c5909eabd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:00.819569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45b0b6-a9df-4240-bc0a-b2c5909eabd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:00.819852 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45b0b6-a9df-4240-bc0a-b2c5909eabd9 admin admin] PATH_INFO: `/v3/projects/0fd8b0df40864c5cb090c4c831ca9348` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:00.821044 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45b0b6-a9df-4240-bc0a-b2c5909eabd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd8b0df40864c5cb090c4c831ca9348)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:00.823798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45b0b6-a9df-4240-bc0a-b2c5909eabd9 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:00.962099 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:00.975254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7a48bf21-ccbb-4d49-ac24-df8a1e5a4896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb659e0219514a028a6314af73790a11'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:00.986767 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7a48bf21-ccbb-4d49-ac24-df8a1e5a4896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb659e0219514a028a6314af73790a11'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:01.033058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8c45b0b6-a9df-4240-bc0a-b2c5909eabd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd8b0df40864c5cb090c4c831ca9348', 'request_id': 'req-8c45b0b6-a9df-4240-bc0a-b2c5909eabd9'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:01.047082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8c45b0b6-a9df-4240-bc0a-b2c5909eabd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd8b0df40864c5cb090c4c831ca9348', 'request_id': 'req-8c45b0b6-a9df-4240-bc0a-b2c5909eabd9'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:01.062458 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8c45b0b6-a9df-4240-bc0a-b2c5909eabd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd8b0df40864c5cb090c4c831ca9348', 'request_id': 'req-8c45b0b6-a9df-4240-bc0a-b2c5909eabd9'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:01.151601 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7a48bf21-ccbb-4d49-ac24-df8a1e5a4896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb659e0219514a028a6314af73790a11'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:01.152236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7a48bf21-ccbb-4d49-ac24-df8a1e5a4896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb659e0219514a028a6314af73790a11'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:01.159858 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7a48bf21-ccbb-4d49-ac24-df8a1e5a4896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb659e0219514a028a6314af73790a11'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:01.165908 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1075/2101] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:43:00 2022] DELETE /identity/v3/users/fb659e0219514a028a6314af73790a11 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:01.282635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8c45b0b6-a9df-4240-bc0a-b2c5909eabd9 admin admin] The token cache is being invalidate because project 0fd8b0df40864c5cb090c4c831ca9348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:43:01.283336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8c45b0b6-a9df-4240-bc0a-b2c5909eabd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:01.284909 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48bf21-ccbb-4d49-ac24-df8a1e5a4896 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:01.285050 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8c45b0b6-a9df-4240-bc0a-b2c5909eabd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:01.286681 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1027/2102] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:43:00 2022] DELETE /identity/v3/projects/0fd8b0df40864c5cb090c4c831ca9348 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:01.287878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7a48bf21-ccbb-4d49-ac24-df8a1e5a4896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:01.291998 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaf0b7-9bc0-4dc5-bfd8-fffab0df70a2 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:01.292456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaf0b7-9bc0-4dc5-bfd8-fffab0df70a2 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:01.310942 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaf0b7-9bc0-4dc5-bfd8-fffab0df70a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:01.344347 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-50aaf0b7-9bc0-4dc5-bfd8-fffab0df70a2 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:01.345561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-50aaf0b7-9bc0-4dc5-bfd8-fffab0df70a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:01.374546 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48bf21-ccbb-4d49-ac24-df8a1e5a4896 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:01.379509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d69e4e-3f9a-4d86-8db0-84451a64009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:01.380371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d69e4e-3f9a-4d86-8db0-84451a64009a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:01.380650 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d69e4e-3f9a-4d86-8db0-84451a64009a admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:01.380955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d69e4e-3f9a-4d86-8db0-84451a64009a admin admin] PATH_INFO: `/v3/projects/64e52a19df3846489e1eb1c381025274` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:01.382400 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d69e4e-3f9a-4d86-8db0-84451a64009a admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e52a19df3846489e1eb1c381025274)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:01.384376 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d69e4e-3f9a-4d86-8db0-84451a64009a admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:01.408817 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1028/2103] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:01.416361 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1937b4-3348-455d-ba58-fb307c9cf254 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:01.417324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1937b4-3348-455d-ba58-fb307c9cf254 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:01.417702 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1937b4-3348-455d-ba58-fb307c9cf254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:01.436731 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-ce1937b4-3348-455d-ba58-fb307c9cf254 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:01.437946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ce1937b4-3348-455d-ba58-fb307c9cf254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:01.446147 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1029/2104] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:43:01.452162 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1937b4-3348-455d-ba58-fb307c9cf254 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:01.462467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1937b4-3348-455d-ba58-fb307c9cf254 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:01.468444 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f38bab-3d3d-4473-b769-5d263537b8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:01.469652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38bab-3d3d-4473-b769-5d263537b8bd admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:01.469652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38bab-3d3d-4473-b769-5d263537b8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:01.469830 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38bab-3d3d-4473-b769-5d263537b8bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:01.470516 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f38bab-3d3d-4473-b769-5d263537b8bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:43:01.472716 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f38bab-3d3d-4473-b769-5d263537b8bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:01.472716 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f38bab-3d3d-4473-b769-5d263537b8bd admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:01.487096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1030/2105] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:43:01.491144 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-85d69e4e-3f9a-4d86-8db0-84451a64009a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e52a19df3846489e1eb1c381025274', 'request_id': 'req-85d69e4e-3f9a-4d86-8db0-84451a64009a'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:01.491695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f38bab-3d3d-4473-b769-5d263537b8bd admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:01.502396 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f38bab-3d3d-4473-b769-5d263537b8bd admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:01.562655 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64b827-b7af-41f8-b442-bdb88d3ce0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:01.563358 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64b827-b7af-41f8-b442-bdb88d3ce0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:01.563645 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64b827-b7af-41f8-b442-bdb88d3ce0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:01.563938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64b827-b7af-41f8-b442-bdb88d3ce0f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:01.564769 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64b827-b7af-41f8-b442-bdb88d3ce0f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:01.566697 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64b827-b7af-41f8-b442-bdb88d3ce0f0 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:01.583484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-85d69e4e-3f9a-4d86-8db0-84451a64009a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e52a19df3846489e1eb1c381025274', 'request_id': 'req-85d69e4e-3f9a-4d86-8db0-84451a64009a'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:01.590557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-85d69e4e-3f9a-4d86-8db0-84451a64009a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e52a19df3846489e1eb1c381025274', 'request_id': 'req-85d69e4e-3f9a-4d86-8db0-84451a64009a'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:01.602475 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-85d69e4e-3f9a-4d86-8db0-84451a64009a admin admin] The token cache is being invalidate because project 64e52a19df3846489e1eb1c381025274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:43:01.602965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-85d69e4e-3f9a-4d86-8db0-84451a64009a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:01.603657 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-85d69e4e-3f9a-4d86-8db0-84451a64009a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:01.606536 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1076/2106] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:43:01 2022] DELETE /identity/v3/projects/64e52a19df3846489e1eb1c381025274 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:01.612062 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728db6d-393a-47e8-af05-1111b8345e12 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:01.612370 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728db6d-393a-47e8-af05-1111b8345e12 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:01.612674 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728db6d-393a-47e8-af05-1111b8345e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:01.632161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-5728db6d-393a-47e8-af05-1111b8345e12 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:01.634435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-5728db6d-393a-47e8-af05-1111b8345e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:01.642204 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1077/2107] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:43:01.649274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e283c-f002-4b56-9c5c-50cf13931376 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:01.649665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e283c-f002-4b56-9c5c-50cf13931376 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:01.649949 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e283c-f002-4b56-9c5c-50cf13931376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:01.671167 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-990e283c-f002-4b56-9c5c-50cf13931376 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:01.672685 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-990e283c-f002-4b56-9c5c-50cf13931376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:01.684935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1078/2108] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:43:01.685842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e283c-f002-4b56-9c5c-50cf13931376 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:01.696150 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e283c-f002-4b56-9c5c-50cf13931376 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:01.702123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59668827-c4b1-4d47-b334-2c67b411df66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:01.702587 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59668827-c4b1-4d47-b334-2c67b411df66 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:01.702878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59668827-c4b1-4d47-b334-2c67b411df66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:01.703163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59668827-c4b1-4d47-b334-2c67b411df66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:01.703947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59668827-c4b1-4d47-b334-2c67b411df66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:43:01.704264 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59668827-c4b1-4d47-b334-2c67b411df66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:01.705866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59668827-c4b1-4d47-b334-2c67b411df66 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:01.724500 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1031/2109] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:43:01 2022] POST /identity/v3/projects => generated 375 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:01.725514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64b827-b7af-41f8-b442-bdb88d3ce0f0 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:01.732676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-8a64b827-b7af-41f8-b442-bdb88d3ce0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:01.751470 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1079/2110] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:43:01.752401 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59668827-c4b1-4d47-b334-2c67b411df66 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:01.754668 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-59668827-c4b1-4d47-b334-2c67b411df66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:01.780266 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59668827-c4b1-4d47-b334-2c67b411df66 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:01.828805 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64b827-b7af-41f8-b442-bdb88d3ce0f0 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:01.836126 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1dbf7-9cc2-407e-8bb4-56d60058d9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:01.837140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1dbf7-9cc2-407e-8bb4-56d60058d9b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:01.837529 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1dbf7-9cc2-407e-8bb4-56d60058d9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:01.837904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1dbf7-9cc2-407e-8bb4-56d60058d9b6 admin admin] PATH_INFO: `/v3/projects/e00c329573b946a39081a7883d219d10` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:01.840436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1dbf7-9cc2-407e-8bb4-56d60058d9b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e00c329573b946a39081a7883d219d10)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:01.843093 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1dbf7-9cc2-407e-8bb4-56d60058d9b6 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:01.876295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e2d94-83a9-4892-96df-3577c8244354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:01.877706 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e2d94-83a9-4892-96df-3577c8244354 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:01.878121 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e2d94-83a9-4892-96df-3577c8244354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:01.878657 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e2d94-83a9-4892-96df-3577c8244354 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:01.880090 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e2d94-83a9-4892-96df-3577c8244354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:01.883499 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e2d94-83a9-4892-96df-3577c8244354 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:01.989598 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:02.007789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6ce1dbf7-9cc2-407e-8bb4-56d60058d9b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e00c329573b946a39081a7883d219d10', 'request_id': 'req-6ce1dbf7-9cc2-407e-8bb4-56d60058d9b6'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:02.013822 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6ce1dbf7-9cc2-407e-8bb4-56d60058d9b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e00c329573b946a39081a7883d219d10', 'request_id': 'req-6ce1dbf7-9cc2-407e-8bb4-56d60058d9b6'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:02.022707 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6ce1dbf7-9cc2-407e-8bb4-56d60058d9b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e00c329573b946a39081a7883d219d10', 'request_id': 'req-6ce1dbf7-9cc2-407e-8bb4-56d60058d9b6'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:02.031515 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1080/2111] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:43:01 2022] POST /identity/v3/users => generated 288 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:02.031515 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e2d94-83a9-4892-96df-3577c8244354 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:02.040311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e2d94-83a9-4892-96df-3577c8244354 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:02.098808 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3582a8-58a3-45b9-b241-1600610bbc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:02.099503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3582a8-58a3-45b9-b241-1600610bbc02 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:02.099913 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3582a8-58a3-45b9-b241-1600610bbc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:02.100062 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3582a8-58a3-45b9-b241-1600610bbc02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:02.100764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3582a8-58a3-45b9-b241-1600610bbc02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:02.102666 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3582a8-58a3-45b9-b241-1600610bbc02 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:02.147371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6ce1dbf7-9cc2-407e-8bb4-56d60058d9b6 admin admin] The token cache is being invalidate because project e00c329573b946a39081a7883d219d10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:43:02.147671 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6ce1dbf7-9cc2-407e-8bb4-56d60058d9b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:02.148493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-6ce1dbf7-9cc2-407e-8bb4-56d60058d9b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:02.153632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1032/2112] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:43:01 2022] DELETE /identity/v3/projects/e00c329573b946a39081a7883d219d10 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:02.153632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1dbf7-9cc2-407e-8bb4-56d60058d9b6 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:02.153632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-6ce1dbf7-9cc2-407e-8bb4-56d60058d9b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:02.167486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1dbf7-9cc2-407e-8bb4-56d60058d9b6 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:02.172566 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2e7d8-9086-462a-9234-f18f62388c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:02.173244 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2e7d8-9086-462a-9234-f18f62388c0f admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:02.173535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2e7d8-9086-462a-9234-f18f62388c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:02.173813 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2e7d8-9086-462a-9234-f18f62388c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:02.174563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2e7d8-9086-462a-9234-f18f62388c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:02.176213 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2e7d8-9086-462a-9234-f18f62388c0f admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:02.186816 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1033/2113] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:02.188451 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9fabe-b3ae-4bda-8766-db05bbd199fd None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:02.188761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9fabe-b3ae-4bda-8766-db05bbd199fd None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:02.189258 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9fabe-b3ae-4bda-8766-db05bbd199fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:02.215584 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-36f9fabe-b3ae-4bda-8766-db05bbd199fd None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:02.216932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-36f9fabe-b3ae-4bda-8766-db05bbd199fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:02.226246 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1034/2114] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:02.226379 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9fabe-b3ae-4bda-8766-db05bbd199fd None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:02.235982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9fabe-b3ae-4bda-8766-db05bbd199fd None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:02.241351 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94838875-1e44-445e-a9be-665b82ac522c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:02.242035 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94838875-1e44-445e-a9be-665b82ac522c admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:02.242322 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94838875-1e44-445e-a9be-665b82ac522c admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:02.242601 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94838875-1e44-445e-a9be-665b82ac522c admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:02.244000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94838875-1e44-445e-a9be-665b82ac522c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:02.253531 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1081/2115] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:43:02 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:02.254919 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae990d46-9262-44e2-b0a6-a0a92e3c664b None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:02.255348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae990d46-9262-44e2-b0a6-a0a92e3c664b None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:02.255459 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae990d46-9262-44e2-b0a6-a0a92e3c664b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:02.261735 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94838875-1e44-445e-a9be-665b82ac522c admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:02.268263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1035/2116] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:02.269555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94838875-1e44-445e-a9be-665b82ac522c admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:02.272031 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-94838875-1e44-445e-a9be-665b82ac522c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:02.278384 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-ae990d46-9262-44e2-b0a6-a0a92e3c664b None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:02.279617 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ae990d46-9262-44e2-b0a6-a0a92e3c664b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:02.286421 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94838875-1e44-445e-a9be-665b82ac522c admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:02.344624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1082/2117] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:02.345460 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae990d46-9262-44e2-b0a6-a0a92e3c664b None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:02.350371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba804fb-e6be-40c4-aca5-a549580bfaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:02.351050 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba804fb-e6be-40c4-aca5-a549580bfaed admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:02.351372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba804fb-e6be-40c4-aca5-a549580bfaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:02.352409 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba804fb-e6be-40c4-aca5-a549580bfaed admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:02.352409 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba804fb-e6be-40c4-aca5-a549580bfaed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:02.354369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba804fb-e6be-40c4-aca5-a549580bfaed admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:02.355343 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae990d46-9262-44e2-b0a6-a0a92e3c664b None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:02.360862 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b5d1d-73ab-4c1c-b3bd-4c442aac1c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:02.361831 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b5d1d-73ab-4c1c-b3bd-4c442aac1c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:02.362119 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b5d1d-73ab-4c1c-b3bd-4c442aac1c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:02.362399 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b5d1d-73ab-4c1c-b3bd-4c442aac1c56 admin admin] PATH_INFO: `/v3/projects/bf642163cc154d8dac38761817f5b65a/users/91b9fbfd07df4bf79cc1139c641ce573/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:02.381079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b5d1d-73ab-4c1c-b3bd-4c442aac1c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf642163cc154d8dac38761817f5b65a, user_id=91b9fbfd07df4bf79cc1139c641ce573, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:02.382730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b5d1d-73ab-4c1c-b3bd-4c442aac1c56 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:02.440327 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1036/2118] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:43:02 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:02.441302 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba804fb-e6be-40c4-aca5-a549580bfaed admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:02.451539 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba804fb-e6be-40c4-aca5-a549580bfaed admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:02.456452 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a88ed-87f1-4151-91ea-651c77fab71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:02.457091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a88ed-87f1-4151-91ea-651c77fab71b admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:02.457373 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a88ed-87f1-4151-91ea-651c77fab71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:02.457649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a88ed-87f1-4151-91ea-651c77fab71b admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:02.458427 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a88ed-87f1-4151-91ea-651c77fab71b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:43:02.458733 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a88ed-87f1-4151-91ea-651c77fab71b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:02.460417 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a88ed-87f1-4151-91ea-651c77fab71b admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:02.473950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1037/2119] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:43:02.478494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a88ed-87f1-4151-91ea-651c77fab71b admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:02.484767 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a88ed-87f1-4151-91ea-651c77fab71b admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:02.489517 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54051ee5-b301-44e7-9353-248d687c15a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:02.490180 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54051ee5-b301-44e7-9353-248d687c15a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:02.490457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54051ee5-b301-44e7-9353-248d687c15a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:02.490732 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54051ee5-b301-44e7-9353-248d687c15a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:02.491484 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54051ee5-b301-44e7-9353-248d687c15a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:02.493097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54051ee5-b301-44e7-9353-248d687c15a3 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:02.503632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1083/2120] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:43:02 2022] PUT /identity/v3/projects/bf642163cc154d8dac38761817f5b65a/users/91b9fbfd07df4bf79cc1139c641ce573/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:02.504001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1038/2121] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:02.507440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b5d1d-73ab-4c1c-b3bd-4c442aac1c56 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:02.510209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54051ee5-b301-44e7-9353-248d687c15a3 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:02.525535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54051ee5-b301-44e7-9353-248d687c15a3 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:02.574989 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b5d1d-73ab-4c1c-b3bd-4c442aac1c56 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:02.580051 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8f613-f983-4885-818d-15f34afcdd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:02.580750 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8f613-f983-4885-818d-15f34afcdd16 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:02.581039 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8f613-f983-4885-818d-15f34afcdd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:02.581321 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8f613-f983-4885-818d-15f34afcdd16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:02.582024 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8f613-f983-4885-818d-15f34afcdd16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:02.584079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8f613-f983-4885-818d-15f34afcdd16 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:02.587393 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75fd66-2659-48a9-ad5f-f2d5818cb9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:02.588092 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75fd66-2659-48a9-ad5f-f2d5818cb9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:02.588432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75fd66-2659-48a9-ad5f-f2d5818cb9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:02.588729 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75fd66-2659-48a9-ad5f-f2d5818cb9b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:02.589435 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75fd66-2659-48a9-ad5f-f2d5818cb9b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:02.591025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75fd66-2659-48a9-ad5f-f2d5818cb9b1 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:02.602004 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1039/2122] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:43:02.603442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb805bd-cbe6-49d9-a85e-9eb3890cb265 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:02.603701 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb805bd-cbe6-49d9-a85e-9eb3890cb265 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:02.603977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb805bd-cbe6-49d9-a85e-9eb3890cb265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:02.631804 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-1fb805bd-cbe6-49d9-a85e-9eb3890cb265 None None] MFA Rules not processed for user `91b9fbfd07df4bf79cc1139c641ce573`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:02.633182 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-1fb805bd-cbe6-49d9-a85e-9eb3890cb265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:02.695464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1084/2123] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:43:02 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:02.697367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1040/2124] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:02.697474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8f613-f983-4885-818d-15f34afcdd16 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:02.707681 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb805bd-cbe6-49d9-a85e-9eb3890cb265 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:02.716719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:02.721744 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb805bd-cbe6-49d9-a85e-9eb3890cb265 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:02.765913 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8f613-f983-4885-818d-15f34afcdd16 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:02.770622 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdde4a-eeec-46a5-9104-286ac2242d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:02.771566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdde4a-eeec-46a5-9104-286ac2242d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:02.771901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdde4a-eeec-46a5-9104-286ac2242d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:02.772190 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdde4a-eeec-46a5-9104-286ac2242d58 admin admin] PATH_INFO: `/v3/projects/a0ac4596504942f7bed555a928abb4cb/users/231fa047245240c8978de4820d91a515/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:02.783165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b1189-9dd9-477c-b726-7151a6d073cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:02.783879 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b1189-9dd9-477c-b726-7151a6d073cf admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:02.784204 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b1189-9dd9-477c-b726-7151a6d073cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:02.784482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b1189-9dd9-477c-b726-7151a6d073cf admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:02.785175 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b1189-9dd9-477c-b726-7151a6d073cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:02.787097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b1189-9dd9-477c-b726-7151a6d073cf admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:02.787367 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdde4a-eeec-46a5-9104-286ac2242d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0ac4596504942f7bed555a928abb4cb, user_id=231fa047245240c8978de4820d91a515, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:02.789951 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdde4a-eeec-46a5-9104-286ac2242d58 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:02.905847 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1085/2125] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:43:02 2022] PUT /identity/v3/projects/a0ac4596504942f7bed555a928abb4cb/users/231fa047245240c8978de4820d91a515/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:02.906632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdde4a-eeec-46a5-9104-286ac2242d58 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:02.908239 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-79cdde4a-eeec-46a5-9104-286ac2242d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:02.947212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1041/2126] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:43:02 2022] POST /identity/v3/users => generated 287 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:02.947212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14025f95-9f14-430a-a8c0-dda436d4b169 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:02.947212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14025f95-9f14-430a-a8c0-dda436d4b169 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:02.947212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14025f95-9f14-430a-a8c0-dda436d4b169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:02.968898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdde4a-eeec-46a5-9104-286ac2242d58 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:02.978561 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de417b13-3d78-4192-ac39-ef8c3945ddd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:02.978561 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de417b13-3d78-4192-ac39-ef8c3945ddd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:02.978561 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de417b13-3d78-4192-ac39-ef8c3945ddd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:02.978561 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de417b13-3d78-4192-ac39-ef8c3945ddd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:02.987129 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-14025f95-9f14-430a-a8c0-dda436d4b169 None None] MFA Rules not processed for user `231fa047245240c8978de4820d91a515`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:02.988410 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-14025f95-9f14-430a-a8c0-dda436d4b169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:03.041931 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de417b13-3d78-4192-ac39-ef8c3945ddd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:03.044635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de417b13-3d78-4192-ac39-ef8c3945ddd8 service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:03.054152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1086/2127] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:03.055234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de417b13-3d78-4192-ac39-ef8c3945ddd8 service cinder] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:03.078690 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1042/2128] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:03.079603 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:03.092622 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14025f95-9f14-430a-a8c0-dda436d4b169 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:03.094028 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-14025f95-9f14-430a-a8c0-dda436d4b169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:03.111067 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14025f95-9f14-430a-a8c0-dda436d4b169 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:03.115578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fb9a7-ef9e-49f7-a690-abdd3c3670f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:03.116682 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fb9a7-ef9e-49f7-a690-abdd3c3670f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:03.117018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fb9a7-ef9e-49f7-a690-abdd3c3670f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:03.117348 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fb9a7-ef9e-49f7-a690-abdd3c3670f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:03.139107 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042fb9a7-ef9e-49f7-a690-abdd3c3670f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:03.140767 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042fb9a7-ef9e-49f7-a690-abdd3c3670f2 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:03.152054 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1043/2129] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:43:03.160686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de417b13-3d78-4192-ac39-ef8c3945ddd8 service cinder] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:03.167133 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46a662-6b11-47e0-898a-5195d0fb532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:03.168122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46a662-6b11-47e0-898a-5195d0fb532c admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:03.168424 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46a662-6b11-47e0-898a-5195d0fb532c admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:03.168679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46a662-6b11-47e0-898a-5195d0fb532c admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:03.169608 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46a662-6b11-47e0-898a-5195d0fb532c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:03.171268 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46a662-6b11-47e0-898a-5195d0fb532c admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:03.182961 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1087/2130] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:03.190277 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fb9a7-ef9e-49f7-a690-abdd3c3670f2 service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:03.203375 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fb9a7-ef9e-49f7-a690-abdd3c3670f2 service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:03.208355 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79246d18-defe-463a-9fc0-2ab3349729cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:03.209021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79246d18-defe-463a-9fc0-2ab3349729cb admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:03.209467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79246d18-defe-463a-9fc0-2ab3349729cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:03.209894 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79246d18-defe-463a-9fc0-2ab3349729cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:03.210759 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79246d18-defe-463a-9fc0-2ab3349729cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:03.212534 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79246d18-defe-463a-9fc0-2ab3349729cb admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:03.225595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1044/2131] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:03.229577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46a662-6b11-47e0-898a-5195d0fb532c admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:03.240736 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46a662-6b11-47e0-898a-5195d0fb532c admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:03.247155 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8f9a8-4a6d-4e8d-a82e-bee8fb4d1300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:03.248562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8f9a8-4a6d-4e8d-a82e-bee8fb4d1300 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:03.249020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8f9a8-4a6d-4e8d-a82e-bee8fb4d1300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:03.249477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8f9a8-4a6d-4e8d-a82e-bee8fb4d1300 admin admin] PATH_INFO: `/v3/projects/d67f3e63e32649f2b9c51ba820df61ed/users/389c703353304654a3d6c3dffac3f423/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:03.271336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8f9a8-4a6d-4e8d-a82e-bee8fb4d1300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67f3e63e32649f2b9c51ba820df61ed, user_id=389c703353304654a3d6c3dffac3f423, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:03.274776 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8f9a8-4a6d-4e8d-a82e-bee8fb4d1300 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:03.394378 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1088/2132] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:43:03 2022] PUT /identity/v3/projects/d67f3e63e32649f2b9c51ba820df61ed/users/389c703353304654a3d6c3dffac3f423/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:03.399637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291675-5196-440d-80db-2b6a791162f2 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:03.400122 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291675-5196-440d-80db-2b6a791162f2 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:03.400233 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291675-5196-440d-80db-2b6a791162f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:03.419841 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-b6291675-5196-440d-80db-2b6a791162f2 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:03.420976 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b6291675-5196-440d-80db-2b6a791162f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:03.491549 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1045/2133] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:43:03.501441 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8f9a8-4a6d-4e8d-a82e-bee8fb4d1300 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:03.503139 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-bbb8f9a8-4a6d-4e8d-a82e-bee8fb4d1300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:03.562908 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8f9a8-4a6d-4e8d-a82e-bee8fb4d1300 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:03.566640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19ec7a-3068-4b2a-b702-043035fe214c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:03.567304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19ec7a-3068-4b2a-b702-043035fe214c service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:03.567608 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19ec7a-3068-4b2a-b702-043035fe214c service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:03.567893 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19ec7a-3068-4b2a-b702-043035fe214c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:03.577101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19ec7a-3068-4b2a-b702-043035fe214c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:03.578536 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19ec7a-3068-4b2a-b702-043035fe214c service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:03.588618 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1089/2134] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:04.711788 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:05.343504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:07.044040 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:07.463197 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:07.635466 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6291675-5196-440d-80db-2b6a791162f2 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:07.648541 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6291675-5196-440d-80db-2b6a791162f2 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:07.656270 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75880e6b-24f4-4467-af27-b88e056366fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:07.657294 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75880e6b-24f4-4467-af27-b88e056366fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:07.657911 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75880e6b-24f4-4467-af27-b88e056366fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:07.658048 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75880e6b-24f4-4467-af27-b88e056366fe admin admin] PATH_INFO: `/v3/users/231fa047245240c8978de4820d91a515` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:07.659397 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75880e6b-24f4-4467-af27-b88e056366fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=231fa047245240c8978de4820d91a515)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:07.661717 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75880e6b-24f4-4467-af27-b88e056366fe admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:07.891057 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-75880e6b-24f4-4467-af27-b88e056366fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231fa047245240c8978de4820d91a515'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:07.918938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-75880e6b-24f4-4467-af27-b88e056366fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231fa047245240c8978de4820d91a515'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:07.940245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-75880e6b-24f4-4467-af27-b88e056366fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231fa047245240c8978de4820d91a515'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:08.031809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-75880e6b-24f4-4467-af27-b88e056366fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231fa047245240c8978de4820d91a515'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:08.032254 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-75880e6b-24f4-4467-af27-b88e056366fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231fa047245240c8978de4820d91a515'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:08.051730 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1046/2135] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:43:07 2022] DELETE /identity/v3/users/231fa047245240c8978de4820d91a515 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:08.053661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d546ed-3739-4238-a119-a6e2fea3b41a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:08.054125 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d546ed-3739-4238-a119-a6e2fea3b41a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:08.054235 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d546ed-3739-4238-a119-a6e2fea3b41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:08.083254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-a3d546ed-3739-4238-a119-a6e2fea3b41a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:08.085422 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a3d546ed-3739-4238-a119-a6e2fea3b41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:08.192323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1090/2136] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:43:08.202957 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75880e6b-24f4-4467-af27-b88e056366fe admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:08.204695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-75880e6b-24f4-4467-af27-b88e056366fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:08.270506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75880e6b-24f4-4467-af27-b88e056366fe admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:08.274558 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33898ae-bafd-4cc3-97d6-1b09b87997d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:08.275400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33898ae-bafd-4cc3-97d6-1b09b87997d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:08.275755 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33898ae-bafd-4cc3-97d6-1b09b87997d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:08.276170 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33898ae-bafd-4cc3-97d6-1b09b87997d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:08.286812 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33898ae-bafd-4cc3-97d6-1b09b87997d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:08.288319 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33898ae-bafd-4cc3-97d6-1b09b87997d2 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:08.301899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1047/2137] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:08.827830 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d546ed-3739-4238-a119-a6e2fea3b41a None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:08.830701 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a3d546ed-3739-4238-a119-a6e2fea3b41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:08.875703 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d546ed-3739-4238-a119-a6e2fea3b41a None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:08.894408 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a273a-0067-4fbc-976c-aafc08a92f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:08.895313 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a273a-0067-4fbc-976c-aafc08a92f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:08.895602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a273a-0067-4fbc-976c-aafc08a92f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:08.895890 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a273a-0067-4fbc-976c-aafc08a92f5e admin admin] PATH_INFO: `/v3/projects/a0ac4596504942f7bed555a928abb4cb` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:08.897168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a273a-0067-4fbc-976c-aafc08a92f5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0ac4596504942f7bed555a928abb4cb)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:08.899118 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a273a-0067-4fbc-976c-aafc08a92f5e admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:09.012958 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:09.095582 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-712a273a-0067-4fbc-976c-aafc08a92f5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0ac4596504942f7bed555a928abb4cb', 'request_id': 'req-712a273a-0067-4fbc-976c-aafc08a92f5e'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:09.221105 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-712a273a-0067-4fbc-976c-aafc08a92f5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0ac4596504942f7bed555a928abb4cb', 'request_id': 'req-712a273a-0067-4fbc-976c-aafc08a92f5e'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:09.233177 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-712a273a-0067-4fbc-976c-aafc08a92f5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0ac4596504942f7bed555a928abb4cb', 'request_id': 'req-712a273a-0067-4fbc-976c-aafc08a92f5e'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:09.247093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-712a273a-0067-4fbc-976c-aafc08a92f5e admin admin] The token cache is being invalidate because project a0ac4596504942f7bed555a928abb4cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:43:09.247541 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-712a273a-0067-4fbc-976c-aafc08a92f5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:09.248365 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-712a273a-0067-4fbc-976c-aafc08a92f5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:09.253505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1091/2138] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:43:08 2022] DELETE /identity/v3/projects/a0ac4596504942f7bed555a928abb4cb => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:09.255314 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589af7d4-1845-4827-b7f3-466cc5a7a1db None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:09.257995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589af7d4-1845-4827-b7f3-466cc5a7a1db None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:09.258799 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589af7d4-1845-4827-b7f3-466cc5a7a1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:09.280749 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-589af7d4-1845-4827-b7f3-466cc5a7a1db None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:09.282202 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-589af7d4-1845-4827-b7f3-466cc5a7a1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:09.363606 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1048/2139] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:09.372073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dc270-6a0d-462d-80c2-9bc4f5a531fe None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:09.372376 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dc270-6a0d-462d-80c2-9bc4f5a531fe None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:09.372634 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dc270-6a0d-462d-80c2-9bc4f5a531fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:09.396821 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-bb8dc270-6a0d-462d-80c2-9bc4f5a531fe None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:09.398127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-bb8dc270-6a0d-462d-80c2-9bc4f5a531fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:09.414597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1092/2140] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:09.419867 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589af7d4-1845-4827-b7f3-466cc5a7a1db None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:09.442073 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589af7d4-1845-4827-b7f3-466cc5a7a1db None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:09.472338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf82aeb-8f51-4463-85b4-c1333e7df118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:09.473053 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf82aeb-8f51-4463-85b4-c1333e7df118 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:09.473343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf82aeb-8f51-4463-85b4-c1333e7df118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:09.473633 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf82aeb-8f51-4463-85b4-c1333e7df118 admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:09.479962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf82aeb-8f51-4463-85b4-c1333e7df118 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:43:09.480293 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf82aeb-8f51-4463-85b4-c1333e7df118 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:09.482127 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf82aeb-8f51-4463-85b4-c1333e7df118 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:09.538301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8dc270-6a0d-462d-80c2-9bc4f5a531fe None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:09.538503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1049/2141] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:43:09.550293 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8dc270-6a0d-462d-80c2-9bc4f5a531fe None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:09.555962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748684c-8bcc-4fc8-9aea-50a952d0703d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:09.556635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748684c-8bcc-4fc8-9aea-50a952d0703d admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:09.556921 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748684c-8bcc-4fc8-9aea-50a952d0703d admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:09.558796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748684c-8bcc-4fc8-9aea-50a952d0703d admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:09.559728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748684c-8bcc-4fc8-9aea-50a952d0703d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:09.561701 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748684c-8bcc-4fc8-9aea-50a952d0703d admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:09.700302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1093/2142] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:43:09 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:09.704783 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf82aeb-8f51-4463-85b4-c1333e7df118 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:09.718018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf82aeb-8f51-4463-85b4-c1333e7df118 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:09.795002 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:09.837093 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8cf1e-0ac9-4582-bc80-b4ef1afa322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:09.842071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8cf1e-0ac9-4582-bc80-b4ef1afa322d admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:09.842901 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8cf1e-0ac9-4582-bc80-b4ef1afa322d admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:09.843685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8cf1e-0ac9-4582-bc80-b4ef1afa322d admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:09.845283 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8cf1e-0ac9-4582-bc80-b4ef1afa322d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:09.853947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8cf1e-0ac9-4582-bc80-b4ef1afa322d admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:09.917962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748684c-8bcc-4fc8-9aea-50a952d0703d admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:09.919826 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d748684c-8bcc-4fc8-9aea-50a952d0703d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:09.942949 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748684c-8bcc-4fc8-9aea-50a952d0703d admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:09.947670 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676df77-6df8-428f-a1a7-95eac888b9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:09.949300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676df77-6df8-428f-a1a7-95eac888b9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:09.949701 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676df77-6df8-428f-a1a7-95eac888b9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:09.950121 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676df77-6df8-428f-a1a7-95eac888b9ff admin admin] PATH_INFO: `/v3/users/0068ad02f128494faa67e80b092c1deb` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:09.951441 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676df77-6df8-428f-a1a7-95eac888b9ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=0068ad02f128494faa67e80b092c1deb)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:09.953476 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676df77-6df8-428f-a1a7-95eac888b9ff admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:10.000537 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1050/2143] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:43:09 2022] POST /identity/v3/users => generated 283 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:10.006965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8cf1e-0ac9-4582-bc80-b4ef1afa322d admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:10.024048 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8cf1e-0ac9-4582-bc80-b4ef1afa322d admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:10.032969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94562f-de86-409b-8378-0f704a8dfc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:10.033663 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94562f-de86-409b-8378-0f704a8dfc19 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:10.033953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94562f-de86-409b-8378-0f704a8dfc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:10.034234 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94562f-de86-409b-8378-0f704a8dfc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:10.035162 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94562f-de86-409b-8378-0f704a8dfc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:10.037136 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94562f-de86-409b-8378-0f704a8dfc19 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:10.049377 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1051/2144] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:10.053602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94562f-de86-409b-8378-0f704a8dfc19 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:10.066724 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94562f-de86-409b-8378-0f704a8dfc19 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:10.072727 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317cc9c-e3e4-4ecb-a116-f277defdedf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:10.074447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317cc9c-e3e4-4ecb-a116-f277defdedf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:10.074605 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317cc9c-e3e4-4ecb-a116-f277defdedf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:10.074901 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317cc9c-e3e4-4ecb-a116-f277defdedf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:10.075752 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317cc9c-e3e4-4ecb-a116-f277defdedf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:10.077518 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317cc9c-e3e4-4ecb-a116-f277defdedf7 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:10.094781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1052/2145] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:43:10.096395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317cc9c-e3e4-4ecb-a116-f277defdedf7 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:10.109735 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317cc9c-e3e4-4ecb-a116-f277defdedf7 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:10.116118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e5562-7826-479c-b520-5c44fcd26fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:10.117109 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e5562-7826-479c-b520-5c44fcd26fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:10.117460 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e5562-7826-479c-b520-5c44fcd26fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:10.117798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e5562-7826-479c-b520-5c44fcd26fe1 admin admin] PATH_INFO: `/v3/projects/6ddfbd56d0ee4fae9b2d118e8b687726/users/fbc9b737ffd447a798ec5ac60474331b/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:10.140362 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e5562-7826-479c-b520-5c44fcd26fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ddfbd56d0ee4fae9b2d118e8b687726, user_id=fbc9b737ffd447a798ec5ac60474331b, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:10.143441 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e5562-7826-479c-b520-5c44fcd26fe1 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:10.275467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1053/2146] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:43:10 2022] PUT /identity/v3/projects/6ddfbd56d0ee4fae9b2d118e8b687726/users/fbc9b737ffd447a798ec5ac60474331b/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:10.286454 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e5bca-adce-45f7-b2ae-4c6d8450d280 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:10.286756 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e5bca-adce-45f7-b2ae-4c6d8450d280 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:10.287031 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e5bca-adce-45f7-b2ae-4c6d8450d280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:10.319134 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a676df77-6df8-428f-a1a7-95eac888b9ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0068ad02f128494faa67e80b092c1deb'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:10.320485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-fa3e5bca-adce-45f7-b2ae-4c6d8450d280 None None] MFA Rules not processed for user `fbc9b737ffd447a798ec5ac60474331b`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:10.322486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fa3e5bca-adce-45f7-b2ae-4c6d8450d280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:10.334290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a676df77-6df8-428f-a1a7-95eac888b9ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0068ad02f128494faa67e80b092c1deb'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:10.400674 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1054/2147] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:10.412025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e5bca-adce-45f7-b2ae-4c6d8450d280 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:10.413555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fa3e5bca-adce-45f7-b2ae-4c6d8450d280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:10.443646 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a676df77-6df8-428f-a1a7-95eac888b9ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0068ad02f128494faa67e80b092c1deb'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:10.444715 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a676df77-6df8-428f-a1a7-95eac888b9ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0068ad02f128494faa67e80b092c1deb'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:10.458020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a676df77-6df8-428f-a1a7-95eac888b9ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0068ad02f128494faa67e80b092c1deb'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:10.466823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1094/2148] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:43:09 2022] DELETE /identity/v3/users/0068ad02f128494faa67e80b092c1deb => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:43:10.513090 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e5bca-adce-45f7-b2ae-4c6d8450d280 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:10.608610 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd988f63-b362-4d3b-aecd-1744f2e70d04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:10.609436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd988f63-b362-4d3b-aecd-1744f2e70d04 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:10.609687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd988f63-b362-4d3b-aecd-1744f2e70d04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:10.609973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd988f63-b362-4d3b-aecd-1744f2e70d04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:10.612034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fd988f63-b362-4d3b-aecd-1744f2e70d04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:10.701178 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd988f63-b362-4d3b-aecd-1744f2e70d04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:10.702710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd988f63-b362-4d3b-aecd-1744f2e70d04 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:10.714164 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1055/2149] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:43:10.748701 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676df77-6df8-428f-a1a7-95eac888b9ff admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:10.750224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a676df77-6df8-428f-a1a7-95eac888b9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:10.856718 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676df77-6df8-428f-a1a7-95eac888b9ff admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:10.861332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea72cd-d0ed-4592-b48a-213eb21adadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:10.862583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea72cd-d0ed-4592-b48a-213eb21adadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:10.862583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea72cd-d0ed-4592-b48a-213eb21adadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:10.862998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea72cd-d0ed-4592-b48a-213eb21adadf admin admin] PATH_INFO: `/v3/projects/adcc39cd54b840b488f530a0346a607f` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:10.864346 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea72cd-d0ed-4592-b48a-213eb21adadf admin admin] RBAC: Authorizing `identity:delete_project(project_id=adcc39cd54b840b488f530a0346a607f)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:10.866702 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea72cd-d0ed-4592-b48a-213eb21adadf admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:11.061436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-49ea72cd-d0ed-4592-b48a-213eb21adadf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adcc39cd54b840b488f530a0346a607f', 'request_id': 'req-49ea72cd-d0ed-4592-b48a-213eb21adadf'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:11.145309 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-49ea72cd-d0ed-4592-b48a-213eb21adadf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adcc39cd54b840b488f530a0346a607f', 'request_id': 'req-49ea72cd-d0ed-4592-b48a-213eb21adadf'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:11.151827 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-49ea72cd-d0ed-4592-b48a-213eb21adadf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adcc39cd54b840b488f530a0346a607f', 'request_id': 'req-49ea72cd-d0ed-4592-b48a-213eb21adadf'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:11.163624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-49ea72cd-d0ed-4592-b48a-213eb21adadf admin admin] The token cache is being invalidate because project adcc39cd54b840b488f530a0346a607f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:43:11.163841 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-49ea72cd-d0ed-4592-b48a-213eb21adadf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:11.164522 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-49ea72cd-d0ed-4592-b48a-213eb21adadf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:11.167253 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1095/2150] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:43:10 2022] DELETE /identity/v3/projects/adcc39cd54b840b488f530a0346a607f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:11.172071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c84b8-9712-408d-85ad-b69ab88855da None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:11.172403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c84b8-9712-408d-85ad-b69ab88855da None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:11.172654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c84b8-9712-408d-85ad-b69ab88855da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:11.193121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-d77c84b8-9712-408d-85ad-b69ab88855da None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:11.194359 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-d77c84b8-9712-408d-85ad-b69ab88855da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:11.287155 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1056/2151] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:11.289865 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f26f7-ac17-40c9-a0f0-519435e4015f None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:11.290162 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f26f7-ac17-40c9-a0f0-519435e4015f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:11.290450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f26f7-ac17-40c9-a0f0-519435e4015f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:11.321191 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-ac9f26f7-ac17-40c9-a0f0-519435e4015f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:11.323626 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ac9f26f7-ac17-40c9-a0f0-519435e4015f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:11.333925 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1096/2152] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:43:11.339075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c84b8-9712-408d-85ad-b69ab88855da None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:11.351541 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c84b8-9712-408d-85ad-b69ab88855da None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:11.358766 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e017685-af4c-4bf3-b696-75451b76b99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:11.359857 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e017685-af4c-4bf3-b696-75451b76b99d admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:11.360413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e017685-af4c-4bf3-b696-75451b76b99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:11.360934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e017685-af4c-4bf3-b696-75451b76b99d admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:11.362027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e017685-af4c-4bf3-b696-75451b76b99d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:43:11.362349 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e017685-af4c-4bf3-b696-75451b76b99d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:11.364322 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e017685-af4c-4bf3-b696-75451b76b99d admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:11.389521 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1057/2153] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:43:11.390727 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f26f7-ac17-40c9-a0f0-519435e4015f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:11.406094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f26f7-ac17-40c9-a0f0-519435e4015f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:11.412453 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704f102-7a19-4758-ba1c-e0a14c0b3471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:11.413196 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704f102-7a19-4758-ba1c-e0a14c0b3471 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:11.413502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704f102-7a19-4758-ba1c-e0a14c0b3471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:11.413903 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704f102-7a19-4758-ba1c-e0a14c0b3471 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:11.414879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704f102-7a19-4758-ba1c-e0a14c0b3471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:11.417703 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704f102-7a19-4758-ba1c-e0a14c0b3471 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:11.446137 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:11.571777 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1097/2154] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:43:11 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:11.573099 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e017685-af4c-4bf3-b696-75451b76b99d admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:11.585606 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e017685-af4c-4bf3-b696-75451b76b99d admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:11.700228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569b31f-7ac4-431e-a2a0-d68ae790f1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:11.704775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569b31f-7ac4-431e-a2a0-d68ae790f1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:11.705146 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569b31f-7ac4-431e-a2a0-d68ae790f1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:11.705551 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569b31f-7ac4-431e-a2a0-d68ae790f1e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:11.707025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569b31f-7ac4-431e-a2a0-d68ae790f1e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:11.711160 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569b31f-7ac4-431e-a2a0-d68ae790f1e4 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:11.789919 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689bd38-3023-4fe8-bd75-03051f8c9375 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:11.793366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689bd38-3023-4fe8-bd75-03051f8c9375 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:11.793366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689bd38-3023-4fe8-bd75-03051f8c9375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:11.825692 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1058/2155] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:43:11 2022] POST /identity/v3/users => generated 287 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:11.830728 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569b31f-7ac4-431e-a2a0-d68ae790f1e4 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:11.851397 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569b31f-7ac4-431e-a2a0-d68ae790f1e4 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:11.860402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-0689bd38-3023-4fe8-bd75-03051f8c9375 None None] MFA Rules not processed for user `389c703353304654a3d6c3dffac3f423`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:11.861647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c49d14-c944-4a3c-82bb-1014bf7eb514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:11.862311 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c49d14-c944-4a3c-82bb-1014bf7eb514 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:11.862599 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c49d14-c944-4a3c-82bb-1014bf7eb514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:11.862904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c49d14-c944-4a3c-82bb-1014bf7eb514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:11.864307 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0689bd38-3023-4fe8-bd75-03051f8c9375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:11.866404 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c49d14-c944-4a3c-82bb-1014bf7eb514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:11.869132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c49d14-c944-4a3c-82bb-1014bf7eb514 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:11.891345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1059/2156] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:11.894869 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c49d14-c944-4a3c-82bb-1014bf7eb514 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:11.905871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c49d14-c944-4a3c-82bb-1014bf7eb514 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:11.910993 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e29e85-677b-47ec-93f6-346baab70041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:11.911855 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e29e85-677b-47ec-93f6-346baab70041 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:11.912249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e29e85-677b-47ec-93f6-346baab70041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:11.912600 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e29e85-677b-47ec-93f6-346baab70041 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:11.913420 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e29e85-677b-47ec-93f6-346baab70041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:11.915410 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e29e85-677b-47ec-93f6-346baab70041 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:11.931102 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1060/2157] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:11.931915 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e29e85-677b-47ec-93f6-346baab70041 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:11.947825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e29e85-677b-47ec-93f6-346baab70041 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:11.949371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1098/2158] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:11.953995 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689bd38-3023-4fe8-bd75-03051f8c9375 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:11.954612 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda62abf-b3be-44a0-bf51-fc75fe25f937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:11.955796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0689bd38-3023-4fe8-bd75-03051f8c9375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:11.956005 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda62abf-b3be-44a0-bf51-fc75fe25f937 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:11.956269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda62abf-b3be-44a0-bf51-fc75fe25f937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:11.956553 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda62abf-b3be-44a0-bf51-fc75fe25f937 admin admin] PATH_INFO: `/v3/projects/5e254cbe1ace4c4bb3f2e7a547976414/users/4c14a0e2a9f2443e88a46d1186bac686/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:11.973342 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689bd38-3023-4fe8-bd75-03051f8c9375 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:11.975572 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda62abf-b3be-44a0-bf51-fc75fe25f937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e254cbe1ace4c4bb3f2e7a547976414, user_id=4c14a0e2a9f2443e88a46d1186bac686, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:11.978069 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39214bdc-231c-49ed-b11a-16cabe6f3803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:11.978705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda62abf-b3be-44a0-bf51-fc75fe25f937 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:11.978821 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39214bdc-231c-49ed-b11a-16cabe6f3803 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:11.979690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39214bdc-231c-49ed-b11a-16cabe6f3803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:11.980133 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39214bdc-231c-49ed-b11a-16cabe6f3803 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:11.980880 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39214bdc-231c-49ed-b11a-16cabe6f3803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:11.982842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39214bdc-231c-49ed-b11a-16cabe6f3803 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:12.117275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1061/2159] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:43:11 2022] PUT /identity/v3/projects/5e254cbe1ace4c4bb3f2e7a547976414/users/4c14a0e2a9f2443e88a46d1186bac686/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:12.123967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1099/2160] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:43:11 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:43:12.134931 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39214bdc-231c-49ed-b11a-16cabe6f3803 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:12.135319 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af48a3-51d9-4b61-9f42-49c4f0720cd5 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:12.135678 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af48a3-51d9-4b61-9f42-49c4f0720cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:12.135945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af48a3-51d9-4b61-9f42-49c4f0720cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:12.167521 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-37af48a3-51d9-4b61-9f42-49c4f0720cd5 None None] MFA Rules not processed for user `4c14a0e2a9f2443e88a46d1186bac686`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:12.169000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-37af48a3-51d9-4b61-9f42-49c4f0720cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:12.209828 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39214bdc-231c-49ed-b11a-16cabe6f3803 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:12.215484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbfb6f-d72d-4161-a1de-a851ce651f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:12.216385 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbfb6f-d72d-4161-a1de-a851ce651f32 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:12.216853 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbfb6f-d72d-4161-a1de-a851ce651f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:12.217281 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbfb6f-d72d-4161-a1de-a851ce651f32 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:12.218135 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbfb6f-d72d-4161-a1de-a851ce651f32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:12.220332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbfb6f-d72d-4161-a1de-a851ce651f32 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:12.244248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1062/2161] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:12.248675 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af48a3-51d9-4b61-9f42-49c4f0720cd5 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:12.260088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af48a3-51d9-4b61-9f42-49c4f0720cd5 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:12.265464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb0382-bef7-4069-a14f-b938cf635948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:12.266149 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb0382-bef7-4069-a14f-b938cf635948 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:12.267007 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb0382-bef7-4069-a14f-b938cf635948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:12.267007 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb0382-bef7-4069-a14f-b938cf635948 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:12.267428 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb0382-bef7-4069-a14f-b938cf635948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:12.269401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb0382-bef7-4069-a14f-b938cf635948 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:12.349186 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1100/2162] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:43:12 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:12.353296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbfb6f-d72d-4161-a1de-a851ce651f32 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:12.364820 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbfb6f-d72d-4161-a1de-a851ce651f32 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:12.369727 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99258101-b92d-4dd5-8951-4325af8cc79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:12.371075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99258101-b92d-4dd5-8951-4325af8cc79b admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:12.371637 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99258101-b92d-4dd5-8951-4325af8cc79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:12.372092 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99258101-b92d-4dd5-8951-4325af8cc79b admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:12.372904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99258101-b92d-4dd5-8951-4325af8cc79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:12.376138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:12.376585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99258101-b92d-4dd5-8951-4325af8cc79b admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:12.388281 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1063/2163] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:43:12 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:43:12.388716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1101/2164] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:43:12.388797 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb0382-bef7-4069-a14f-b938cf635948 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:12.389338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99258101-b92d-4dd5-8951-4325af8cc79b admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:12.399490 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99258101-b92d-4dd5-8951-4325af8cc79b admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:12.469991 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb0382-bef7-4069-a14f-b938cf635948 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:12.473852 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033a07b-3ef9-4e2c-9e3c-b5d17d2c1172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:12.474948 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033a07b-3ef9-4e2c-9e3c-b5d17d2c1172 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:12.474948 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033a07b-3ef9-4e2c-9e3c-b5d17d2c1172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:12.475845 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033a07b-3ef9-4e2c-9e3c-b5d17d2c1172 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:12.476769 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033a07b-3ef9-4e2c-9e3c-b5d17d2c1172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:12.478779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033a07b-3ef9-4e2c-9e3c-b5d17d2c1172 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:12.486511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8d89b-1b62-4627-a144-5ec74505306f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:12.487578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8d89b-1b62-4627-a144-5ec74505306f admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:12.487933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8d89b-1b62-4627-a144-5ec74505306f admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:12.488284 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8d89b-1b62-4627-a144-5ec74505306f admin admin] PATH_INFO: `/v3/projects/c3b654209dac46c4ab9cd4850d3930cf/users/ee918260b5864fbdbcc6e6a46e86556a/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:12.503610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8d89b-1b62-4627-a144-5ec74505306f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b654209dac46c4ab9cd4850d3930cf, user_id=ee918260b5864fbdbcc6e6a46e86556a, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:12.506578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8d89b-1b62-4627-a144-5ec74505306f admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:12.580304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1064/2165] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:43:12 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:43:12.585036 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033a07b-3ef9-4e2c-9e3c-b5d17d2c1172 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:12.593367 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1102/2166] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:43:12 2022] PUT /identity/v3/projects/c3b654209dac46c4ab9cd4850d3930cf/users/ee918260b5864fbdbcc6e6a46e86556a/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:12.601459 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033a07b-3ef9-4e2c-9e3c-b5d17d2c1172 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:12.605616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8d89b-1b62-4627-a144-5ec74505306f admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:12.696130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a79614-3c3e-47e4-852c-a632cb87db91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:12.696917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a79614-3c3e-47e4-852c-a632cb87db91 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:12.697269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a79614-3c3e-47e4-852c-a632cb87db91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:12.697845 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a79614-3c3e-47e4-852c-a632cb87db91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:12.699467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a79614-3c3e-47e4-852c-a632cb87db91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:12.700971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a79614-3c3e-47e4-852c-a632cb87db91 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:12.706112 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8d89b-1b62-4627-a144-5ec74505306f admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:12.711329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1065/2167] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:43:12.711951 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1452d-4cc7-402a-a80c-b9029e6d63b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:12.712703 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1452d-4cc7-402a-a80c-b9029e6d63b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:12.712993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1452d-4cc7-402a-a80c-b9029e6d63b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:12.713269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1452d-4cc7-402a-a80c-b9029e6d63b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:12.714193 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1452d-4cc7-402a-a80c-b9029e6d63b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:12.715380 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a79614-3c3e-47e4-852c-a632cb87db91 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:12.715866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1452d-4cc7-402a-a80c-b9029e6d63b5 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:12.725056 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a79614-3c3e-47e4-852c-a632cb87db91 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:12.727311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1103/2168] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:12.731171 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ede96-bd3c-46f9-9e47-e4bef42d8644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:12.731376 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1452d-4cc7-402a-a80c-b9029e6d63b5 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:12.732171 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ede96-bd3c-46f9-9e47-e4bef42d8644 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:12.732466 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ede96-bd3c-46f9-9e47-e4bef42d8644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:12.732746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ede96-bd3c-46f9-9e47-e4bef42d8644 admin admin] PATH_INFO: `/v3/projects/3c16dca1aafb41358292d94c005e6871/users/eacfcea5db8e463c86e19ead34ade4f7/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:12.741335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1452d-4cc7-402a-a80c-b9029e6d63b5 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:12.746900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226f2e3-d31b-4f9b-b15d-d0acbec327f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:12.747793 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226f2e3-d31b-4f9b-b15d-d0acbec327f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:12.748075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226f2e3-d31b-4f9b-b15d-d0acbec327f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:12.748406 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226f2e3-d31b-4f9b-b15d-d0acbec327f9 admin admin] PATH_INFO: `/v3/projects/c3b654209dac46c4ab9cd4850d3930cf/users/ee918260b5864fbdbcc6e6a46e86556a/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:12.750439 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226f2e3-d31b-4f9b-b15d-d0acbec327f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b654209dac46c4ab9cd4850d3930cf, user_id=ee918260b5864fbdbcc6e6a46e86556a, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:12.751409 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ede96-bd3c-46f9-9e47-e4bef42d8644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c16dca1aafb41358292d94c005e6871, user_id=eacfcea5db8e463c86e19ead34ade4f7, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:12.753321 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226f2e3-d31b-4f9b-b15d-d0acbec327f9 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:12.754306 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ede96-bd3c-46f9-9e47-e4bef42d8644 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:12.767327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1104/2169] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:43:12 2022] PUT /identity/v3/projects/c3b654209dac46c4ab9cd4850d3930cf/users/ee918260b5864fbdbcc6e6a46e86556a/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:43:12.864037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1066/2170] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:43:12 2022] PUT /identity/v3/projects/3c16dca1aafb41358292d94c005e6871/users/eacfcea5db8e463c86e19ead34ade4f7/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:43:12.864144 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226f2e3-d31b-4f9b-b15d-d0acbec327f9 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:12.936183 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226f2e3-d31b-4f9b-b15d-d0acbec327f9 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:13.000250 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce7943-345b-486f-812d-627f44ef0564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:13.000983 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce7943-345b-486f-812d-627f44ef0564 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:13.001262 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce7943-345b-486f-812d-627f44ef0564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:13.001538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce7943-345b-486f-812d-627f44ef0564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:13.002277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce7943-345b-486f-812d-627f44ef0564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:13.003999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce7943-345b-486f-812d-627f44ef0564 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:13.014993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1105/2171] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:13.019394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ede96-bd3c-46f9-9e47-e4bef42d8644 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:13.031482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ede96-bd3c-46f9-9e47-e4bef42d8644 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:13.036462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf9241-7d73-4ea8-b32e-9aecc57a1779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:13.037371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf9241-7d73-4ea8-b32e-9aecc57a1779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:13.037642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf9241-7d73-4ea8-b32e-9aecc57a1779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:13.037920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf9241-7d73-4ea8-b32e-9aecc57a1779 admin admin] PATH_INFO: `/v3/projects/3c16dca1aafb41358292d94c005e6871/users/eacfcea5db8e463c86e19ead34ade4f7/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:13.043405 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf9241-7d73-4ea8-b32e-9aecc57a1779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c16dca1aafb41358292d94c005e6871, user_id=eacfcea5db8e463c86e19ead34ade4f7, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:13.043604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf9241-7d73-4ea8-b32e-9aecc57a1779 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:13.054709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1067/2172] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:43:13 2022] PUT /identity/v3/projects/3c16dca1aafb41358292d94c005e6871/users/eacfcea5db8e463c86e19ead34ade4f7/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:13.064950 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cac65-f3b2-4582-8284-da332ba1afe2 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:13.065246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cac65-f3b2-4582-8284-da332ba1afe2 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:13.065527 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cac65-f3b2-4582-8284-da332ba1afe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:13.097293 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-d44cac65-f3b2-4582-8284-da332ba1afe2 None None] MFA Rules not processed for user `eacfcea5db8e463c86e19ead34ade4f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:13.098772 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d44cac65-f3b2-4582-8284-da332ba1afe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:13.200661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1106/2173] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:43:13.217528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf9241-7d73-4ea8-b32e-9aecc57a1779 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:13.219398 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0ccf9241-7d73-4ea8-b32e-9aecc57a1779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:13.307368 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf9241-7d73-4ea8-b32e-9aecc57a1779 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:13.314361 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910b5ae-bd39-4f21-a925-2f40aa1fad5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:13.315528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910b5ae-bd39-4f21-a925-2f40aa1fad5e service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:13.316259 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910b5ae-bd39-4f21-a925-2f40aa1fad5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:13.316765 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910b5ae-bd39-4f21-a925-2f40aa1fad5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:13.329853 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910b5ae-bd39-4f21-a925-2f40aa1fad5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:13.332032 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910b5ae-bd39-4f21-a925-2f40aa1fad5e service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:13.345214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1068/2174] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:13.567335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cac65-f3b2-4582-8284-da332ba1afe2 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:13.581821 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cac65-f3b2-4582-8284-da332ba1afe2 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:13.586558 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258ebc4-251a-4c49-96cc-f31c51434e03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:13.588244 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258ebc4-251a-4c49-96cc-f31c51434e03 service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:13.590655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258ebc4-251a-4c49-96cc-f31c51434e03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:13.591340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258ebc4-251a-4c49-96cc-f31c51434e03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:13.672138 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258ebc4-251a-4c49-96cc-f31c51434e03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:13.673589 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258ebc4-251a-4c49-96cc-f31c51434e03 service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:13.693182 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910b5ae-bd39-4f21-a925-2f40aa1fad5e service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:13.694719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-9910b5ae-bd39-4f21-a925-2f40aa1fad5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:13.696527 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1107/2175] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:13.791390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:13.799352 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910b5ae-bd39-4f21-a925-2f40aa1fad5e service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:13.804330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ab579-88a0-4e4e-bb5c-4413b43e1109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:13.804800 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ab579-88a0-4e4e-bb5c-4413b43e1109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:13.805082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ab579-88a0-4e4e-bb5c-4413b43e1109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:13.805353 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ab579-88a0-4e4e-bb5c-4413b43e1109 admin admin] PATH_INFO: `/v3/users/9fef55e1eb6f4fed9126887ec36e6556` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:13.806933 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ab579-88a0-4e4e-bb5c-4413b43e1109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fef55e1eb6f4fed9126887ec36e6556)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:13.810908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ab579-88a0-4e4e-bb5c-4413b43e1109 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:13.886378 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:14.160095 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9e0ab579-88a0-4e4e-bb5c-4413b43e1109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fef55e1eb6f4fed9126887ec36e6556'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:14.175385 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9e0ab579-88a0-4e4e-bb5c-4413b43e1109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fef55e1eb6f4fed9126887ec36e6556'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:14.188506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9e0ab579-88a0-4e4e-bb5c-4413b43e1109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fef55e1eb6f4fed9126887ec36e6556'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:14.301931 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9e0ab579-88a0-4e4e-bb5c-4413b43e1109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fef55e1eb6f4fed9126887ec36e6556'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:14.303192 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9e0ab579-88a0-4e4e-bb5c-4413b43e1109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fef55e1eb6f4fed9126887ec36e6556'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:14.313194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1069/2176] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:43:13 2022] DELETE /identity/v3/users/9fef55e1eb6f4fed9126887ec36e6556 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:43:14.318839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d62d5-d336-4b02-bee9-3f5c3d8c4be8 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:14.319403 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d62d5-d336-4b02-bee9-3f5c3d8c4be8 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:14.319741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d62d5-d336-4b02-bee9-3f5c3d8c4be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:14.343882 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-478d62d5-d336-4b02-bee9-3f5c3d8c4be8 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:14.345167 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-478d62d5-d336-4b02-bee9-3f5c3d8c4be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:14.489250 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1108/2177] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:14.499676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ab579-88a0-4e4e-bb5c-4413b43e1109 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:14.501136 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-9e0ab579-88a0-4e4e-bb5c-4413b43e1109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:14.583248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ab579-88a0-4e4e-bb5c-4413b43e1109 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:14.588926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853fc77-9863-4929-8cc8-1d9d2a4ecf51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:14.590354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853fc77-9863-4929-8cc8-1d9d2a4ecf51 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:14.590869 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853fc77-9863-4929-8cc8-1d9d2a4ecf51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:14.591156 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853fc77-9863-4929-8cc8-1d9d2a4ecf51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:14.606388 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853fc77-9863-4929-8cc8-1d9d2a4ecf51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:14.608154 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853fc77-9863-4929-8cc8-1d9d2a4ecf51 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:14.660183 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1070/2178] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:15.384200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d62d5-d336-4b02-bee9-3f5c3d8c4be8 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:15.386841 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-478d62d5-d336-4b02-bee9-3f5c3d8c4be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:15.418420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d62d5-d336-4b02-bee9-3f5c3d8c4be8 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:15.430773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168da839-cfcb-4f39-92da-de7f0bc4b19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:15.433626 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168da839-cfcb-4f39-92da-de7f0bc4b19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:15.434183 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168da839-cfcb-4f39-92da-de7f0bc4b19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:15.436418 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168da839-cfcb-4f39-92da-de7f0bc4b19e admin admin] PATH_INFO: `/v3/projects/43ff2c5b223449faa6a028d9888f9069` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:15.438801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168da839-cfcb-4f39-92da-de7f0bc4b19e admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ff2c5b223449faa6a028d9888f9069)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:15.447588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168da839-cfcb-4f39-92da-de7f0bc4b19e admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:15.818902 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-168da839-cfcb-4f39-92da-de7f0bc4b19e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ff2c5b223449faa6a028d9888f9069', 'request_id': 'req-168da839-cfcb-4f39-92da-de7f0bc4b19e'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:15.983429 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-168da839-cfcb-4f39-92da-de7f0bc4b19e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ff2c5b223449faa6a028d9888f9069', 'request_id': 'req-168da839-cfcb-4f39-92da-de7f0bc4b19e'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:15.998685 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-168da839-cfcb-4f39-92da-de7f0bc4b19e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ff2c5b223449faa6a028d9888f9069', 'request_id': 'req-168da839-cfcb-4f39-92da-de7f0bc4b19e'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:16.019648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-168da839-cfcb-4f39-92da-de7f0bc4b19e admin admin] The token cache is being invalidate because project 43ff2c5b223449faa6a028d9888f9069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:43:16.020201 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-168da839-cfcb-4f39-92da-de7f0bc4b19e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:16.021137 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-168da839-cfcb-4f39-92da-de7f0bc4b19e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:16.022906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1109/2179] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:43:15 2022] DELETE /identity/v3/projects/43ff2c5b223449faa6a028d9888f9069 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:16.028853 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81f0ca-c019-41f1-a463-a0ca8ac31a05 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:16.029338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81f0ca-c019-41f1-a463-a0ca8ac31a05 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:16.029543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81f0ca-c019-41f1-a463-a0ca8ac31a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:16.065366 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-3a81f0ca-c019-41f1-a463-a0ca8ac31a05 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:16.067184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-3a81f0ca-c019-41f1-a463-a0ca8ac31a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:16.178864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1071/2180] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:16.189581 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c5e8b-5fc5-4477-b3fe-dd47a9844acb None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:16.189968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c5e8b-5fc5-4477-b3fe-dd47a9844acb None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:16.190348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c5e8b-5fc5-4477-b3fe-dd47a9844acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:16.241380 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-a80c5e8b-5fc5-4477-b3fe-dd47a9844acb None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:16.246844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a80c5e8b-5fc5-4477-b3fe-dd47a9844acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:16.262278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1110/2181] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:16.268755 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81f0ca-c019-41f1-a463-a0ca8ac31a05 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:16.283255 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81f0ca-c019-41f1-a463-a0ca8ac31a05 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:16.293067 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277971d1-3df6-47d4-85d8-f52b3b76cac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:16.293819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277971d1-3df6-47d4-85d8-f52b3b76cac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:16.294209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277971d1-3df6-47d4-85d8-f52b3b76cac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:16.294595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277971d1-3df6-47d4-85d8-f52b3b76cac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:16.295542 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277971d1-3df6-47d4-85d8-f52b3b76cac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:43:16.297148 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277971d1-3df6-47d4-85d8-f52b3b76cac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:16.299500 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277971d1-3df6-47d4-85d8-f52b3b76cac0 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:16.314334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1072/2182] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:43:16.319683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c5e8b-5fc5-4477-b3fe-dd47a9844acb None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:16.356188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c5e8b-5fc5-4477-b3fe-dd47a9844acb None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:16.366800 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d876c-e15e-433f-8d1c-91fc6be11bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:16.368629 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d876c-e15e-433f-8d1c-91fc6be11bfb admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:16.369101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d876c-e15e-433f-8d1c-91fc6be11bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:16.369814 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d876c-e15e-433f-8d1c-91fc6be11bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:16.370705 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d876c-e15e-433f-8d1c-91fc6be11bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:16.373263 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d876c-e15e-433f-8d1c-91fc6be11bfb admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:16.466890 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1111/2183] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:43:16 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:16.467735 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277971d1-3df6-47d4-85d8-f52b3b76cac0 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:16.481064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277971d1-3df6-47d4-85d8-f52b3b76cac0 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:16.592002 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dfe61-c78c-435e-8ecb-68eb2e6084cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:16.592830 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dfe61-c78c-435e-8ecb-68eb2e6084cd admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:16.593121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dfe61-c78c-435e-8ecb-68eb2e6084cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:16.593912 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dfe61-c78c-435e-8ecb-68eb2e6084cd admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:16.594126 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7dfe61-c78c-435e-8ecb-68eb2e6084cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:16.596511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7dfe61-c78c-435e-8ecb-68eb2e6084cd admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:16.629665 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:16.702229 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1073/2184] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:43:16 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:43:16.706294 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d876c-e15e-433f-8d1c-91fc6be11bfb admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:16.727329 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d876c-e15e-433f-8d1c-91fc6be11bfb admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:16.733448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e921c4-4147-474e-a00b-d51556537524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:16.734575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e921c4-4147-474e-a00b-d51556537524 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:16.735022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e921c4-4147-474e-a00b-d51556537524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:16.735496 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e921c4-4147-474e-a00b-d51556537524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:16.736567 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e921c4-4147-474e-a00b-d51556537524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:16.739805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e921c4-4147-474e-a00b-d51556537524 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:16.765134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dfe61-c78c-435e-8ecb-68eb2e6084cd admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:16.775002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1112/2185] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:16.783523 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dfe61-c78c-435e-8ecb-68eb2e6084cd admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:16.794005 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6745a-861a-4279-9471-ffe994909d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:16.795100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6745a-861a-4279-9471-ffe994909d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:16.795223 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6745a-861a-4279-9471-ffe994909d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:16.795450 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6745a-861a-4279-9471-ffe994909d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:16.796208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6745a-861a-4279-9471-ffe994909d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:16.798811 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6745a-861a-4279-9471-ffe994909d00 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:16.813629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1074/2186] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:16.816342 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e921c4-4147-474e-a00b-d51556537524 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:16.828611 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e921c4-4147-474e-a00b-d51556537524 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:16.842277 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15177c-f201-4701-aaa6-eb4cbbd0d200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:16.843518 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15177c-f201-4701-aaa6-eb4cbbd0d200 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:16.843986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15177c-f201-4701-aaa6-eb4cbbd0d200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:16.844467 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15177c-f201-4701-aaa6-eb4cbbd0d200 admin admin] PATH_INFO: `/v3/projects/ad7f67c2641f483abdd1002828b22da2/users/b9ca96db12074a9fa09a7dcf9c1a6565/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:16.884681 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15177c-f201-4701-aaa6-eb4cbbd0d200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad7f67c2641f483abdd1002828b22da2, user_id=b9ca96db12074a9fa09a7dcf9c1a6565, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:16.888552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15177c-f201-4701-aaa6-eb4cbbd0d200 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:16.987177 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1113/2187] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:43:16 2022] PUT /identity/v3/projects/ad7f67c2641f483abdd1002828b22da2/users/b9ca96db12074a9fa09a7dcf9c1a6565/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:16.998667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952ee6c-7be7-4d04-a6c7-1bba50cb4594 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:16.998964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952ee6c-7be7-4d04-a6c7-1bba50cb4594 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:16.999246 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952ee6c-7be7-4d04-a6c7-1bba50cb4594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:17.030816 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-7952ee6c-7be7-4d04-a6c7-1bba50cb4594 None None] MFA Rules not processed for user `b9ca96db12074a9fa09a7dcf9c1a6565`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:17.032092 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-7952ee6c-7be7-4d04-a6c7-1bba50cb4594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:17.103437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1075/2188] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:43:17.114589 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15177c-f201-4701-aaa6-eb4cbbd0d200 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:17.116491 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-5f15177c-f201-4701-aaa6-eb4cbbd0d200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:17.225775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15177c-f201-4701-aaa6-eb4cbbd0d200 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:17.234828 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c9700-fbd7-422c-a4de-a9d093744516 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37932500740c4ccb96358bd751d01598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:17.235551 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c9700-fbd7-422c-a4de-a9d093744516 service glance] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:17.235843 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c9700-fbd7-422c-a4de-a9d093744516 service glance] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:17.236127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c9700-fbd7-422c-a4de-a9d093744516 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:17.260175 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c9700-fbd7-422c-a4de-a9d093744516 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:17.262846 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c9700-fbd7-422c-a4de-a9d093744516 service glance] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:17.277274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1114/2189] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:17.282690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:18.915070 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:19.929609 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fddac1-a8bc-4ddd-9333-c09cbc6e881c None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:19.930260 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fddac1-a8bc-4ddd-9333-c09cbc6e881c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:19.930260 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fddac1-a8bc-4ddd-9333-c09cbc6e881c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:19.957291 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:19.962213 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-c0fddac1-a8bc-4ddd-9333-c09cbc6e881c None None] MFA Rules not processed for user `ee918260b5864fbdbcc6e6a46e86556a`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:19.963739 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-c0fddac1-a8bc-4ddd-9333-c09cbc6e881c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:20.048543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1076/2190] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:20.063080 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c9700-fbd7-422c-a4de-a9d093744516 service glance] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:20.064811 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-427c9700-fbd7-422c-a4de-a9d093744516 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:20.154902 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c9700-fbd7-422c-a4de-a9d093744516 service glance] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:20.160501 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec283f-b86e-4aa8-b240-3e33a116bcd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:20.161523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec283f-b86e-4aa8-b240-3e33a116bcd7 service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:20.161656 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec283f-b86e-4aa8-b240-3e33a116bcd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:20.161904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec283f-b86e-4aa8-b240-3e33a116bcd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:20.163818 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f0ec283f-b86e-4aa8-b240-3e33a116bcd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:20.230301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec283f-b86e-4aa8-b240-3e33a116bcd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:20.232101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec283f-b86e-4aa8-b240-3e33a116bcd7 service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:20.243924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1115/2191] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:21.872096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:22.292655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:23.290151 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e723871-d45c-413c-8ee0-f7a268f5eba7 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:23.290151 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e723871-d45c-413c-8ee0-f7a268f5eba7 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:23.290860 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e723871-d45c-413c-8ee0-f7a268f5eba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:23.322155 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-4e723871-d45c-413c-8ee0-f7a268f5eba7 None None] MFA Rules not processed for user `389c703353304654a3d6c3dffac3f423`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:23.323905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-4e723871-d45c-413c-8ee0-f7a268f5eba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:23.333152 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1077/2192] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:23.423760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:23.766624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:24.482638 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:26.545702 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:26.693958 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:27.703778 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:28.448588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:28.513901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec283f-b86e-4aa8-b240-3e33a116bcd7 service nova] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:28.515436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f0ec283f-b86e-4aa8-b240-3e33a116bcd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:28.597126 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec283f-b86e-4aa8-b240-3e33a116bcd7 service nova] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:28.601993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c772c0-0be5-43e2-b293-202d4a823e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:28.602894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c772c0-0be5-43e2-b293-202d4a823e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:28.603181 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c772c0-0be5-43e2-b293-202d4a823e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:28.603492 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c772c0-0be5-43e2-b293-202d4a823e14 admin admin] PATH_INFO: `/v3/users/91b9fbfd07df4bf79cc1139c641ce573` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:28.605591 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c772c0-0be5-43e2-b293-202d4a823e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91b9fbfd07df4bf79cc1139c641ce573)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:28.607547 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c772c0-0be5-43e2-b293-202d4a823e14 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:28.799971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-51c772c0-0be5-43e2-b293-202d4a823e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91b9fbfd07df4bf79cc1139c641ce573'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:28.813841 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-51c772c0-0be5-43e2-b293-202d4a823e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91b9fbfd07df4bf79cc1139c641ce573'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:28.905401 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-51c772c0-0be5-43e2-b293-202d4a823e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91b9fbfd07df4bf79cc1139c641ce573'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:28.906135 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-51c772c0-0be5-43e2-b293-202d4a823e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91b9fbfd07df4bf79cc1139c641ce573'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:28.916105 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-51c772c0-0be5-43e2-b293-202d4a823e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91b9fbfd07df4bf79cc1139c641ce573'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:28.923358 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1116/2193] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:43:28 2022] DELETE /identity/v3/users/91b9fbfd07df4bf79cc1139c641ce573 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:28.927944 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f93d0f-dd63-407d-bd14-86ae206e7986 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:28.928423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f93d0f-dd63-407d-bd14-86ae206e7986 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:28.928560 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f93d0f-dd63-407d-bd14-86ae206e7986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:28.948230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-54f93d0f-dd63-407d-bd14-86ae206e7986 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:28.949470 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-54f93d0f-dd63-407d-bd14-86ae206e7986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:29.019751 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1078/2194] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:29.039517 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c772c0-0be5-43e2-b293-202d4a823e14 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:29.041165 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-51c772c0-0be5-43e2-b293-202d4a823e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:29.106851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c772c0-0be5-43e2-b293-202d4a823e14 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:29.116384 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd72a4-7de1-4264-9433-f51678845473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:29.117054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd72a4-7de1-4264-9433-f51678845473 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:29.117341 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd72a4-7de1-4264-9433-f51678845473 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:29.117677 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd72a4-7de1-4264-9433-f51678845473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:29.127603 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd72a4-7de1-4264-9433-f51678845473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:29.129074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd72a4-7de1-4264-9433-f51678845473 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:29.140436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1117/2195] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:29.277758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:29.603677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f93d0f-dd63-407d-bd14-86ae206e7986 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:29.606025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-54f93d0f-dd63-407d-bd14-86ae206e7986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:29.619583 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f93d0f-dd63-407d-bd14-86ae206e7986 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:29.624822 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5207c7-094d-4e6a-bf0b-fc76b63c9e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:29.628306 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5207c7-094d-4e6a-bf0b-fc76b63c9e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:29.628306 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5207c7-094d-4e6a-bf0b-fc76b63c9e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:29.628306 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5207c7-094d-4e6a-bf0b-fc76b63c9e46 admin admin] PATH_INFO: `/v3/projects/bf642163cc154d8dac38761817f5b65a` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:29.628306 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5207c7-094d-4e6a-bf0b-fc76b63c9e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf642163cc154d8dac38761817f5b65a)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:29.630124 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5207c7-094d-4e6a-bf0b-fc76b63c9e46 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:29.734854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-7c5207c7-094d-4e6a-bf0b-fc76b63c9e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf642163cc154d8dac38761817f5b65a', 'request_id': 'req-7c5207c7-094d-4e6a-bf0b-fc76b63c9e46'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:29.740414 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-7c5207c7-094d-4e6a-bf0b-fc76b63c9e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf642163cc154d8dac38761817f5b65a', 'request_id': 'req-7c5207c7-094d-4e6a-bf0b-fc76b63c9e46'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:29.747113 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-7c5207c7-094d-4e6a-bf0b-fc76b63c9e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf642163cc154d8dac38761817f5b65a', 'request_id': 'req-7c5207c7-094d-4e6a-bf0b-fc76b63c9e46'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:29.831894 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-7c5207c7-094d-4e6a-bf0b-fc76b63c9e46 admin admin] The token cache is being invalidate because project bf642163cc154d8dac38761817f5b65a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:43:29.832244 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-7c5207c7-094d-4e6a-bf0b-fc76b63c9e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:29.832927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-7c5207c7-094d-4e6a-bf0b-fc76b63c9e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:29.836987 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1079/2196] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:43:29 2022] DELETE /identity/v3/projects/bf642163cc154d8dac38761817f5b65a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:29.844034 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ce74f-d612-4c4b-8e0c-77f725700d2f None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:29.844957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ce74f-d612-4c4b-8e0c-77f725700d2f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:29.845465 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ce74f-d612-4c4b-8e0c-77f725700d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:29.869105 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-2f2ce74f-d612-4c4b-8e0c-77f725700d2f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:29.870975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-2f2ce74f-d612-4c4b-8e0c-77f725700d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:29.937759 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1118/2197] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:29.946554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29effcf9-b17d-45fb-9d49-36305aab7d0e None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:29.947051 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29effcf9-b17d-45fb-9d49-36305aab7d0e None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:29.947549 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29effcf9-b17d-45fb-9d49-36305aab7d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:29.971665 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-29effcf9-b17d-45fb-9d49-36305aab7d0e None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:29.973112 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-29effcf9-b17d-45fb-9d49-36305aab7d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:29.985483 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1080/2198] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:29.992954 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ce74f-d612-4c4b-8e0c-77f725700d2f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:30.000835 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ce74f-d612-4c4b-8e0c-77f725700d2f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:30.005754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dcedd-6496-429f-8e32-28b57442b5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:30.006447 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dcedd-6496-429f-8e32-28b57442b5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:30.006736 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dcedd-6496-429f-8e32-28b57442b5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:30.007042 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dcedd-6496-429f-8e32-28b57442b5a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:30.007944 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04dcedd-6496-429f-8e32-28b57442b5a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:43:30.008577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04dcedd-6496-429f-8e32-28b57442b5a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:30.010311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04dcedd-6496-429f-8e32-28b57442b5a6 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:30.022556 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1119/2199] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:43:30.026703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29effcf9-b17d-45fb-9d49-36305aab7d0e None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:30.043669 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29effcf9-b17d-45fb-9d49-36305aab7d0e None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:30.049143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb84f7-d65b-45c3-b65b-3f3803385114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:30.050029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb84f7-d65b-45c3-b65b-3f3803385114 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:30.050316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb84f7-d65b-45c3-b65b-3f3803385114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:30.050672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb84f7-d65b-45c3-b65b-3f3803385114 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:30.051321 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb84f7-d65b-45c3-b65b-3f3803385114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:30.053238 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb84f7-d65b-45c3-b65b-3f3803385114 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:30.232558 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1081/2200] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:43:30 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:30.236658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dcedd-6496-429f-8e32-28b57442b5a6 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:30.248675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dcedd-6496-429f-8e32-28b57442b5a6 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:30.308612 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183807a-eab4-47cd-8b0c-163c6179117b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:30.309303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183807a-eab4-47cd-8b0c-163c6179117b admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:30.309593 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183807a-eab4-47cd-8b0c-163c6179117b admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:30.309963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183807a-eab4-47cd-8b0c-163c6179117b admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:30.310577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183807a-eab4-47cd-8b0c-163c6179117b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:30.312556 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183807a-eab4-47cd-8b0c-163c6179117b admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:30.455472 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1120/2201] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:43:30 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:30.459675 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb84f7-d65b-45c3-b65b-3f3803385114 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:30.470351 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb84f7-d65b-45c3-b65b-3f3803385114 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:30.475451 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14079c67-4f83-4462-81ad-e687819e7b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:30.476168 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14079c67-4f83-4462-81ad-e687819e7b78 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:30.476537 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14079c67-4f83-4462-81ad-e687819e7b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:30.476825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14079c67-4f83-4462-81ad-e687819e7b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:30.477568 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14079c67-4f83-4462-81ad-e687819e7b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:30.480033 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14079c67-4f83-4462-81ad-e687819e7b78 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:30.488094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:30.492196 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1082/2202] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:30.500224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183807a-eab4-47cd-8b0c-163c6179117b admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:30.510745 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183807a-eab4-47cd-8b0c-163c6179117b admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:30.515660 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938c0be-547d-41d9-af97-6ae431016b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:30.516334 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938c0be-547d-41d9-af97-6ae431016b74 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:30.516610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938c0be-547d-41d9-af97-6ae431016b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:30.516894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938c0be-547d-41d9-af97-6ae431016b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:30.517627 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938c0be-547d-41d9-af97-6ae431016b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:30.519219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938c0be-547d-41d9-af97-6ae431016b74 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:30.531450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1121/2203] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:30.539778 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14079c67-4f83-4462-81ad-e687819e7b78 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:30.550985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14079c67-4f83-4462-81ad-e687819e7b78 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:30.556520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeff0e-f78e-4161-bd77-f09056f29cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:30.558015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeff0e-f78e-4161-bd77-f09056f29cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:30.558300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeff0e-f78e-4161-bd77-f09056f29cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:30.558603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeff0e-f78e-4161-bd77-f09056f29cd8 admin admin] PATH_INFO: `/v3/projects/f635096f13f14a8ea278f3cf16c26100/users/8915aef802fb47bd829bb15753310332/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:30.564153 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:30.578709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfeff0e-f78e-4161-bd77-f09056f29cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f635096f13f14a8ea278f3cf16c26100, user_id=8915aef802fb47bd829bb15753310332, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:30.581509 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfeff0e-f78e-4161-bd77-f09056f29cd8 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:30.687109 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1083/2204] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:43:30 2022] PUT /identity/v3/projects/f635096f13f14a8ea278f3cf16c26100/users/8915aef802fb47bd829bb15753310332/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:30.697667 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d133f82-e73c-4de5-9f9f-c5cc33485458 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:30.698218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d133f82-e73c-4de5-9f9f-c5cc33485458 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:30.698617 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d133f82-e73c-4de5-9f9f-c5cc33485458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:30.726797 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-6d133f82-e73c-4de5-9f9f-c5cc33485458 None None] MFA Rules not processed for user `8915aef802fb47bd829bb15753310332`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:30.728084 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-6d133f82-e73c-4de5-9f9f-c5cc33485458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:30.794712 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1122/2205] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:30.799296 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeff0e-f78e-4161-bd77-f09056f29cd8 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:30.865868 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeff0e-f78e-4161-bd77-f09056f29cd8 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:30.871486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b805f-00aa-4593-9363-d8d22cea6cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:30.872403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b805f-00aa-4593-9363-d8d22cea6cde admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:30.872720 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b805f-00aa-4593-9363-d8d22cea6cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:30.873369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b805f-00aa-4593-9363-d8d22cea6cde admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:30.874091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b805f-00aa-4593-9363-d8d22cea6cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:30.876068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b805f-00aa-4593-9363-d8d22cea6cde admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:30.987561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1084/2206] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:43:30 2022] POST /identity/v3/projects => generated 371 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:30.991586 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d133f82-e73c-4de5-9f9f-c5cc33485458 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:31.002457 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d133f82-e73c-4de5-9f9f-c5cc33485458 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:31.031426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:31.065503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddf6c9-7a64-45b5-a2aa-ef931ea922d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:31.066136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddf6c9-7a64-45b5-a2aa-ef931ea922d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:31.066424 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddf6c9-7a64-45b5-a2aa-ef931ea922d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:31.066705 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddf6c9-7a64-45b5-a2aa-ef931ea922d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:31.067442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddf6c9-7a64-45b5-a2aa-ef931ea922d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:31.069363 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddf6c9-7a64-45b5-a2aa-ef931ea922d6 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:31.158042 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1123/2207] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:43:30 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:31.161907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b805f-00aa-4593-9363-d8d22cea6cde admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:31.173279 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b805f-00aa-4593-9363-d8d22cea6cde admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:31.178062 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b62a8-90a1-4fda-9fcb-3ff6dd316010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:31.178738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b62a8-90a1-4fda-9fcb-3ff6dd316010 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:31.179044 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b62a8-90a1-4fda-9fcb-3ff6dd316010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:31.179360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b62a8-90a1-4fda-9fcb-3ff6dd316010 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:31.180101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b62a8-90a1-4fda-9fcb-3ff6dd316010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:31.181689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b62a8-90a1-4fda-9fcb-3ff6dd316010 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:31.192033 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1085/2208] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:31.196137 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddf6c9-7a64-45b5-a2aa-ef931ea922d6 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:31.206314 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddf6c9-7a64-45b5-a2aa-ef931ea922d6 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:31.210975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe694f8b-052b-46a3-8a57-d44fa564b233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:31.211675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe694f8b-052b-46a3-8a57-d44fa564b233 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:31.212012 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe694f8b-052b-46a3-8a57-d44fa564b233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:31.212353 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe694f8b-052b-46a3-8a57-d44fa564b233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:31.213160 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe694f8b-052b-46a3-8a57-d44fa564b233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:31.215491 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe694f8b-052b-46a3-8a57-d44fa564b233 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:31.227077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1124/2209] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:31.232071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b62a8-90a1-4fda-9fcb-3ff6dd316010 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:31.242411 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b62a8-90a1-4fda-9fcb-3ff6dd316010 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:31.247366 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398af31-6288-4b23-8e54-a96a818b012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:31.248268 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398af31-6288-4b23-8e54-a96a818b012e admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:31.248556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398af31-6288-4b23-8e54-a96a818b012e admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:31.248861 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398af31-6288-4b23-8e54-a96a818b012e admin admin] PATH_INFO: `/v3/projects/1ac7642587a74b76add830786afddab2/users/28afd746e3854705980bc7f42a4027f6/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:31.266647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398af31-6288-4b23-8e54-a96a818b012e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac7642587a74b76add830786afddab2, user_id=28afd746e3854705980bc7f42a4027f6, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:31.269348 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398af31-6288-4b23-8e54-a96a818b012e admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:31.361330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1086/2210] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:43:31 2022] PUT /identity/v3/projects/1ac7642587a74b76add830786afddab2/users/28afd746e3854705980bc7f42a4027f6/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:43:31.372621 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f087d-d0b9-4ec7-afd7-7e0a8b11f80a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:31.373000 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f087d-d0b9-4ec7-afd7-7e0a8b11f80a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:31.373355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f087d-d0b9-4ec7-afd7-7e0a8b11f80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:31.381604 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:31.404015 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-274f087d-d0b9-4ec7-afd7-7e0a8b11f80a None None] MFA Rules not processed for user `28afd746e3854705980bc7f42a4027f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:31.405324 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-274f087d-d0b9-4ec7-afd7-7e0a8b11f80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:31.472620 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1125/2211] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:31.477425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398af31-6288-4b23-8e54-a96a818b012e admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:31.482503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:31.543000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398af31-6288-4b23-8e54-a96a818b012e admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:31.547969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741adf0-500a-47de-ac2f-5805b7f80549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:31.548638 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741adf0-500a-47de-ac2f-5805b7f80549 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:31.548928 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741adf0-500a-47de-ac2f-5805b7f80549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:31.549207 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741adf0-500a-47de-ac2f-5805b7f80549 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:31.549976 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741adf0-500a-47de-ac2f-5805b7f80549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:31.552235 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741adf0-500a-47de-ac2f-5805b7f80549 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:31.659165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1087/2212] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:43:31 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:31.663866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f087d-d0b9-4ec7-afd7-7e0a8b11f80a None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:31.674474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f087d-d0b9-4ec7-afd7-7e0a8b11f80a None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:31.731443 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fae6b-8d78-4986-a6d8-36048ff70b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:31.732076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fae6b-8d78-4986-a6d8-36048ff70b64 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:31.732410 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fae6b-8d78-4986-a6d8-36048ff70b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:31.732690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fae6b-8d78-4986-a6d8-36048ff70b64 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:31.733408 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0fae6b-8d78-4986-a6d8-36048ff70b64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:31.735375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0fae6b-8d78-4986-a6d8-36048ff70b64 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:31.841159 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1126/2213] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:43:31 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:31.845300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741adf0-500a-47de-ac2f-5805b7f80549 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:31.856686 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741adf0-500a-47de-ac2f-5805b7f80549 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:31.861781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fb4f8-aba3-4001-8dca-00d3645ae5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:31.862477 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fb4f8-aba3-4001-8dca-00d3645ae5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:31.862764 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fb4f8-aba3-4001-8dca-00d3645ae5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:31.863041 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fb4f8-aba3-4001-8dca-00d3645ae5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:31.863813 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fb4f8-aba3-4001-8dca-00d3645ae5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:31.865432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fb4f8-aba3-4001-8dca-00d3645ae5c8 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:31.881368 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1088/2214] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:31.882578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fae6b-8d78-4986-a6d8-36048ff70b64 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:31.893981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fae6b-8d78-4986-a6d8-36048ff70b64 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:31.899412 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad08fc-1ec4-440a-9884-87e55703b83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:31.900333 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad08fc-1ec4-440a-9884-87e55703b83d admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:31.900616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad08fc-1ec4-440a-9884-87e55703b83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:31.901053 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad08fc-1ec4-440a-9884-87e55703b83d admin admin] PATH_INFO: `/v3/projects/edbbcad06651452ebf6f82895399b518/users/f93bd556f2da46f097c8f34c7cabec7f/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:31.919523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad08fc-1ec4-440a-9884-87e55703b83d admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbbcad06651452ebf6f82895399b518, user_id=f93bd556f2da46f097c8f34c7cabec7f, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:31.922248 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad08fc-1ec4-440a-9884-87e55703b83d admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:32.007849 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1127/2215] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:43:31 2022] PUT /identity/v3/projects/edbbcad06651452ebf6f82895399b518/users/f93bd556f2da46f097c8f34c7cabec7f/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:32.013141 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fb4f8-aba3-4001-8dca-00d3645ae5c8 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:32.023808 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fb4f8-aba3-4001-8dca-00d3645ae5c8 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:32.083190 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:32.085761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd44611-2931-4bc8-a7cc-f3aed8648a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:32.086442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd44611-2931-4bc8-a7cc-f3aed8648a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:32.086725 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd44611-2931-4bc8-a7cc-f3aed8648a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:32.087029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd44611-2931-4bc8-a7cc-f3aed8648a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:32.087791 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd44611-2931-4bc8-a7cc-f3aed8648a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:32.090107 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd44611-2931-4bc8-a7cc-f3aed8648a43 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:32.103308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1089/2216] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:32.105770 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad08fc-1ec4-440a-9884-87e55703b83d admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:32.117571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad08fc-1ec4-440a-9884-87e55703b83d admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:32.123300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcfac8-5738-4adc-9933-2f2ffa2c50af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:32.124217 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcfac8-5738-4adc-9933-2f2ffa2c50af admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:32.124501 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcfac8-5738-4adc-9933-2f2ffa2c50af admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:32.124784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcfac8-5738-4adc-9933-2f2ffa2c50af admin admin] PATH_INFO: `/v3/projects/edbbcad06651452ebf6f82895399b518/users/f93bd556f2da46f097c8f34c7cabec7f/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:32.126771 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcfac8-5738-4adc-9933-2f2ffa2c50af admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbbcad06651452ebf6f82895399b518, user_id=f93bd556f2da46f097c8f34c7cabec7f, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:32.129441 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcfac8-5738-4adc-9933-2f2ffa2c50af admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:32.141414 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1128/2217] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:43:32 2022] PUT /identity/v3/projects/edbbcad06651452ebf6f82895399b518/users/f93bd556f2da46f097c8f34c7cabec7f/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:32.216483 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fc654-92cd-4959-8715-ffe65ee5f99b None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:32.216781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fc654-92cd-4959-8715-ffe65ee5f99b None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:32.217071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fc654-92cd-4959-8715-ffe65ee5f99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:32.260061 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-309fc654-92cd-4959-8715-ffe65ee5f99b None None] MFA Rules not processed for user `f93bd556f2da46f097c8f34c7cabec7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:32.261352 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-309fc654-92cd-4959-8715-ffe65ee5f99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:32.330366 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:32.340970 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1090/2218] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:32.348726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcfac8-5738-4adc-9933-2f2ffa2c50af admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:32.350862 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-18fcfac8-5738-4adc-9933-2f2ffa2c50af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:32.381899 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:32.420136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcfac8-5738-4adc-9933-2f2ffa2c50af admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:32.423825 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458dfaf-5fa2-40f3-9e43-9d9b91f42ae0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:32.424482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458dfaf-5fa2-40f3-9e43-9d9b91f42ae0 service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:32.424775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458dfaf-5fa2-40f3-9e43-9d9b91f42ae0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:32.425057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458dfaf-5fa2-40f3-9e43-9d9b91f42ae0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:32.496812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458dfaf-5fa2-40f3-9e43-9d9b91f42ae0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:32.498390 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458dfaf-5fa2-40f3-9e43-9d9b91f42ae0 service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:32.509109 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1129/2219] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:33.157366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:33.620535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:35.689830 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fc654-92cd-4959-8715-ffe65ee5f99b None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:35.699547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fc654-92cd-4959-8715-ffe65ee5f99b None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:35.703066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4913a96-df34-45d9-8fb7-1d82f75f69cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:35.703735 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4913a96-df34-45d9-8fb7-1d82f75f69cb service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:35.704058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4913a96-df34-45d9-8fb7-1d82f75f69cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:35.704319 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4913a96-df34-45d9-8fb7-1d82f75f69cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:35.762778 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4913a96-df34-45d9-8fb7-1d82f75f69cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:35.764270 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4913a96-df34-45d9-8fb7-1d82f75f69cb service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:35.773200 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1091/2220] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:37.287393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458dfaf-5fa2-40f3-9e43-9d9b91f42ae0 service cinder] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:37.288853 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f458dfaf-5fa2-40f3-9e43-9d9b91f42ae0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:37.301471 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458dfaf-5fa2-40f3-9e43-9d9b91f42ae0 service cinder] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:37.305505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f84bca-48a8-410a-8f21-9fc52c15cc6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:37.306155 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f84bca-48a8-410a-8f21-9fc52c15cc6d service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:37.306439 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f84bca-48a8-410a-8f21-9fc52c15cc6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:37.306713 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f84bca-48a8-410a-8f21-9fc52c15cc6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:37.318885 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f84bca-48a8-410a-8f21-9fc52c15cc6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:37.320408 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f84bca-48a8-410a-8f21-9fc52c15cc6d service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:37.331563 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1130/2221] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:43.135262 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4913a96-df34-45d9-8fb7-1d82f75f69cb service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:43.202598 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4913a96-df34-45d9-8fb7-1d82f75f69cb service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:43.207798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e89df-a426-41b0-890e-29daa8993457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:43.208832 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e89df-a426-41b0-890e-29daa8993457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:43.209169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e89df-a426-41b0-890e-29daa8993457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:43.209586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e89df-a426-41b0-890e-29daa8993457 admin admin] PATH_INFO: `/v3/users/8915aef802fb47bd829bb15753310332` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:43.210808 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e89df-a426-41b0-890e-29daa8993457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8915aef802fb47bd829bb15753310332)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:43.212828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e89df-a426-41b0-890e-29daa8993457 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:43.373568 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b63e89df-a426-41b0-890e-29daa8993457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8915aef802fb47bd829bb15753310332'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:43.386605 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b63e89df-a426-41b0-890e-29daa8993457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8915aef802fb47bd829bb15753310332'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:43.393935 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b63e89df-a426-41b0-890e-29daa8993457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8915aef802fb47bd829bb15753310332'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:43.457644 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b63e89df-a426-41b0-890e-29daa8993457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8915aef802fb47bd829bb15753310332'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:43.458378 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b63e89df-a426-41b0-890e-29daa8993457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8915aef802fb47bd829bb15753310332'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:43.467014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1092/2222] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:43:43 2022] DELETE /identity/v3/users/8915aef802fb47bd829bb15753310332 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:43.471948 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed5f13-06ab-4f2c-b9f0-01119a9cdad0 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:43.472459 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed5f13-06ab-4f2c-b9f0-01119a9cdad0 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:43.472562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed5f13-06ab-4f2c-b9f0-01119a9cdad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:43.495219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-e8ed5f13-06ab-4f2c-b9f0-01119a9cdad0 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:43.497084 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e8ed5f13-06ab-4f2c-b9f0-01119a9cdad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:43.561840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1131/2223] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:43.572356 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e89df-a426-41b0-890e-29daa8993457 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:43.573833 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b63e89df-a426-41b0-890e-29daa8993457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:43.593224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:43.638467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e89df-a426-41b0-890e-29daa8993457 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:43.642187 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154121a-7ae1-4abb-8ff0-4d64454bc2b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:43.642825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154121a-7ae1-4abb-8ff0-4d64454bc2b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:43.643136 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154121a-7ae1-4abb-8ff0-4d64454bc2b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:43.643450 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154121a-7ae1-4abb-8ff0-4d64454bc2b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:43.653768 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154121a-7ae1-4abb-8ff0-4d64454bc2b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:43.655184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154121a-7ae1-4abb-8ff0-4d64454bc2b3 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:43.664777 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1093/2224] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:44.097289 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed5f13-06ab-4f2c-b9f0-01119a9cdad0 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:44.099016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e8ed5f13-06ab-4f2c-b9f0-01119a9cdad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:44.111626 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed5f13-06ab-4f2c-b9f0-01119a9cdad0 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:44.117061 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b4a46-c7d2-4849-a613-4aaf43db8aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:44.118129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b4a46-c7d2-4849-a613-4aaf43db8aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:44.118527 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b4a46-c7d2-4849-a613-4aaf43db8aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:44.118851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b4a46-c7d2-4849-a613-4aaf43db8aa9 admin admin] PATH_INFO: `/v3/projects/f635096f13f14a8ea278f3cf16c26100` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:44.120177 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b4a46-c7d2-4849-a613-4aaf43db8aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f635096f13f14a8ea278f3cf16c26100)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:44.123393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b4a46-c7d2-4849-a613-4aaf43db8aa9 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:44.252322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-765b4a46-c7d2-4849-a613-4aaf43db8aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f635096f13f14a8ea278f3cf16c26100', 'request_id': 'req-765b4a46-c7d2-4849-a613-4aaf43db8aa9'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:44.331734 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-765b4a46-c7d2-4849-a613-4aaf43db8aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f635096f13f14a8ea278f3cf16c26100', 'request_id': 'req-765b4a46-c7d2-4849-a613-4aaf43db8aa9'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:44.337900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-765b4a46-c7d2-4849-a613-4aaf43db8aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f635096f13f14a8ea278f3cf16c26100', 'request_id': 'req-765b4a46-c7d2-4849-a613-4aaf43db8aa9'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:44.349636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-765b4a46-c7d2-4849-a613-4aaf43db8aa9 admin admin] The token cache is being invalidate because project f635096f13f14a8ea278f3cf16c26100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:43:44.349929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-765b4a46-c7d2-4849-a613-4aaf43db8aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:44.350572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-765b4a46-c7d2-4849-a613-4aaf43db8aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:44.352166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1132/2225] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:43:44 2022] DELETE /identity/v3/projects/f635096f13f14a8ea278f3cf16c26100 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:44.357596 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154121a-7ae1-4abb-8ff0-4d64454bc2b3 service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:44.374360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154121a-7ae1-4abb-8ff0-4d64454bc2b3 service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:44.444571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f54ae2-c6f4-4126-a9a1-07283ffb8ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:44.445642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f54ae2-c6f4-4126-a9a1-07283ffb8ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:44.445927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f54ae2-c6f4-4126-a9a1-07283ffb8ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:44.446203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f54ae2-c6f4-4126-a9a1-07283ffb8ced admin admin] PATH_INFO: `/v3/users/28afd746e3854705980bc7f42a4027f6` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:44.447427 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f54ae2-c6f4-4126-a9a1-07283ffb8ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=28afd746e3854705980bc7f42a4027f6)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:44.449434 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f54ae2-c6f4-4126-a9a1-07283ffb8ced admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:44.637135 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-11f54ae2-c6f4-4126-a9a1-07283ffb8ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28afd746e3854705980bc7f42a4027f6'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:44.659481 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-11f54ae2-c6f4-4126-a9a1-07283ffb8ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28afd746e3854705980bc7f42a4027f6'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:44.668721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-11f54ae2-c6f4-4126-a9a1-07283ffb8ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28afd746e3854705980bc7f42a4027f6'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:44.734097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-11f54ae2-c6f4-4126-a9a1-07283ffb8ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28afd746e3854705980bc7f42a4027f6'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:44.734756 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-11f54ae2-c6f4-4126-a9a1-07283ffb8ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28afd746e3854705980bc7f42a4027f6'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:44.741704 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1094/2226] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:43:44 2022] DELETE /identity/v3/users/28afd746e3854705980bc7f42a4027f6 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:45.215376 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b4a46-c7d2-4849-a613-4aaf43db8aa9 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:45.216926 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-765b4a46-c7d2-4849-a613-4aaf43db8aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:45.234557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b4a46-c7d2-4849-a613-4aaf43db8aa9 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:45.255201 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:45.306119 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b74fd-ffd4-49de-8092-bd9cf906c72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:45.307028 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b74fd-ffd4-49de-8092-bd9cf906c72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:45.307337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b74fd-ffd4-49de-8092-bd9cf906c72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:45.307615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b74fd-ffd4-49de-8092-bd9cf906c72b admin admin] PATH_INFO: `/v3/projects/1ac7642587a74b76add830786afddab2` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:45.308962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b74fd-ffd4-49de-8092-bd9cf906c72b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac7642587a74b76add830786afddab2)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:45.312427 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b74fd-ffd4-49de-8092-bd9cf906c72b admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:45.424150 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b70b74fd-ffd4-49de-8092-bd9cf906c72b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac7642587a74b76add830786afddab2', 'request_id': 'req-b70b74fd-ffd4-49de-8092-bd9cf906c72b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:45.499650 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b70b74fd-ffd4-49de-8092-bd9cf906c72b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac7642587a74b76add830786afddab2', 'request_id': 'req-b70b74fd-ffd4-49de-8092-bd9cf906c72b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:45.505886 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b70b74fd-ffd4-49de-8092-bd9cf906c72b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac7642587a74b76add830786afddab2', 'request_id': 'req-b70b74fd-ffd4-49de-8092-bd9cf906c72b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:45.518404 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b70b74fd-ffd4-49de-8092-bd9cf906c72b admin admin] The token cache is being invalidate because project 1ac7642587a74b76add830786afddab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:43:45.518697 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b70b74fd-ffd4-49de-8092-bd9cf906c72b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:45.519399 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b70b74fd-ffd4-49de-8092-bd9cf906c72b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:45.520967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1133/2227] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:43:45 2022] DELETE /identity/v3/projects/1ac7642587a74b76add830786afddab2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:45.525008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f54ae2-c6f4-4126-a9a1-07283ffb8ced admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:45.526659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-11f54ae2-c6f4-4126-a9a1-07283ffb8ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:45.540192 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f54ae2-c6f4-4126-a9a1-07283ffb8ced admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:45.577742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:45.600835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cfba0-5840-4a83-9aa1-78e0c6f9d455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:45.601713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cfba0-5840-4a83-9aa1-78e0c6f9d455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:45.602024 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cfba0-5840-4a83-9aa1-78e0c6f9d455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:45.602302 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cfba0-5840-4a83-9aa1-78e0c6f9d455 admin admin] PATH_INFO: `/v3/users/f93bd556f2da46f097c8f34c7cabec7f` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:45.603524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62cfba0-5840-4a83-9aa1-78e0c6f9d455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f93bd556f2da46f097c8f34c7cabec7f)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:45.605485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62cfba0-5840-4a83-9aa1-78e0c6f9d455 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:45.818562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e62cfba0-5840-4a83-9aa1-78e0c6f9d455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f93bd556f2da46f097c8f34c7cabec7f'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:45.832566 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e62cfba0-5840-4a83-9aa1-78e0c6f9d455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f93bd556f2da46f097c8f34c7cabec7f'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:45.839576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e62cfba0-5840-4a83-9aa1-78e0c6f9d455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f93bd556f2da46f097c8f34c7cabec7f'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:45.911199 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e62cfba0-5840-4a83-9aa1-78e0c6f9d455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f93bd556f2da46f097c8f34c7cabec7f'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:45.911891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e62cfba0-5840-4a83-9aa1-78e0c6f9d455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f93bd556f2da46f097c8f34c7cabec7f'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:45.919040 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1095/2228] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:43:45 2022] DELETE /identity/v3/users/f93bd556f2da46f097c8f34c7cabec7f => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:46.364539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b74fd-ffd4-49de-8092-bd9cf906c72b admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:46.372449 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b70b74fd-ffd4-49de-8092-bd9cf906c72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:46.389663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b74fd-ffd4-49de-8092-bd9cf906c72b admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:46.451203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a67519-54b7-4515-ba6a-ae049f6ae63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:46.452117 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a67519-54b7-4515-ba6a-ae049f6ae63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:46.452405 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a67519-54b7-4515-ba6a-ae049f6ae63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:46.452688 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a67519-54b7-4515-ba6a-ae049f6ae63d admin admin] PATH_INFO: `/v3/projects/edbbcad06651452ebf6f82895399b518` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:46.453937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a67519-54b7-4515-ba6a-ae049f6ae63d admin admin] RBAC: Authorizing `identity:delete_project(project_id=edbbcad06651452ebf6f82895399b518)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:46.456018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a67519-54b7-4515-ba6a-ae049f6ae63d admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:46.631635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:46.632859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a8a67519-54b7-4515-ba6a-ae049f6ae63d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edbbcad06651452ebf6f82895399b518', 'request_id': 'req-a8a67519-54b7-4515-ba6a-ae049f6ae63d'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:46.716744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a8a67519-54b7-4515-ba6a-ae049f6ae63d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edbbcad06651452ebf6f82895399b518', 'request_id': 'req-a8a67519-54b7-4515-ba6a-ae049f6ae63d'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:46.723220 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a8a67519-54b7-4515-ba6a-ae049f6ae63d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edbbcad06651452ebf6f82895399b518', 'request_id': 'req-a8a67519-54b7-4515-ba6a-ae049f6ae63d'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:46.735983 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a8a67519-54b7-4515-ba6a-ae049f6ae63d admin admin] The token cache is being invalidate because project edbbcad06651452ebf6f82895399b518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:43:46.736273 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a8a67519-54b7-4515-ba6a-ae049f6ae63d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:46.736927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a8a67519-54b7-4515-ba6a-ae049f6ae63d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:43:46.738682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1134/2229] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:43:46 2022] DELETE /identity/v3/projects/edbbcad06651452ebf6f82895399b518 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:46.743940 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ace6cc-0402-4341-a65b-f854c5c405b0 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:46.744443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ace6cc-0402-4341-a65b-f854c5c405b0 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:46.744542 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ace6cc-0402-4341-a65b-f854c5c405b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:46.768669 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-75ace6cc-0402-4341-a65b-f854c5c405b0 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:46.769878 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-75ace6cc-0402-4341-a65b-f854c5c405b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:46.837114 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1096/2230] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:46.845069 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acb657-9e2c-4b07-8dc8-7a56b4c8b0fb None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:46.845359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acb657-9e2c-4b07-8dc8-7a56b4c8b0fb None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:46.845641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acb657-9e2c-4b07-8dc8-7a56b4c8b0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:46.865301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-43acb657-9e2c-4b07-8dc8-7a56b4c8b0fb None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:46.866522 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-43acb657-9e2c-4b07-8dc8-7a56b4c8b0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:46.875054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1135/2231] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:46.879322 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ace6cc-0402-4341-a65b-f854c5c405b0 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:46.890264 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ace6cc-0402-4341-a65b-f854c5c405b0 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:46.895856 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86805fc8-be6e-43c2-8a86-64d7e745df23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:46.896570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86805fc8-be6e-43c2-8a86-64d7e745df23 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:46.896855 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86805fc8-be6e-43c2-8a86-64d7e745df23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:46.897192 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86805fc8-be6e-43c2-8a86-64d7e745df23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:46.897948 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86805fc8-be6e-43c2-8a86-64d7e745df23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:43:46.898256 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86805fc8-be6e-43c2-8a86-64d7e745df23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:46.899989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86805fc8-be6e-43c2-8a86-64d7e745df23 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:46.912595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1097/2232] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:43:46.916912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acb657-9e2c-4b07-8dc8-7a56b4c8b0fb None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:46.925995 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acb657-9e2c-4b07-8dc8-7a56b4c8b0fb None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:46.930700 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116aab5-3d4c-4507-975a-f100f3d22d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:46.931384 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116aab5-3d4c-4507-975a-f100f3d22d05 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:46.931666 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116aab5-3d4c-4507-975a-f100f3d22d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:46.931940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116aab5-3d4c-4507-975a-f100f3d22d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:46.932641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116aab5-3d4c-4507-975a-f100f3d22d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:46.935068 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116aab5-3d4c-4507-975a-f100f3d22d05 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:47.038561 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1136/2233] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:43:46 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:47.044102 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86805fc8-be6e-43c2-8a86-64d7e745df23 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:47.054920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86805fc8-be6e-43c2-8a86-64d7e745df23 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:47.102782 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:47.118520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33aab1e-e8e5-43f7-ad15-42aefbfa639e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:47.119198 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aab1e-e8e5-43f7-ad15-42aefbfa639e admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:47.119536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aab1e-e8e5-43f7-ad15-42aefbfa639e admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:47.119807 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aab1e-e8e5-43f7-ad15-42aefbfa639e admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:47.120526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33aab1e-e8e5-43f7-ad15-42aefbfa639e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:47.123132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33aab1e-e8e5-43f7-ad15-42aefbfa639e admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:47.213193 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1098/2234] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:43:47 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:43:47.217572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116aab5-3d4c-4507-975a-f100f3d22d05 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:47.227957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116aab5-3d4c-4507-975a-f100f3d22d05 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:47.233153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362cb48-756d-4447-a339-1fa24ddfc7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:47.233808 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362cb48-756d-4447-a339-1fa24ddfc7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:47.234090 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362cb48-756d-4447-a339-1fa24ddfc7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:47.234367 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362cb48-756d-4447-a339-1fa24ddfc7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:47.235139 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362cb48-756d-4447-a339-1fa24ddfc7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:47.236771 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362cb48-756d-4447-a339-1fa24ddfc7a0 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:47.249019 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1137/2235] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:47.252421 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33aab1e-e8e5-43f7-ad15-42aefbfa639e admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:47.262869 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33aab1e-e8e5-43f7-ad15-42aefbfa639e admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:47.267727 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41732d0c-6d24-4f43-bf41-dbdafcaab667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:47.268417 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41732d0c-6d24-4f43-bf41-dbdafcaab667 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:47.268706 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41732d0c-6d24-4f43-bf41-dbdafcaab667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:47.268988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41732d0c-6d24-4f43-bf41-dbdafcaab667 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:47.270103 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41732d0c-6d24-4f43-bf41-dbdafcaab667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:47.271354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41732d0c-6d24-4f43-bf41-dbdafcaab667 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:47.282581 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1099/2236] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:47.287657 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362cb48-756d-4447-a339-1fa24ddfc7a0 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:47.299028 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362cb48-756d-4447-a339-1fa24ddfc7a0 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:47.304375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8835e71-942e-4274-ad07-09d3a5b9fd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:47.305327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8835e71-942e-4274-ad07-09d3a5b9fd43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:47.305624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8835e71-942e-4274-ad07-09d3a5b9fd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:47.305922 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8835e71-942e-4274-ad07-09d3a5b9fd43 admin admin] PATH_INFO: `/v3/projects/57f1c80543064e2a9cefff4372d84fbe/users/582f3de5b2e8433da1300551829fc401/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:47.322773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8835e71-942e-4274-ad07-09d3a5b9fd43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f1c80543064e2a9cefff4372d84fbe, user_id=582f3de5b2e8433da1300551829fc401, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:47.325588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8835e71-942e-4274-ad07-09d3a5b9fd43 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:47.437774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1138/2237] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:43:47 2022] PUT /identity/v3/projects/57f1c80543064e2a9cefff4372d84fbe/users/582f3de5b2e8433da1300551829fc401/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:43:47.442992 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee7fb4-2053-49ee-97d5-d7701d7c2b91 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:47.445561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee7fb4-2053-49ee-97d5-d7701d7c2b91 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:47.445561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee7fb4-2053-49ee-97d5-d7701d7c2b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:47.461165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-4eee7fb4-2053-49ee-97d5-d7701d7c2b91 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:47.462359 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-4eee7fb4-2053-49ee-97d5-d7701d7c2b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:47.525667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1100/2238] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:47.536214 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8835e71-942e-4274-ad07-09d3a5b9fd43 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:47.537985 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f8835e71-942e-4274-ad07-09d3a5b9fd43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:47.600081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8835e71-942e-4274-ad07-09d3a5b9fd43 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:47.603655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bc383-36c7-43ae-abcd-e48c169dd8c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:47.604297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bc383-36c7-43ae-abcd-e48c169dd8c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:47.604578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bc383-36c7-43ae-abcd-e48c169dd8c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:47.604855 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bc383-36c7-43ae-abcd-e48c169dd8c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:47.618527 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bc383-36c7-43ae-abcd-e48c169dd8c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:47.622804 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bc383-36c7-43ae-abcd-e48c169dd8c3 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:47.632926 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1139/2239] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:43:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:43:53.442485 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763574d3-5ccb-4ff4-b1fb-04c4d5592671 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:53.443064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763574d3-5ccb-4ff4-b1fb-04c4d5592671 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:53.443064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763574d3-5ccb-4ff4-b1fb-04c4d5592671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:53.474695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-763574d3-5ccb-4ff4-b1fb-04c4d5592671 None None] MFA Rules not processed for user `582f3de5b2e8433da1300551829fc401`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:43:53.476815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-763574d3-5ccb-4ff4-b1fb-04c4d5592671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:43:53.551378 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1101/2240] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:43:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:43:53.555922 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bc383-36c7-43ae-abcd-e48c169dd8c3 service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:53.565980 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bc383-36c7-43ae-abcd-e48c169dd8c3 service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:53.589322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534954c3-4332-471b-8e19-be96212f14b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:53.590121 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534954c3-4332-471b-8e19-be96212f14b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:53.590477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534954c3-4332-471b-8e19-be96212f14b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:53.591736 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534954c3-4332-471b-8e19-be96212f14b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:53.592496 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534954c3-4332-471b-8e19-be96212f14b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:53.595616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534954c3-4332-471b-8e19-be96212f14b2 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:53.720248 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1140/2241] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:43:53 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:53.724835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763574d3-5ccb-4ff4-b1fb-04c4d5592671 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:53.736754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763574d3-5ccb-4ff4-b1fb-04c4d5592671 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:53.792782 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:53.802687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd02bc-0043-4f35-9775-6787f671c4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:53.804969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd02bc-0043-4f35-9775-6787f671c4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:53.804969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd02bc-0043-4f35-9775-6787f671c4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:53.804969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd02bc-0043-4f35-9775-6787f671c4b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:53.804969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd02bc-0043-4f35-9775-6787f671c4b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:53.806841 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd02bc-0043-4f35-9775-6787f671c4b7 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:53.910608 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1102/2242] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:43:53 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:43:53.915218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534954c3-4332-471b-8e19-be96212f14b2 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:53.928855 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534954c3-4332-471b-8e19-be96212f14b2 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:53.934304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c29193-0b7b-4878-aa96-bda4503449ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:53.935825 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29193-0b7b-4878-aa96-bda4503449ff admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:53.942779 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29193-0b7b-4878-aa96-bda4503449ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:53.942779 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29193-0b7b-4878-aa96-bda4503449ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:53.942779 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c29193-0b7b-4878-aa96-bda4503449ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:53.942779 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c29193-0b7b-4878-aa96-bda4503449ff admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:53.951191 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1141/2243] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:53.955582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd02bc-0043-4f35-9775-6787f671c4b7 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:53.966097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd02bc-0043-4f35-9775-6787f671c4b7 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:53.971048 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac057a6-e879-42ba-bba7-b1b863ce99a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:53.972029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac057a6-e879-42ba-bba7-b1b863ce99a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:53.972313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac057a6-e879-42ba-bba7-b1b863ce99a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:53.972593 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac057a6-e879-42ba-bba7-b1b863ce99a5 admin admin] PATH_INFO: `/v3/projects/41617e5dd61241c8b6dd8904fb6d9750/users/12900a1818d5493a9f51f44dbd6999c4/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:53.991170 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac057a6-e879-42ba-bba7-b1b863ce99a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41617e5dd61241c8b6dd8904fb6d9750, user_id=12900a1818d5493a9f51f44dbd6999c4, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:53.993910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac057a6-e879-42ba-bba7-b1b863ce99a5 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:54.112992 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1103/2244] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:43:53 2022] PUT /identity/v3/projects/41617e5dd61241c8b6dd8904fb6d9750/users/12900a1818d5493a9f51f44dbd6999c4/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:43:54.116886 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c29193-0b7b-4878-aa96-bda4503449ff admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:54.127525 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c29193-0b7b-4878-aa96-bda4503449ff admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:54.180208 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:43:54.199834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cf423-cc40-4ce4-bf9d-7ff07cff7968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:54.200581 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cf423-cc40-4ce4-bf9d-7ff07cff7968 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:54.200872 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cf423-cc40-4ce4-bf9d-7ff07cff7968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:54.201147 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cf423-cc40-4ce4-bf9d-7ff07cff7968 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:54.201885 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cf423-cc40-4ce4-bf9d-7ff07cff7968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:54.203526 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cf423-cc40-4ce4-bf9d-7ff07cff7968 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:54.214004 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1142/2245] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:43:54.219685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac057a6-e879-42ba-bba7-b1b863ce99a5 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:43:54.230728 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac057a6-e879-42ba-bba7-b1b863ce99a5 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:43:54.238437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198d5e7-28e6-4368-8367-ec3a78b30692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:43:54.238437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198d5e7-28e6-4368-8367-ec3a78b30692 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:43:54.238437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198d5e7-28e6-4368-8367-ec3a78b30692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:43:54.238437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198d5e7-28e6-4368-8367-ec3a78b30692 admin admin] PATH_INFO: `/v3/projects/41617e5dd61241c8b6dd8904fb6d9750/users/12900a1818d5493a9f51f44dbd6999c4/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:43:54.240689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198d5e7-28e6-4368-8367-ec3a78b30692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41617e5dd61241c8b6dd8904fb6d9750, user_id=12900a1818d5493a9f51f44dbd6999c4, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:43:54.243767 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198d5e7-28e6-4368-8367-ec3a78b30692 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:43:54.256913 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1104/2246] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:43:54 2022] PUT /identity/v3/projects/41617e5dd61241c8b6dd8904fb6d9750/users/12900a1818d5493a9f51f44dbd6999c4/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:00.895076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296f9ac-a634-498c-8528-965a2a7dd6f7 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:00.895633 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296f9ac-a634-498c-8528-965a2a7dd6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:00.896688 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296f9ac-a634-498c-8528-965a2a7dd6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:00.936484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-5296f9ac-a634-498c-8528-965a2a7dd6f7 None None] MFA Rules not processed for user `12900a1818d5493a9f51f44dbd6999c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:00.936484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-5296f9ac-a634-498c-8528-965a2a7dd6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:01.016971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1143/2247] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:01.030157 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198d5e7-28e6-4368-8367-ec3a78b30692 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:01.032093 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2198d5e7-28e6-4368-8367-ec3a78b30692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:01.101689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198d5e7-28e6-4368-8367-ec3a78b30692 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:01.105750 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302f6ea-bdcf-4fe0-a936-9bb6ca776258 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37932500740c4ccb96358bd751d01598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:01.106423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302f6ea-bdcf-4fe0-a936-9bb6ca776258 service glance] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:01.106852 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302f6ea-bdcf-4fe0-a936-9bb6ca776258 service glance] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:01.107166 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302f6ea-bdcf-4fe0-a936-9bb6ca776258 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:01.195756 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302f6ea-bdcf-4fe0-a936-9bb6ca776258 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:01.197357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302f6ea-bdcf-4fe0-a936-9bb6ca776258 service glance] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:01.208781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1105/2248] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:01.497003 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994ef5f-c437-43b1-8576-530150fc6f3e None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:01.498100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994ef5f-c437-43b1-8576-530150fc6f3e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:01.498536 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994ef5f-c437-43b1-8576-530150fc6f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:01.522096 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-5994ef5f-c437-43b1-8576-530150fc6f3e None None] MFA Rules not processed for user `5ec758ef106b49f4985845b3c106f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:01.524559 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-5994ef5f-c437-43b1-8576-530150fc6f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:01.595516 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1144/2249] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Jul 12 14:44:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:01.640946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302f6ea-bdcf-4fe0-a936-9bb6ca776258 service glance] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:01.643636 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-d302f6ea-bdcf-4fe0-a936-9bb6ca776258 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:01.715140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:01.722691 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302f6ea-bdcf-4fe0-a936-9bb6ca776258 service glance] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:01.728551 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25faae3c-fd57-40fc-be8a-d00291251da6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad12085f356a4f0682bb70ad231a10b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:01.729218 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faae3c-fd57-40fc-be8a-d00291251da6 service swift] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:01.729798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faae3c-fd57-40fc-be8a-d00291251da6 service swift] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:01.729798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faae3c-fd57-40fc-be8a-d00291251da6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:01.741321 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25faae3c-fd57-40fc-be8a-d00291251da6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:01.743511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25faae3c-fd57-40fc-be8a-d00291251da6 service swift] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:01.754265 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1106/2250] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Jul 12 14:44:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:44:11.589346 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=69 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:11.767791 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=5 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:11.931819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7e679-09e1-40b5-99fe-711acc464b95 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:11.932326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7e679-09e1-40b5-99fe-711acc464b95 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:11.932663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7e679-09e1-40b5-99fe-711acc464b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:11.964270 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-51c7e679-09e1-40b5-99fe-711acc464b95 None None] MFA Rules not processed for user `abb27a4eecd14ab89a1d349fa3bdc0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:11.965553 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-51c7e679-09e1-40b5-99fe-711acc464b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:12.063369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1145/2251] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:13.935883 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a4189-9013-4fce-b383-00400a09ea0c None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:13.936486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a4189-9013-4fce-b383-00400a09ea0c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:13.936572 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a4189-9013-4fce-b383-00400a09ea0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:13.955593 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-8a5a4189-9013-4fce-b383-00400a09ea0c None None] MFA Rules not processed for user `582f3de5b2e8433da1300551829fc401`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:13.956842 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-8a5a4189-9013-4fce-b383-00400a09ea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:13.968576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1107/2252] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:14.192648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7e679-09e1-40b5-99fe-711acc464b95 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:14.194927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-51c7e679-09e1-40b5-99fe-711acc464b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:14.272417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7e679-09e1-40b5-99fe-711acc464b95 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:14.277750 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f1cb3-2e7d-44a5-be3d-012767ca596d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:14.278834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f1cb3-2e7d-44a5-be3d-012767ca596d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:14.279320 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f1cb3-2e7d-44a5-be3d-012767ca596d admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:14.279666 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f1cb3-2e7d-44a5-be3d-012767ca596d admin admin] PATH_INFO: `/v3/users/4c14a0e2a9f2443e88a46d1186bac686` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:14.280939 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f1cb3-2e7d-44a5-be3d-012767ca596d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c14a0e2a9f2443e88a46d1186bac686)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:14.283050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f1cb3-2e7d-44a5-be3d-012767ca596d admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:14.509981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-6d7f1cb3-2e7d-44a5-be3d-012767ca596d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c14a0e2a9f2443e88a46d1186bac686'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:14.524784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-6d7f1cb3-2e7d-44a5-be3d-012767ca596d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c14a0e2a9f2443e88a46d1186bac686'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:14.597191 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-6d7f1cb3-2e7d-44a5-be3d-012767ca596d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c14a0e2a9f2443e88a46d1186bac686'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:14.598112 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-6d7f1cb3-2e7d-44a5-be3d-012767ca596d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c14a0e2a9f2443e88a46d1186bac686'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:14.606821 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-6d7f1cb3-2e7d-44a5-be3d-012767ca596d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c14a0e2a9f2443e88a46d1186bac686'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:14.624884 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1146/2253] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:44:14 2022] DELETE /identity/v3/users/4c14a0e2a9f2443e88a46d1186bac686 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:14.629317 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277434e-10f1-4004-85d7-47cb38a0386f None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:14.629765 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277434e-10f1-4004-85d7-47cb38a0386f None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:14.630328 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277434e-10f1-4004-85d7-47cb38a0386f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:14.651444 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-5277434e-10f1-4004-85d7-47cb38a0386f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:14.653037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5277434e-10f1-4004-85d7-47cb38a0386f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:14.734718 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1108/2254] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:14.746597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f1cb3-2e7d-44a5-be3d-012767ca596d admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:14.747013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-6d7f1cb3-2e7d-44a5-be3d-012767ca596d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:14.783460 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:14.817660 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f1cb3-2e7d-44a5-be3d-012767ca596d admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:14.824625 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10743c-71c7-4b43-8af0-c5948ee4e3a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:14.824625 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10743c-71c7-4b43-8af0-c5948ee4e3a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:14.824625 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10743c-71c7-4b43-8af0-c5948ee4e3a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:14.824625 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10743c-71c7-4b43-8af0-c5948ee4e3a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:14.833893 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10743c-71c7-4b43-8af0-c5948ee4e3a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:14.835319 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10743c-71c7-4b43-8af0-c5948ee4e3a5 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:14.845893 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1147/2255] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:15.406259 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277434e-10f1-4004-85d7-47cb38a0386f None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:15.409779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5277434e-10f1-4004-85d7-47cb38a0386f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:15.436324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277434e-10f1-4004-85d7-47cb38a0386f None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:15.441494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a162809-cacb-49cd-87e8-6f749aeb8a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:15.442364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a162809-cacb-49cd-87e8-6f749aeb8a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:15.442642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a162809-cacb-49cd-87e8-6f749aeb8a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:15.442918 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a162809-cacb-49cd-87e8-6f749aeb8a64 admin admin] PATH_INFO: `/v3/projects/5e254cbe1ace4c4bb3f2e7a547976414` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:15.444133 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a162809-cacb-49cd-87e8-6f749aeb8a64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e254cbe1ace4c4bb3f2e7a547976414)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:15.446201 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a162809-cacb-49cd-87e8-6f749aeb8a64 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:15.600785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0a162809-cacb-49cd-87e8-6f749aeb8a64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e254cbe1ace4c4bb3f2e7a547976414', 'request_id': 'req-0a162809-cacb-49cd-87e8-6f749aeb8a64'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:15.607522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0a162809-cacb-49cd-87e8-6f749aeb8a64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e254cbe1ace4c4bb3f2e7a547976414', 'request_id': 'req-0a162809-cacb-49cd-87e8-6f749aeb8a64'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:15.615356 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0a162809-cacb-49cd-87e8-6f749aeb8a64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e254cbe1ace4c4bb3f2e7a547976414', 'request_id': 'req-0a162809-cacb-49cd-87e8-6f749aeb8a64'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:15.711001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0a162809-cacb-49cd-87e8-6f749aeb8a64 admin admin] The token cache is being invalidate because project 5e254cbe1ace4c4bb3f2e7a547976414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:44:15.711371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0a162809-cacb-49cd-87e8-6f749aeb8a64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:15.715210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0a162809-cacb-49cd-87e8-6f749aeb8a64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:15.715210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1109/2256] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:44:15 2022] DELETE /identity/v3/projects/5e254cbe1ace4c4bb3f2e7a547976414 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:15.718549 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10743c-71c7-4b43-8af0-c5948ee4e3a5 service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:15.729203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10743c-71c7-4b43-8af0-c5948ee4e3a5 service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:15.805060 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd74392-2fbf-4a47-83be-0e7a6a479d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:15.805945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd74392-2fbf-4a47-83be-0e7a6a479d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:15.806231 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd74392-2fbf-4a47-83be-0e7a6a479d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:15.806504 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd74392-2fbf-4a47-83be-0e7a6a479d46 admin admin] PATH_INFO: `/v3/users/eacfcea5db8e463c86e19ead34ade4f7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:15.807774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd74392-2fbf-4a47-83be-0e7a6a479d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eacfcea5db8e463c86e19ead34ade4f7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:15.809738 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd74392-2fbf-4a47-83be-0e7a6a479d46 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:16.023471 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-efd74392-2fbf-4a47-83be-0e7a6a479d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eacfcea5db8e463c86e19ead34ade4f7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:16.042797 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-efd74392-2fbf-4a47-83be-0e7a6a479d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eacfcea5db8e463c86e19ead34ade4f7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:16.144624 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-efd74392-2fbf-4a47-83be-0e7a6a479d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eacfcea5db8e463c86e19ead34ade4f7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:16.145273 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-efd74392-2fbf-4a47-83be-0e7a6a479d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eacfcea5db8e463c86e19ead34ade4f7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:16.156707 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-efd74392-2fbf-4a47-83be-0e7a6a479d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eacfcea5db8e463c86e19ead34ade4f7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:16.165183 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1148/2257] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:44:15 2022] DELETE /identity/v3/users/eacfcea5db8e463c86e19ead34ade4f7 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:16.998369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a162809-cacb-49cd-87e8-6f749aeb8a64 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:16.999763 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0a162809-cacb-49cd-87e8-6f749aeb8a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:17.033538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a162809-cacb-49cd-87e8-6f749aeb8a64 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:17.147204 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc1169-1280-4f9c-8200-28f4cca638d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:17.148430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc1169-1280-4f9c-8200-28f4cca638d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:17.148751 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc1169-1280-4f9c-8200-28f4cca638d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:17.149780 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc1169-1280-4f9c-8200-28f4cca638d5 admin admin] PATH_INFO: `/v3/projects/3c16dca1aafb41358292d94c005e6871` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:17.151337 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc1169-1280-4f9c-8200-28f4cca638d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c16dca1aafb41358292d94c005e6871)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:17.155361 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc1169-1280-4f9c-8200-28f4cca638d5 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:17.189777 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:17.335157 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9ccc1169-1280-4f9c-8200-28f4cca638d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c16dca1aafb41358292d94c005e6871', 'request_id': 'req-9ccc1169-1280-4f9c-8200-28f4cca638d5'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:17.342228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9ccc1169-1280-4f9c-8200-28f4cca638d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c16dca1aafb41358292d94c005e6871', 'request_id': 'req-9ccc1169-1280-4f9c-8200-28f4cca638d5'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:17.349799 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9ccc1169-1280-4f9c-8200-28f4cca638d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c16dca1aafb41358292d94c005e6871', 'request_id': 'req-9ccc1169-1280-4f9c-8200-28f4cca638d5'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:17.419031 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9ccc1169-1280-4f9c-8200-28f4cca638d5 admin admin] The token cache is being invalidate because project 3c16dca1aafb41358292d94c005e6871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:44:17.419430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9ccc1169-1280-4f9c-8200-28f4cca638d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:17.420102 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9ccc1169-1280-4f9c-8200-28f4cca638d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:17.421666 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1110/2258] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:44:16 2022] DELETE /identity/v3/projects/3c16dca1aafb41358292d94c005e6871 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:17.426679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4deb954-9369-4d9a-9cdc-fbe1df7fb93e None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:17.427160 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4deb954-9369-4d9a-9cdc-fbe1df7fb93e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:17.427263 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4deb954-9369-4d9a-9cdc-fbe1df7fb93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:17.447781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-c4deb954-9369-4d9a-9cdc-fbe1df7fb93e None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:17.450081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-c4deb954-9369-4d9a-9cdc-fbe1df7fb93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:17.530318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:17.548904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1149/2259] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:44:17.556922 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b5279-6bf6-48df-8317-41ae514b3599 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:17.557217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b5279-6bf6-48df-8317-41ae514b3599 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:17.557503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b5279-6bf6-48df-8317-41ae514b3599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:17.576908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-9b4b5279-6bf6-48df-8317-41ae514b3599 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:17.578167 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-9b4b5279-6bf6-48df-8317-41ae514b3599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:17.587561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1111/2260] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:17.592664 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4deb954-9369-4d9a-9cdc-fbe1df7fb93e None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:17.612100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4deb954-9369-4d9a-9cdc-fbe1df7fb93e None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:17.619171 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b65311-c5d4-4dec-805f-d568c660f82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:17.620200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b65311-c5d4-4dec-805f-d568c660f82d admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:17.620670 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b65311-c5d4-4dec-805f-d568c660f82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:17.621120 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b65311-c5d4-4dec-805f-d568c660f82d admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:17.622164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b65311-c5d4-4dec-805f-d568c660f82d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:44:17.622677 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b65311-c5d4-4dec-805f-d568c660f82d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:17.624860 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b65311-c5d4-4dec-805f-d568c660f82d admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:17.649506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b5279-6bf6-48df-8317-41ae514b3599 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:17.649639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1150/2261] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:44:17.669128 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b5279-6bf6-48df-8317-41ae514b3599 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:17.677560 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd3e8f-40a6-4873-a251-dbf9bbdccb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:17.678847 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd3e8f-40a6-4873-a251-dbf9bbdccb1d admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:17.680043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd3e8f-40a6-4873-a251-dbf9bbdccb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:17.680945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd3e8f-40a6-4873-a251-dbf9bbdccb1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:17.681399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd3e8f-40a6-4873-a251-dbf9bbdccb1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:17.684096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd3e8f-40a6-4873-a251-dbf9bbdccb1d admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:17.818947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1112/2262] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:44:17 2022] POST /identity/v3/projects => generated 363 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:44:17.823382 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b65311-c5d4-4dec-805f-d568c660f82d admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:17.837187 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b65311-c5d4-4dec-805f-d568c660f82d admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:17.944431 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e53941-f3cd-476a-9673-dadd0d76c5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:17.945143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e53941-f3cd-476a-9673-dadd0d76c5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:17.945568 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e53941-f3cd-476a-9673-dadd0d76c5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:17.946016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e53941-f3cd-476a-9673-dadd0d76c5f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:17.946869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e53941-f3cd-476a-9673-dadd0d76c5f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:17.948866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e53941-f3cd-476a-9673-dadd0d76c5f9 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:18.092325 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1151/2263] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:44:17 2022] POST /identity/v3/users => generated 282 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:44:18.096257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd3e8f-40a6-4873-a251-dbf9bbdccb1d admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:18.119212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd3e8f-40a6-4873-a251-dbf9bbdccb1d admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:18.126844 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f67c3-f3e3-4024-a772-0faf393c9daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:18.128174 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f67c3-f3e3-4024-a772-0faf393c9daa admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:18.128623 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f67c3-f3e3-4024-a772-0faf393c9daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:18.129064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f67c3-f3e3-4024-a772-0faf393c9daa admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:18.129924 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f67c3-f3e3-4024-a772-0faf393c9daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:18.131843 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f67c3-f3e3-4024-a772-0faf393c9daa admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:18.149657 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1113/2264] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:44:18.149841 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e53941-f3cd-476a-9673-dadd0d76c5f9 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:18.161047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e53941-f3cd-476a-9673-dadd0d76c5f9 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:18.167006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb93d4-f08a-432c-8fb5-83182d2409db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:18.167919 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb93d4-f08a-432c-8fb5-83182d2409db admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:18.168356 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb93d4-f08a-432c-8fb5-83182d2409db admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:18.168715 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb93d4-f08a-432c-8fb5-83182d2409db admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:18.170274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb93d4-f08a-432c-8fb5-83182d2409db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:18.172231 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb93d4-f08a-432c-8fb5-83182d2409db admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:18.191088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1152/2265] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:44:18.195763 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f67c3-f3e3-4024-a772-0faf393c9daa admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:18.213127 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f67c3-f3e3-4024-a772-0faf393c9daa admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:18.222213 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9a773-935e-4784-a1e0-437d25d3b90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:18.223255 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9a773-935e-4784-a1e0-437d25d3b90e admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:18.223671 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9a773-935e-4784-a1e0-437d25d3b90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:18.224021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9a773-935e-4784-a1e0-437d25d3b90e admin admin] PATH_INFO: `/v3/projects/4016d06100414662bac9bc5aa240ffa5/users/48e2643f1af046daa9efc2cdea373683/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:18.245247 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9a773-935e-4784-a1e0-437d25d3b90e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4016d06100414662bac9bc5aa240ffa5, user_id=48e2643f1af046daa9efc2cdea373683, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:18.248722 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9a773-935e-4784-a1e0-437d25d3b90e admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:18.381268 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1114/2266] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:44:18 2022] PUT /identity/v3/projects/4016d06100414662bac9bc5aa240ffa5/users/48e2643f1af046daa9efc2cdea373683/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:18.394804 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08551d-05b1-4bed-8c6a-346f1a629215 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:18.395100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08551d-05b1-4bed-8c6a-346f1a629215 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:18.395417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08551d-05b1-4bed-8c6a-346f1a629215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:18.442518 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-ef08551d-05b1-4bed-8c6a-346f1a629215 None None] MFA Rules not processed for user `48e2643f1af046daa9efc2cdea373683`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:18.444602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ef08551d-05b1-4bed-8c6a-346f1a629215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:18.568686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1153/2267] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:18.573034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9a773-935e-4784-a1e0-437d25d3b90e admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:18.718725 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9a773-935e-4784-a1e0-437d25d3b90e admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:18.731308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41138e39-5e42-48a8-9141-5c5b2841b396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:18.732903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41138e39-5e42-48a8-9141-5c5b2841b396 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:18.733255 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41138e39-5e42-48a8-9141-5c5b2841b396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:18.733546 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41138e39-5e42-48a8-9141-5c5b2841b396 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:18.734340 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41138e39-5e42-48a8-9141-5c5b2841b396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:18.736527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41138e39-5e42-48a8-9141-5c5b2841b396 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:18.743020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a3579-d293-430f-8867-7e3f52fb9b01 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:18.743405 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a3579-d293-430f-8867-7e3f52fb9b01 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:18.743881 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a3579-d293-430f-8867-7e3f52fb9b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:18.773450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-573a3579-d293-430f-8867-7e3f52fb9b01 None None] MFA Rules not processed for user `5ec758ef106b49f4985845b3c106f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:18.775131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-573a3579-d293-430f-8867-7e3f52fb9b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:18.838327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:18.842690 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1115/2268] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:44:18 2022] POST /identity/v3/projects => generated 365 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:44:18.847025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41138e39-5e42-48a8-9141-5c5b2841b396 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:18.881780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1154/2269] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Jul 12 14:44:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:44:18.894202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a3579-d293-430f-8867-7e3f52fb9b01 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:18.895725 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-573a3579-d293-430f-8867-7e3f52fb9b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:18.915727 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:18.971804 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41138e39-5e42-48a8-9141-5c5b2841b396 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:18.983369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086da3b-bf70-4a6f-a5e5-56ab91eb3bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:18.984498 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086da3b-bf70-4a6f-a5e5-56ab91eb3bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:18.984939 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086da3b-bf70-4a6f-a5e5-56ab91eb3bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:18.985460 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086da3b-bf70-4a6f-a5e5-56ab91eb3bd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:18.986330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086da3b-bf70-4a6f-a5e5-56ab91eb3bd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:19.011424 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086da3b-bf70-4a6f-a5e5-56ab91eb3bd7 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:19.085836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a3579-d293-430f-8867-7e3f52fb9b01 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:19.175504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1116/2270] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:44:18 2022] POST /identity/v3/users => generated 289 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:44:19.176620 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086da3b-bf70-4a6f-a5e5-56ab91eb3bd7 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:19.202052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086da3b-bf70-4a6f-a5e5-56ab91eb3bd7 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:19.211341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4188284-9028-439c-a9a7-5db64b127343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:19.212717 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4188284-9028-439c-a9a7-5db64b127343 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:19.213179 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4188284-9028-439c-a9a7-5db64b127343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:19.213942 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4188284-9028-439c-a9a7-5db64b127343 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:19.215416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4188284-9028-439c-a9a7-5db64b127343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:19.218998 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4188284-9028-439c-a9a7-5db64b127343 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:19.225398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df4b11-4a72-4fb3-aff3-b5075ece60ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad12085f356a4f0682bb70ad231a10b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:19.228158 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df4b11-4a72-4fb3-aff3-b5075ece60ee service swift] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:19.228450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df4b11-4a72-4fb3-aff3-b5075ece60ee service swift] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:19.228883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df4b11-4a72-4fb3-aff3-b5075ece60ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:19.240799 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1117/2271] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:44:19.254107 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4188284-9028-439c-a9a7-5db64b127343 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:19.278228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4188284-9028-439c-a9a7-5db64b127343 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:19.300229 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafd364-a2a0-42f5-963b-6457830ddfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:19.303300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafd364-a2a0-42f5-963b-6457830ddfbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:19.304417 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafd364-a2a0-42f5-963b-6457830ddfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:19.304721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafd364-a2a0-42f5-963b-6457830ddfbf admin admin] PATH_INFO: `/v3/projects/9c0c475e2de24361ba42726fdd5e32d8/users/d4f875e707ce45b5a775aa4c267e78e9/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:19.337346 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafd364-a2a0-42f5-963b-6457830ddfbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0c475e2de24361ba42726fdd5e32d8, user_id=d4f875e707ce45b5a775aa4c267e78e9, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:19.355312 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafd364-a2a0-42f5-963b-6457830ddfbf admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:19.386689 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df4b11-4a72-4fb3-aff3-b5075ece60ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:19.390133 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df4b11-4a72-4fb3-aff3-b5075ece60ee service swift] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:19.400170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1155/2272] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Jul 12 14:44:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:44:19.451965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1118/2273] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:44:19 2022] PUT /identity/v3/projects/9c0c475e2de24361ba42726fdd5e32d8/users/d4f875e707ce45b5a775aa4c267e78e9/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:19.455573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df4b11-4a72-4fb3-aff3-b5075ece60ee service swift] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:19.481655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df4b11-4a72-4fb3-aff3-b5075ece60ee service swift] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:19.563690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589bb76-3d1a-4970-8310-214b89753609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:19.564393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589bb76-3d1a-4970-8310-214b89753609 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:19.564679 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589bb76-3d1a-4970-8310-214b89753609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:19.564957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589bb76-3d1a-4970-8310-214b89753609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:19.565711 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589bb76-3d1a-4970-8310-214b89753609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:19.567414 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589bb76-3d1a-4970-8310-214b89753609 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:19.578292 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1156/2274] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:44:19.583389 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafd364-a2a0-42f5-963b-6457830ddfbf admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:19.598556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafd364-a2a0-42f5-963b-6457830ddfbf admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:19.607857 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b1362-afdf-4fb8-9a4c-e00dc305b650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:19.612703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b1362-afdf-4fb8-9a4c-e00dc305b650 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:19.612703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b1362-afdf-4fb8-9a4c-e00dc305b650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:19.612703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b1362-afdf-4fb8-9a4c-e00dc305b650 admin admin] PATH_INFO: `/v3/projects/9c0c475e2de24361ba42726fdd5e32d8/users/d4f875e707ce45b5a775aa4c267e78e9/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:19.612703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b1362-afdf-4fb8-9a4c-e00dc305b650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0c475e2de24361ba42726fdd5e32d8, user_id=d4f875e707ce45b5a775aa4c267e78e9, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:19.616067 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b1362-afdf-4fb8-9a4c-e00dc305b650 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:19.631829 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:19.638866 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1119/2275] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:44:19 2022] PUT /identity/v3/projects/9c0c475e2de24361ba42726fdd5e32d8/users/d4f875e707ce45b5a775aa4c267e78e9/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:19.649377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8d47d-886b-4d37-b6af-019658a3e7a7 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:19.649935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8d47d-886b-4d37-b6af-019658a3e7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:19.650402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8d47d-886b-4d37-b6af-019658a3e7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:19.716955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-05d8d47d-886b-4d37-b6af-019658a3e7a7 None None] MFA Rules not processed for user `d4f875e707ce45b5a775aa4c267e78e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:19.718226 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-05d8d47d-886b-4d37-b6af-019658a3e7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:19.881549 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1157/2276] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:19.902574 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b1362-afdf-4fb8-9a4c-e00dc305b650 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:19.910543 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-8c2b1362-afdf-4fb8-9a4c-e00dc305b650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:19.992221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b1362-afdf-4fb8-9a4c-e00dc305b650 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:19.996079 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb3ca8-df37-4a35-b2e8-9e0e7d2051d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:19.996976 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb3ca8-df37-4a35-b2e8-9e0e7d2051d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:19.997608 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb3ca8-df37-4a35-b2e8-9e0e7d2051d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:19.998305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb3ca8-df37-4a35-b2e8-9e0e7d2051d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:20.008749 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb3ca8-df37-4a35-b2e8-9e0e7d2051d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:20.010559 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb3ca8-df37-4a35-b2e8-9e0e7d2051d7 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:20.021745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1120/2277] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:20.328871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8d47d-886b-4d37-b6af-019658a3e7a7 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:20.347195 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8d47d-886b-4d37-b6af-019658a3e7a7 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:20.353949 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656a875-7be4-4c71-8635-95e5d3b3aa89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:20.355180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656a875-7be4-4c71-8635-95e5d3b3aa89 service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:20.355770 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656a875-7be4-4c71-8635-95e5d3b3aa89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:20.356292 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656a875-7be4-4c71-8635-95e5d3b3aa89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:20.487829 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656a875-7be4-4c71-8635-95e5d3b3aa89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:20.489300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656a875-7be4-4c71-8635-95e5d3b3aa89 service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:20.503749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1158/2278] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:20 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:21.791516 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb3ca8-df37-4a35-b2e8-9e0e7d2051d7 service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:21.793290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b6fb3ca8-df37-4a35-b2e8-9e0e7d2051d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:21.879711 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb3ca8-df37-4a35-b2e8-9e0e7d2051d7 service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:21.884349 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77e02d-5445-49ea-9348-74aeea2004d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:21.885496 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77e02d-5445-49ea-9348-74aeea2004d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:21.885781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77e02d-5445-49ea-9348-74aeea2004d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:21.886057 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77e02d-5445-49ea-9348-74aeea2004d3 admin admin] PATH_INFO: `/v3/users/b9ca96db12074a9fa09a7dcf9c1a6565` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:21.887244 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77e02d-5445-49ea-9348-74aeea2004d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ca96db12074a9fa09a7dcf9c1a6565)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:21.889798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77e02d-5445-49ea-9348-74aeea2004d3 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:21.909436 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:22.155890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-fc77e02d-5445-49ea-9348-74aeea2004d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ca96db12074a9fa09a7dcf9c1a6565'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:22.169413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-fc77e02d-5445-49ea-9348-74aeea2004d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ca96db12074a9fa09a7dcf9c1a6565'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:22.178345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-fc77e02d-5445-49ea-9348-74aeea2004d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ca96db12074a9fa09a7dcf9c1a6565'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:22.266161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-fc77e02d-5445-49ea-9348-74aeea2004d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ca96db12074a9fa09a7dcf9c1a6565'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:22.267014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-fc77e02d-5445-49ea-9348-74aeea2004d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ca96db12074a9fa09a7dcf9c1a6565'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:22.281657 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1121/2279] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:44:21 2022] DELETE /identity/v3/users/b9ca96db12074a9fa09a7dcf9c1a6565 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:22.290162 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803e1d0-b0c3-410b-b7e3-b17b4144c3d6 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:22.290162 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803e1d0-b0c3-410b-b7e3-b17b4144c3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:22.290162 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803e1d0-b0c3-410b-b7e3-b17b4144c3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:22.307582 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-d803e1d0-b0c3-410b-b7e3-b17b4144c3d6 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:22.309087 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d803e1d0-b0c3-410b-b7e3-b17b4144c3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:22.381398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:22.409057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1159/2280] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:44:22.418747 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77e02d-5445-49ea-9348-74aeea2004d3 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:22.420300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fc77e02d-5445-49ea-9348-74aeea2004d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:22.502435 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77e02d-5445-49ea-9348-74aeea2004d3 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:22.506109 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a056d2-a54a-40ee-9a7b-9ea595fea106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:22.508301 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a056d2-a54a-40ee-9a7b-9ea595fea106 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:22.508301 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a056d2-a54a-40ee-9a7b-9ea595fea106 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:22.508301 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a056d2-a54a-40ee-9a7b-9ea595fea106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:22.523456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a056d2-a54a-40ee-9a7b-9ea595fea106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:22.524929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a056d2-a54a-40ee-9a7b-9ea595fea106 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:22.535179 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1122/2281] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:23.235510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803e1d0-b0c3-410b-b7e3-b17b4144c3d6 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:23.250723 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d803e1d0-b0c3-410b-b7e3-b17b4144c3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:23.268326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803e1d0-b0c3-410b-b7e3-b17b4144c3d6 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:23.273388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b68c2-32a3-4810-9bb7-9d2e8595d4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:23.274285 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b68c2-32a3-4810-9bb7-9d2e8595d4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:23.274578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b68c2-32a3-4810-9bb7-9d2e8595d4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:23.274864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b68c2-32a3-4810-9bb7-9d2e8595d4d1 admin admin] PATH_INFO: `/v3/projects/ad7f67c2641f483abdd1002828b22da2` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:23.276161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b68c2-32a3-4810-9bb7-9d2e8595d4d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad7f67c2641f483abdd1002828b22da2)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:23.279618 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b68c2-32a3-4810-9bb7-9d2e8595d4d1 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:23.410188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b71b68c2-32a3-4810-9bb7-9d2e8595d4d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad7f67c2641f483abdd1002828b22da2', 'request_id': 'req-b71b68c2-32a3-4810-9bb7-9d2e8595d4d1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:23.503777 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b71b68c2-32a3-4810-9bb7-9d2e8595d4d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad7f67c2641f483abdd1002828b22da2', 'request_id': 'req-b71b68c2-32a3-4810-9bb7-9d2e8595d4d1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:23.510488 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b71b68c2-32a3-4810-9bb7-9d2e8595d4d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad7f67c2641f483abdd1002828b22da2', 'request_id': 'req-b71b68c2-32a3-4810-9bb7-9d2e8595d4d1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:23.522872 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b71b68c2-32a3-4810-9bb7-9d2e8595d4d1 admin admin] The token cache is being invalidate because project ad7f67c2641f483abdd1002828b22da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:44:23.523162 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b71b68c2-32a3-4810-9bb7-9d2e8595d4d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:23.523896 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b71b68c2-32a3-4810-9bb7-9d2e8595d4d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:23.525461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1160/2282] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:44:23 2022] DELETE /identity/v3/projects/ad7f67c2641f483abdd1002828b22da2 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:23.531364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d106d5-6055-4c43-a721-f7034433ba42 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:23.531844 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d106d5-6055-4c43-a721-f7034433ba42 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:23.532195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d106d5-6055-4c43-a721-f7034433ba42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:23.564268 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-18d106d5-6055-4c43-a721-f7034433ba42 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:23.565520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-18d106d5-6055-4c43-a721-f7034433ba42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:23.653259 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1123/2283] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:23.662688 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d69e49-ba8c-45ea-87b3-a7039d8bc613 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:23.663020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d69e49-ba8c-45ea-87b3-a7039d8bc613 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:23.663472 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d69e49-ba8c-45ea-87b3-a7039d8bc613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:23.684204 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-75d69e49-ba8c-45ea-87b3-a7039d8bc613 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:23.685754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-75d69e49-ba8c-45ea-87b3-a7039d8bc613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:23.694492 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1161/2284] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:23.701119 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d106d5-6055-4c43-a721-f7034433ba42 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:23.712065 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d106d5-6055-4c43-a721-f7034433ba42 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:23.719816 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff73d7-d0a0-446c-8377-32791e7e54be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:23.720478 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff73d7-d0a0-446c-8377-32791e7e54be admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:23.720752 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff73d7-d0a0-446c-8377-32791e7e54be admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:23.721013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff73d7-d0a0-446c-8377-32791e7e54be admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:23.721757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff73d7-d0a0-446c-8377-32791e7e54be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:44:23.722078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff73d7-d0a0-446c-8377-32791e7e54be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:23.723727 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff73d7-d0a0-446c-8377-32791e7e54be admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:23.736256 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1124/2285] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:44:23.740929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d69e49-ba8c-45ea-87b3-a7039d8bc613 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:23.751443 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d69e49-ba8c-45ea-87b3-a7039d8bc613 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:23.756415 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564fd75-786d-42a3-b9ae-000314cf4389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:23.757011 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564fd75-786d-42a3-b9ae-000314cf4389 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:23.757298 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564fd75-786d-42a3-b9ae-000314cf4389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:23.757576 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564fd75-786d-42a3-b9ae-000314cf4389 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:23.758279 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564fd75-786d-42a3-b9ae-000314cf4389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:23.760498 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564fd75-786d-42a3-b9ae-000314cf4389 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:23.873909 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1162/2286] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:44:23 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:44:23.878458 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff73d7-d0a0-446c-8377-32791e7e54be admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:23.889642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff73d7-d0a0-446c-8377-32791e7e54be admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:23.929873 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:24.010361 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d2eef-2e95-44b8-9de9-57e1fd043e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:24.011212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d2eef-2e95-44b8-9de9-57e1fd043e01 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:24.011434 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d2eef-2e95-44b8-9de9-57e1fd043e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:24.011903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d2eef-2e95-44b8-9de9-57e1fd043e01 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:24.012649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d2eef-2e95-44b8-9de9-57e1fd043e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:24.015547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d2eef-2e95-44b8-9de9-57e1fd043e01 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:24.168489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1125/2287] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:44:23 2022] POST /identity/v3/users => generated 291 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:44:24.171218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564fd75-786d-42a3-b9ae-000314cf4389 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:24.186808 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564fd75-786d-42a3-b9ae-000314cf4389 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:24.192052 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c3555-b2e9-41d3-9608-cbf0a2a9eac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:24.192736 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c3555-b2e9-41d3-9608-cbf0a2a9eac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:24.193021 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c3555-b2e9-41d3-9608-cbf0a2a9eac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:24.193301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c3555-b2e9-41d3-9608-cbf0a2a9eac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:24.194102 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c3555-b2e9-41d3-9608-cbf0a2a9eac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:24.195751 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c3555-b2e9-41d3-9608-cbf0a2a9eac5 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:24.208739 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1163/2288] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:44:24.215081 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d2eef-2e95-44b8-9de9-57e1fd043e01 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:24.225406 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d2eef-2e95-44b8-9de9-57e1fd043e01 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:24.232623 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c28fa-56fc-4647-8e02-4376cd1ad5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:24.233419 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c28fa-56fc-4647-8e02-4376cd1ad5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:24.233706 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c28fa-56fc-4647-8e02-4376cd1ad5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:24.234053 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c28fa-56fc-4647-8e02-4376cd1ad5b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:24.234735 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c28fa-56fc-4647-8e02-4376cd1ad5b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:24.242288 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c28fa-56fc-4647-8e02-4376cd1ad5b7 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:24.281146 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1126/2289] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:44:24.285470 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c3555-b2e9-41d3-9608-cbf0a2a9eac5 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:24.297644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c3555-b2e9-41d3-9608-cbf0a2a9eac5 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:24.305202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe1f40-027f-4ca8-a275-b349d16bb9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:24.306423 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe1f40-027f-4ca8-a275-b349d16bb9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:24.306836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe1f40-027f-4ca8-a275-b349d16bb9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:24.307221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe1f40-027f-4ca8-a275-b349d16bb9ae admin admin] PATH_INFO: `/v3/projects/d3cd168575c549aaafc5901dad18795a/users/d691506a2d8a43cf831d0265f85e9651/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:24.331011 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c28fa-56fc-4647-8e02-4376cd1ad5b7 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:24.332964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe1f40-027f-4ca8-a275-b349d16bb9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3cd168575c549aaafc5901dad18795a, user_id=d691506a2d8a43cf831d0265f85e9651, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:24.333781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-f86c28fa-56fc-4647-8e02-4376cd1ad5b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:24.336616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe1f40-027f-4ca8-a275-b349d16bb9ae admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:24.349673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c28fa-56fc-4647-8e02-4376cd1ad5b7 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:24.355495 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9fe2f-c3bb-4a11-ad71-48a76b11b34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:24.357103 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9fe2f-c3bb-4a11-ad71-48a76b11b34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:24.357458 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9fe2f-c3bb-4a11-ad71-48a76b11b34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:24.357725 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9fe2f-c3bb-4a11-ad71-48a76b11b34f admin admin] PATH_INFO: `/v3/users/48e2643f1af046daa9efc2cdea373683` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:24.359004 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9fe2f-c3bb-4a11-ad71-48a76b11b34f admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e2643f1af046daa9efc2cdea373683)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:24.361027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9fe2f-c3bb-4a11-ad71-48a76b11b34f admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:24.427566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1164/2290] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:44:24 2022] PUT /identity/v3/projects/d3cd168575c549aaafc5901dad18795a/users/d691506a2d8a43cf831d0265f85e9651/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:24.432831 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f63e4-0c32-4bbd-a154-65248367d068 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:24.433214 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f63e4-0c32-4bbd-a154-65248367d068 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:24.433574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f63e4-0c32-4bbd-a154-65248367d068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:24.462451 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-815f63e4-0c32-4bbd-a154-65248367d068 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:24.463967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-815f63e4-0c32-4bbd-a154-65248367d068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:24.568730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1165/2291] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:44:24.568730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f63e4-0c32-4bbd-a154-65248367d068 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:24.568730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-815f63e4-0c32-4bbd-a154-65248367d068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:24.580180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:24.665093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f63e4-0c32-4bbd-a154-65248367d068 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:24.669852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c8394-8781-4bf2-9bba-937a37e748a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:24.678507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c8394-8781-4bf2-9bba-937a37e748a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:24.678507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c8394-8781-4bf2-9bba-937a37e748a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:24.678507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c8394-8781-4bf2-9bba-937a37e748a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:24.683421 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c8394-8781-4bf2-9bba-937a37e748a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:24.684936 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c8394-8781-4bf2-9bba-937a37e748a6 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:24.701494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1166/2292] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:44:25.187835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-25d9fe2f-c3bb-4a11-ad71-48a76b11b34f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e2643f1af046daa9efc2cdea373683'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:25.204338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-25d9fe2f-c3bb-4a11-ad71-48a76b11b34f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e2643f1af046daa9efc2cdea373683'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:25.216989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-25d9fe2f-c3bb-4a11-ad71-48a76b11b34f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e2643f1af046daa9efc2cdea373683'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:25.287024 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-25d9fe2f-c3bb-4a11-ad71-48a76b11b34f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e2643f1af046daa9efc2cdea373683'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:25.287798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-25d9fe2f-c3bb-4a11-ad71-48a76b11b34f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e2643f1af046daa9efc2cdea373683'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:25.297783 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1127/2293] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:44:24 2022] DELETE /identity/v3/users/48e2643f1af046daa9efc2cdea373683 => generated 0 bytes in 964 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:44:25.299598 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc09f6-277a-47f8-b1ec-c9f353791c34 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:25.299916 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc09f6-277a-47f8-b1ec-c9f353791c34 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:25.300186 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc09f6-277a-47f8-b1ec-c9f353791c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:25.318001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-20dc09f6-277a-47f8-b1ec-c9f353791c34 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:25.319201 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-20dc09f6-277a-47f8-b1ec-c9f353791c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:25.415142 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1167/2294] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:25.444978 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9fe2f-c3bb-4a11-ad71-48a76b11b34f admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:25.447101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-25d9fe2f-c3bb-4a11-ad71-48a76b11b34f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:25.541432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9fe2f-c3bb-4a11-ad71-48a76b11b34f admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:25.545876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4a479-607e-48c0-b3a2-0a95d6198382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:25.546533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4a479-607e-48c0-b3a2-0a95d6198382 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:25.546821 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4a479-607e-48c0-b3a2-0a95d6198382 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:25.547236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4a479-607e-48c0-b3a2-0a95d6198382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:25.557732 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4a479-607e-48c0-b3a2-0a95d6198382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:25.559215 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4a479-607e-48c0-b3a2-0a95d6198382 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:25.569993 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1128/2295] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:25.767394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc09f6-277a-47f8-b1ec-c9f353791c34 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:25.768930 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-20dc09f6-277a-47f8-b1ec-c9f353791c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:25.781668 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc09f6-277a-47f8-b1ec-c9f353791c34 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:25.790017 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e92bb2-6521-4178-b9ce-657ad9591ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:25.791099 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e92bb2-6521-4178-b9ce-657ad9591ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:25.791495 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e92bb2-6521-4178-b9ce-657ad9591ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:25.791787 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e92bb2-6521-4178-b9ce-657ad9591ea9 admin admin] PATH_INFO: `/v3/users/fbc9b737ffd447a798ec5ac60474331b` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:25.793737 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e92bb2-6521-4178-b9ce-657ad9591ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbc9b737ffd447a798ec5ac60474331b)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:25.796572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e92bb2-6521-4178-b9ce-657ad9591ea9 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:26.034354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-94e92bb2-6521-4178-b9ce-657ad9591ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbc9b737ffd447a798ec5ac60474331b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:26.047099 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-94e92bb2-6521-4178-b9ce-657ad9591ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbc9b737ffd447a798ec5ac60474331b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:26.121127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-94e92bb2-6521-4178-b9ce-657ad9591ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbc9b737ffd447a798ec5ac60474331b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:26.121855 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-94e92bb2-6521-4178-b9ce-657ad9591ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbc9b737ffd447a798ec5ac60474331b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:26.130688 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-94e92bb2-6521-4178-b9ce-657ad9591ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbc9b737ffd447a798ec5ac60474331b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:26.140014 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1168/2296] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:44:25 2022] DELETE /identity/v3/users/fbc9b737ffd447a798ec5ac60474331b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:26.143462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b259f3c-fe0e-458d-aa02-9ed5318cb0cd None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:26.143833 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b259f3c-fe0e-458d-aa02-9ed5318cb0cd None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:26.144334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b259f3c-fe0e-458d-aa02-9ed5318cb0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:26.185710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-2b259f3c-fe0e-458d-aa02-9ed5318cb0cd None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:26.191536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2b259f3c-fe0e-458d-aa02-9ed5318cb0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:26.212422 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:26.361059 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1129/2297] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:26.381071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e92bb2-6521-4178-b9ce-657ad9591ea9 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:26.390579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-94e92bb2-6521-4178-b9ce-657ad9591ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:26.433503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b259f3c-fe0e-458d-aa02-9ed5318cb0cd None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:26.437166 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2b259f3c-fe0e-458d-aa02-9ed5318cb0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:26.453808 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b259f3c-fe0e-458d-aa02-9ed5318cb0cd None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:26.460575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e92bb2-6521-4178-b9ce-657ad9591ea9 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:26.461017 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc3d96-77b4-4de4-96c3-6255ddaf6336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:26.462252 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc3d96-77b4-4de4-96c3-6255ddaf6336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:26.466839 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc3d96-77b4-4de4-96c3-6255ddaf6336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:26.467308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc3d96-77b4-4de4-96c3-6255ddaf6336 admin admin] PATH_INFO: `/v3/projects/4016d06100414662bac9bc5aa240ffa5` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:26.468096 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b642f51-cdd9-4c0a-a02f-16269e37c5ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:26.469023 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b642f51-cdd9-4c0a-a02f-16269e37c5ed service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:26.469467 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b642f51-cdd9-4c0a-a02f-16269e37c5ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:26.469896 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b642f51-cdd9-4c0a-a02f-16269e37c5ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:26.471582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc3d96-77b4-4de4-96c3-6255ddaf6336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4016d06100414662bac9bc5aa240ffa5)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:26.476643 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc3d96-77b4-4de4-96c3-6255ddaf6336 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:26.498534 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b642f51-cdd9-4c0a-a02f-16269e37c5ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:26.500039 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b642f51-cdd9-4c0a-a02f-16269e37c5ed service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:26.520970 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1169/2298] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:26.637430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-babc3d96-77b4-4de4-96c3-6255ddaf6336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4016d06100414662bac9bc5aa240ffa5', 'request_id': 'req-babc3d96-77b4-4de4-96c3-6255ddaf6336'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:26.652817 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-babc3d96-77b4-4de4-96c3-6255ddaf6336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4016d06100414662bac9bc5aa240ffa5', 'request_id': 'req-babc3d96-77b4-4de4-96c3-6255ddaf6336'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:26.660203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-babc3d96-77b4-4de4-96c3-6255ddaf6336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4016d06100414662bac9bc5aa240ffa5', 'request_id': 'req-babc3d96-77b4-4de4-96c3-6255ddaf6336'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:26.854500 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-babc3d96-77b4-4de4-96c3-6255ddaf6336 admin admin] The token cache is being invalidate because project 4016d06100414662bac9bc5aa240ffa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:44:26.854500 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-babc3d96-77b4-4de4-96c3-6255ddaf6336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:26.855846 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-babc3d96-77b4-4de4-96c3-6255ddaf6336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:26.861200 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1130/2299] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:44:26 2022] DELETE /identity/v3/projects/4016d06100414662bac9bc5aa240ffa5 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:26.865459 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b642f51-cdd9-4c0a-a02f-16269e37c5ed service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:26.894888 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b642f51-cdd9-4c0a-a02f-16269e37c5ed service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:26.917720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:26.925378 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06ee29-1862-4c5f-93f0-7c69b24f39a7 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:26.925743 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06ee29-1862-4c5f-93f0-7c69b24f39a7 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:26.926455 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06ee29-1862-4c5f-93f0-7c69b24f39a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:26.996797 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-5b06ee29-1862-4c5f-93f0-7c69b24f39a7 None None] MFA Rules not processed for user `d691506a2d8a43cf831d0265f85e9651`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:26.998588 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5b06ee29-1862-4c5f-93f0-7c69b24f39a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:27.024464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c68f52-165c-4b78-bb3d-1aa666acf045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:27.025276 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c68f52-165c-4b78-bb3d-1aa666acf045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:27.025559 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c68f52-165c-4b78-bb3d-1aa666acf045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:27.025837 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c68f52-165c-4b78-bb3d-1aa666acf045 admin admin] PATH_INFO: `/v3/users/d4f875e707ce45b5a775aa4c267e78e9` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:27.027153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c68f52-165c-4b78-bb3d-1aa666acf045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4f875e707ce45b5a775aa4c267e78e9)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:27.029184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c68f52-165c-4b78-bb3d-1aa666acf045 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:27.119407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1131/2300] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:27.131536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06ee29-1862-4c5f-93f0-7c69b24f39a7 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:27.133266 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5b06ee29-1862-4c5f-93f0-7c69b24f39a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:27.217615 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06ee29-1862-4c5f-93f0-7c69b24f39a7 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:27.221678 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5a419-e068-4fc0-b37e-e2df5383d0b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:27.223154 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5a419-e068-4fc0-b37e-e2df5383d0b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:27.223154 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5a419-e068-4fc0-b37e-e2df5383d0b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:27.223154 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5a419-e068-4fc0-b37e-e2df5383d0b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:27.233899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5a419-e068-4fc0-b37e-e2df5383d0b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:27.236372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5a419-e068-4fc0-b37e-e2df5383d0b7 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:27.261988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1132/2301] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:44:27.265182 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5a419-e068-4fc0-b37e-e2df5383d0b7 service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:27.267801 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-9bc5a419-e068-4fc0-b37e-e2df5383d0b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:27.268957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-11c68f52-165c-4b78-bb3d-1aa666acf045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4f875e707ce45b5a775aa4c267e78e9'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:27.283977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-11c68f52-165c-4b78-bb3d-1aa666acf045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4f875e707ce45b5a775aa4c267e78e9'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:27.288070 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5a419-e068-4fc0-b37e-e2df5383d0b7 service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:27.295437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef49f1-e0f6-42e5-b145-7f9c083bedd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:27.296768 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef49f1-e0f6-42e5-b145-7f9c083bedd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:27.297114 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef49f1-e0f6-42e5-b145-7f9c083bedd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:27.297378 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef49f1-e0f6-42e5-b145-7f9c083bedd4 admin admin] PATH_INFO: `/v3/projects/6ddfbd56d0ee4fae9b2d118e8b687726` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:27.298681 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef49f1-e0f6-42e5-b145-7f9c083bedd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ddfbd56d0ee4fae9b2d118e8b687726)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:27.300673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef49f1-e0f6-42e5-b145-7f9c083bedd4 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:27.352930 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-11c68f52-165c-4b78-bb3d-1aa666acf045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4f875e707ce45b5a775aa4c267e78e9'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:27.354228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-11c68f52-165c-4b78-bb3d-1aa666acf045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4f875e707ce45b5a775aa4c267e78e9'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:27.365394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-11c68f52-165c-4b78-bb3d-1aa666acf045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4f875e707ce45b5a775aa4c267e78e9'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:27.373568 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1170/2302] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:44:26 2022] DELETE /identity/v3/users/d4f875e707ce45b5a775aa4c267e78e9 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:27.453057 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-61ef49f1-e0f6-42e5-b145-7f9c083bedd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ddfbd56d0ee4fae9b2d118e8b687726', 'request_id': 'req-61ef49f1-e0f6-42e5-b145-7f9c083bedd4'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:27.460720 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-61ef49f1-e0f6-42e5-b145-7f9c083bedd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ddfbd56d0ee4fae9b2d118e8b687726', 'request_id': 'req-61ef49f1-e0f6-42e5-b145-7f9c083bedd4'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:27.468477 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-61ef49f1-e0f6-42e5-b145-7f9c083bedd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ddfbd56d0ee4fae9b2d118e8b687726', 'request_id': 'req-61ef49f1-e0f6-42e5-b145-7f9c083bedd4'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:27.553055 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-61ef49f1-e0f6-42e5-b145-7f9c083bedd4 admin admin] The token cache is being invalidate because project 6ddfbd56d0ee4fae9b2d118e8b687726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:44:27.553439 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-61ef49f1-e0f6-42e5-b145-7f9c083bedd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:27.554497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-61ef49f1-e0f6-42e5-b145-7f9c083bedd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:27.556345 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1133/2303] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:44:27 2022] DELETE /identity/v3/projects/6ddfbd56d0ee4fae9b2d118e8b687726 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:27.561536 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd4487-b56b-4acd-adc6-1c347e9dddf0 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:27.561830 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd4487-b56b-4acd-adc6-1c347e9dddf0 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:27.562113 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd4487-b56b-4acd-adc6-1c347e9dddf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:27.582489 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-9afd4487-b56b-4acd-adc6-1c347e9dddf0 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:27.583832 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-9afd4487-b56b-4acd-adc6-1c347e9dddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:27.674710 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1171/2304] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:27.682507 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d69d04-3a32-4f08-a065-c05cd0acae8d None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:27.684710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d69d04-3a32-4f08-a065-c05cd0acae8d None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:27.684710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d69d04-3a32-4f08-a065-c05cd0acae8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:27.704902 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-17d69d04-3a32-4f08-a065-c05cd0acae8d None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:27.706057 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-17d69d04-3a32-4f08-a065-c05cd0acae8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:27.714756 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1134/2305] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:27.722297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd4487-b56b-4acd-adc6-1c347e9dddf0 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:27.733848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd4487-b56b-4acd-adc6-1c347e9dddf0 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:27.738744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fe7ec-9cfc-48cc-bc09-d4765c50f101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:27.743538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fe7ec-9cfc-48cc-bc09-d4765c50f101 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:27.743538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fe7ec-9cfc-48cc-bc09-d4765c50f101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:27.743538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fe7ec-9cfc-48cc-bc09-d4765c50f101 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:27.743538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fe7ec-9cfc-48cc-bc09-d4765c50f101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:44:27.743538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fe7ec-9cfc-48cc-bc09-d4765c50f101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:27.743538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fe7ec-9cfc-48cc-bc09-d4765c50f101 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:27.765002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1172/2306] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:44:27.769041 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d69d04-3a32-4f08-a065-c05cd0acae8d None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:27.780154 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d69d04-3a32-4f08-a065-c05cd0acae8d None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:27.785399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92f15a-c221-4959-9308-c5c1af07a319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:27.786185 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92f15a-c221-4959-9308-c5c1af07a319 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:27.786540 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92f15a-c221-4959-9308-c5c1af07a319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:27.786879 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92f15a-c221-4959-9308-c5c1af07a319 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:27.787730 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92f15a-c221-4959-9308-c5c1af07a319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:27.789966 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92f15a-c221-4959-9308-c5c1af07a319 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:27.917321 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1135/2307] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:44:27 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:44:27.923502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fe7ec-9cfc-48cc-bc09-d4765c50f101 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:27.934739 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fe7ec-9cfc-48cc-bc09-d4765c50f101 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:27.990001 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92f15a-c221-4959-9308-c5c1af07a319 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:27.991985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ae92f15a-c221-4959-9308-c5c1af07a319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:28.024192 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b771387-dac3-4342-84f0-dc3a59ec2440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:28.025390 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b771387-dac3-4342-84f0-dc3a59ec2440 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:28.025525 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b771387-dac3-4342-84f0-dc3a59ec2440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:28.025826 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b771387-dac3-4342-84f0-dc3a59ec2440 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:28.026783 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b771387-dac3-4342-84f0-dc3a59ec2440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:28.030536 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b771387-dac3-4342-84f0-dc3a59ec2440 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:28.081780 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92f15a-c221-4959-9308-c5c1af07a319 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:28.092807 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c22a1e-f833-4587-b9f0-14280da599ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:28.093720 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c22a1e-f833-4587-b9f0-14280da599ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:28.094015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c22a1e-f833-4587-b9f0-14280da599ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:28.094298 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c22a1e-f833-4587-b9f0-14280da599ec admin admin] PATH_INFO: `/v3/projects/9c0c475e2de24361ba42726fdd5e32d8` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:28.099417 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c22a1e-f833-4587-b9f0-14280da599ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c0c475e2de24361ba42726fdd5e32d8)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:28.101943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c22a1e-f833-4587-b9f0-14280da599ec admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:28.111844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1173/2308] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:44:27 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:44:28.114877 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b771387-dac3-4342-84f0-dc3a59ec2440 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:28.145267 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b771387-dac3-4342-84f0-dc3a59ec2440 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:28.160363 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331194a-5505-4799-9654-9ac1cce43513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:28.164216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331194a-5505-4799-9654-9ac1cce43513 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:28.164216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331194a-5505-4799-9654-9ac1cce43513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:28.164216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331194a-5505-4799-9654-9ac1cce43513 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:28.164216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331194a-5505-4799-9654-9ac1cce43513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:28.164216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331194a-5505-4799-9654-9ac1cce43513 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:28.175156 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1174/2309] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:44:28.179522 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331194a-5505-4799-9654-9ac1cce43513 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:28.205727 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331194a-5505-4799-9654-9ac1cce43513 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:28.222177 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777d627-522d-41ae-b00a-6b5b543a0930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:28.222904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777d627-522d-41ae-b00a-6b5b543a0930 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:28.223314 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777d627-522d-41ae-b00a-6b5b543a0930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:28.223557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777d627-522d-41ae-b00a-6b5b543a0930 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:28.224329 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777d627-522d-41ae-b00a-6b5b543a0930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:28.226014 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777d627-522d-41ae-b00a-6b5b543a0930 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:28.250006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1175/2310] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:44:28.254088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777d627-522d-41ae-b00a-6b5b543a0930 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:28.256116 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-21c22a1e-f833-4587-b9f0-14280da599ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c0c475e2de24361ba42726fdd5e32d8', 'request_id': 'req-21c22a1e-f833-4587-b9f0-14280da599ec'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:28.269421 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-21c22a1e-f833-4587-b9f0-14280da599ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c0c475e2de24361ba42726fdd5e32d8', 'request_id': 'req-21c22a1e-f833-4587-b9f0-14280da599ec'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:28.273620 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777d627-522d-41ae-b00a-6b5b543a0930 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:28.279341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-21c22a1e-f833-4587-b9f0-14280da599ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c0c475e2de24361ba42726fdd5e32d8', 'request_id': 'req-21c22a1e-f833-4587-b9f0-14280da599ec'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:28.334291 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4666122-2c07-4fd9-9333-e77963d95a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:28.335220 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4666122-2c07-4fd9-9333-e77963d95a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:28.335583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4666122-2c07-4fd9-9333-e77963d95a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:28.335869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4666122-2c07-4fd9-9333-e77963d95a5d admin admin] PATH_INFO: `/v3/projects/6fb903185eb24e7ab9aa4be1aceb69a1/users/6ab07185794f48e5b90af952aef8ef0a/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:28.351851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4666122-2c07-4fd9-9333-e77963d95a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb903185eb24e7ab9aa4be1aceb69a1, user_id=6ab07185794f48e5b90af952aef8ef0a, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:28.354620 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4666122-2c07-4fd9-9333-e77963d95a5d admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:28.397586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-21c22a1e-f833-4587-b9f0-14280da599ec admin admin] The token cache is being invalidate because project 9c0c475e2de24361ba42726fdd5e32d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:44:28.398232 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-21c22a1e-f833-4587-b9f0-14280da599ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:28.399159 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-21c22a1e-f833-4587-b9f0-14280da599ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:28.400856 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1136/2311] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:44:27 2022] DELETE /identity/v3/projects/9c0c475e2de24361ba42726fdd5e32d8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:44:28.405490 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3cc4a-572f-4689-a47d-02b427b9b18d None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:28.405785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3cc4a-572f-4689-a47d-02b427b9b18d None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:28.406067 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3cc4a-572f-4689-a47d-02b427b9b18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:28.424796 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-39e3cc4a-572f-4689-a47d-02b427b9b18d None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:28.426026 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-39e3cc4a-572f-4689-a47d-02b427b9b18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:28.441529 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1137/2312] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:44:28.446450 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e694540-8d8c-467c-90a5-869780ea4c89 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:28.446450 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e694540-8d8c-467c-90a5-869780ea4c89 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:28.446450 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e694540-8d8c-467c-90a5-869780ea4c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:28.448742 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1176/2313] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:44:28 2022] PUT /identity/v3/projects/6fb903185eb24e7ab9aa4be1aceb69a1/users/6ab07185794f48e5b90af952aef8ef0a/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:28.459884 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc1ae1-99dc-47bb-8035-13345ec0af36 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:28.460244 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc1ae1-99dc-47bb-8035-13345ec0af36 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:28.460594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc1ae1-99dc-47bb-8035-13345ec0af36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:28.465271 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-2e694540-8d8c-467c-90a5-869780ea4c89 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:28.466829 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2e694540-8d8c-467c-90a5-869780ea4c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:28.490331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-a1bc1ae1-99dc-47bb-8035-13345ec0af36 None None] MFA Rules not processed for user `6ab07185794f48e5b90af952aef8ef0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:28.491555 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a1bc1ae1-99dc-47bb-8035-13345ec0af36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:28.570059 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1138/2314] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:28.571201 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e694540-8d8c-467c-90a5-869780ea4c89 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:28.581071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1177/2315] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:28.582775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e694540-8d8c-467c-90a5-869780ea4c89 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:28.594572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc1ae1-99dc-47bb-8035-13345ec0af36 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:28.604217 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a1bc1ae1-99dc-47bb-8035-13345ec0af36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:28.609722 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f4cc4-b1df-4306-9817-ba5fe078f1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:28.610430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f4cc4-b1df-4306-9817-ba5fe078f1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:28.610777 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f4cc4-b1df-4306-9817-ba5fe078f1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:28.611131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f4cc4-b1df-4306-9817-ba5fe078f1a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:28.611927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f4cc4-b1df-4306-9817-ba5fe078f1a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:44:28.612235 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f4cc4-b1df-4306-9817-ba5fe078f1a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:28.613858 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f4cc4-b1df-4306-9817-ba5fe078f1a6 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:28.631058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1139/2316] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:44:28.635727 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f4cc4-b1df-4306-9817-ba5fe078f1a6 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:28.648410 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f4cc4-b1df-4306-9817-ba5fe078f1a6 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:28.653949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695d73e-692a-48b3-91fd-803063bba04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:28.654748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695d73e-692a-48b3-91fd-803063bba04c admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:28.655332 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695d73e-692a-48b3-91fd-803063bba04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:28.655455 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695d73e-692a-48b3-91fd-803063bba04c admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:28.656122 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695d73e-692a-48b3-91fd-803063bba04c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:28.658142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695d73e-692a-48b3-91fd-803063bba04c admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:28.666265 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc1ae1-99dc-47bb-8035-13345ec0af36 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:28.673047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab5e4f-7a2e-47fd-a53d-36e1327fcf7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:28.674025 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab5e4f-7a2e-47fd-a53d-36e1327fcf7c service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:28.674385 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab5e4f-7a2e-47fd-a53d-36e1327fcf7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:28.674756 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab5e4f-7a2e-47fd-a53d-36e1327fcf7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:28.687254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab5e4f-7a2e-47fd-a53d-36e1327fcf7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:28.688795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab5e4f-7a2e-47fd-a53d-36e1327fcf7c service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:28.715553 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1178/2317] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:28.738799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab5e4f-7a2e-47fd-a53d-36e1327fcf7c service cinder] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:28.740332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-16ab5e4f-7a2e-47fd-a53d-36e1327fcf7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:28.749364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1140/2318] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:44:28 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:44:28.754176 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695d73e-692a-48b3-91fd-803063bba04c admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:28.762651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab5e4f-7a2e-47fd-a53d-36e1327fcf7c service cinder] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:28.878739 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c518cb-8c12-4e1d-8b6b-8f5f94407c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:28.879588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c518cb-8c12-4e1d-8b6b-8f5f94407c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:28.879872 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c518cb-8c12-4e1d-8b6b-8f5f94407c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:28.880421 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c518cb-8c12-4e1d-8b6b-8f5f94407c15 admin admin] PATH_INFO: `/v3/users/6ab07185794f48e5b90af952aef8ef0a` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:28.881696 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c518cb-8c12-4e1d-8b6b-8f5f94407c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab07185794f48e5b90af952aef8ef0a)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:28.883355 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695d73e-692a-48b3-91fd-803063bba04c admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:28.883685 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c518cb-8c12-4e1d-8b6b-8f5f94407c15 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:28.892889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b72b9-5b34-437d-a216-f641fc7108eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:28.892889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b72b9-5b34-437d-a216-f641fc7108eb admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:28.892889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b72b9-5b34-437d-a216-f641fc7108eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:28.892889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b72b9-5b34-437d-a216-f641fc7108eb admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:28.893304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b72b9-5b34-437d-a216-f641fc7108eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:28.894524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b72b9-5b34-437d-a216-f641fc7108eb admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:28.975402 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1141/2319] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:44:28 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:44:28.979981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b72b9-5b34-437d-a216-f641fc7108eb admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:28.991673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b72b9-5b34-437d-a216-f641fc7108eb admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:28.996500 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a094be-f2cd-40ed-93dc-f62fea5336fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:29.001900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a094be-f2cd-40ed-93dc-f62fea5336fe admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:29.001900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a094be-f2cd-40ed-93dc-f62fea5336fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:29.001900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a094be-f2cd-40ed-93dc-f62fea5336fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:29.001900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a094be-f2cd-40ed-93dc-f62fea5336fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:29.001900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a094be-f2cd-40ed-93dc-f62fea5336fe admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:29.011834 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1142/2320] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:44:29.015585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a094be-f2cd-40ed-93dc-f62fea5336fe admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:29.025604 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a094be-f2cd-40ed-93dc-f62fea5336fe admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:29.030977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f284779-52ed-4b58-a561-643c366c563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:29.031647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f284779-52ed-4b58-a561-643c366c563e admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:29.031932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f284779-52ed-4b58-a561-643c366c563e admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:29.032207 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f284779-52ed-4b58-a561-643c366c563e admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:29.033131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f284779-52ed-4b58-a561-643c366c563e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:29.035070 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f284779-52ed-4b58-a561-643c366c563e admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:29.049368 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1143/2321] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:44:29.053615 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f284779-52ed-4b58-a561-643c366c563e admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:29.063874 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f284779-52ed-4b58-a561-643c366c563e admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:29.070158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89ddb0-e714-4b98-85c4-f24981457cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:29.071093 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89ddb0-e714-4b98-85c4-f24981457cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:29.071415 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89ddb0-e714-4b98-85c4-f24981457cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:29.071697 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89ddb0-e714-4b98-85c4-f24981457cc4 admin admin] PATH_INFO: `/v3/projects/5f936b59fa1a45018fc6a41348602089/users/212889cc70394bc2801a6170e6d4ddaa/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:29.087257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89ddb0-e714-4b98-85c4-f24981457cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f936b59fa1a45018fc6a41348602089, user_id=212889cc70394bc2801a6170e6d4ddaa, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:29.089971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89ddb0-e714-4b98-85c4-f24981457cc4 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:29.113611 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-70c518cb-8c12-4e1d-8b6b-8f5f94407c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab07185794f48e5b90af952aef8ef0a'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:29.125680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-70c518cb-8c12-4e1d-8b6b-8f5f94407c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab07185794f48e5b90af952aef8ef0a'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:29.165137 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1144/2322] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:44:29 2022] PUT /identity/v3/projects/5f936b59fa1a45018fc6a41348602089/users/212889cc70394bc2801a6170e6d4ddaa/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:44:29.179007 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138654e0-0d3c-45b4-a271-6bc905aa7fc4 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:29.179329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138654e0-0d3c-45b4-a271-6bc905aa7fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:29.179662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138654e0-0d3c-45b4-a271-6bc905aa7fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:29.223315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-138654e0-0d3c-45b4-a271-6bc905aa7fc4 None None] MFA Rules not processed for user `212889cc70394bc2801a6170e6d4ddaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:29.224889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-138654e0-0d3c-45b4-a271-6bc905aa7fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:29.232747 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-70c518cb-8c12-4e1d-8b6b-8f5f94407c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab07185794f48e5b90af952aef8ef0a'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:29.233268 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:29.233708 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-70c518cb-8c12-4e1d-8b6b-8f5f94407c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab07185794f48e5b90af952aef8ef0a'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:29.254648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-70c518cb-8c12-4e1d-8b6b-8f5f94407c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab07185794f48e5b90af952aef8ef0a'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:29.264352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1179/2323] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:44:28 2022] DELETE /identity/v3/users/6ab07185794f48e5b90af952aef8ef0a => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:44:29.267967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fada673-cbf9-4926-a171-343aafa2f331 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:29.268462 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fada673-cbf9-4926-a171-343aafa2f331 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:29.268802 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fada673-cbf9-4926-a171-343aafa2f331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:29.295001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-7fada673-cbf9-4926-a171-343aafa2f331 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:29.297243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7fada673-cbf9-4926-a171-343aafa2f331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:29.335633 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1145/2324] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:29.350710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138654e0-0d3c-45b4-a271-6bc905aa7fc4 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:29.355694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-138654e0-0d3c-45b4-a271-6bc905aa7fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:29.407853 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1180/2325] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:44:29.424487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fada673-cbf9-4926-a171-343aafa2f331 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:29.425794 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7fada673-cbf9-4926-a171-343aafa2f331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:29.438801 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138654e0-0d3c-45b4-a271-6bc905aa7fc4 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:29.445679 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c5e87-b5a4-4f77-b017-8a0a23878c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:29.446357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c5e87-b5a4-4f77-b017-8a0a23878c44 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:29.446603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c5e87-b5a4-4f77-b017-8a0a23878c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:29.446889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c5e87-b5a4-4f77-b017-8a0a23878c44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:29.447639 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c5e87-b5a4-4f77-b017-8a0a23878c44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:29.449841 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c5e87-b5a4-4f77-b017-8a0a23878c44 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:29.495569 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fada673-cbf9-4926-a171-343aafa2f331 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:29.500171 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14510d6d-fc00-4299-a8db-4c05335f915c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:29.500831 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14510d6d-fc00-4299-a8db-4c05335f915c service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:29.501118 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14510d6d-fc00-4299-a8db-4c05335f915c service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:29.501395 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14510d6d-fc00-4299-a8db-4c05335f915c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:29.512034 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14510d6d-fc00-4299-a8db-4c05335f915c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:29.514972 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14510d6d-fc00-4299-a8db-4c05335f915c service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:29.528314 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1181/2326] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:29.529074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1146/2327] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:44:29 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:44:29.530717 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14510d6d-fc00-4299-a8db-4c05335f915c service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:29.542524 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14510d6d-fc00-4299-a8db-4c05335f915c service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:29.615645 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0dfb4b-238e-40c1-bef1-cdb346544909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:29.616628 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dfb4b-238e-40c1-bef1-cdb346544909 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:29.616917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dfb4b-238e-40c1-bef1-cdb346544909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:29.617195 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dfb4b-238e-40c1-bef1-cdb346544909 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:29.617945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0dfb4b-238e-40c1-bef1-cdb346544909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:29.620139 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0dfb4b-238e-40c1-bef1-cdb346544909 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:29.723335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:29.730666 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1182/2328] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:44:29 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:44:29.735877 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c5e87-b5a4-4f77-b017-8a0a23878c44 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:29.746856 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c5e87-b5a4-4f77-b017-8a0a23878c44 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:29.752603 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93323bd0-b57b-4a0c-8562-265145b074b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:29.753237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93323bd0-b57b-4a0c-8562-265145b074b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:29.753573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93323bd0-b57b-4a0c-8562-265145b074b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:29.753855 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93323bd0-b57b-4a0c-8562-265145b074b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:29.755466 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93323bd0-b57b-4a0c-8562-265145b074b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:29.757127 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93323bd0-b57b-4a0c-8562-265145b074b5 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:29.769977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1147/2329] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:44:29.774224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0dfb4b-238e-40c1-bef1-cdb346544909 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:29.790371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0dfb4b-238e-40c1-bef1-cdb346544909 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:29.798295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe328609-d6a8-4c6c-9311-cbf0b944a430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:29.800674 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe328609-d6a8-4c6c-9311-cbf0b944a430 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:29.801305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe328609-d6a8-4c6c-9311-cbf0b944a430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:29.802176 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe328609-d6a8-4c6c-9311-cbf0b944a430 admin admin] PATH_INFO: `/v3/projects/6a7f5f1e03b34fa8bd1282e9472b3e30/users/22703f484c6640198b6c3e316cec28dd/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:29.821316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe328609-d6a8-4c6c-9311-cbf0b944a430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7f5f1e03b34fa8bd1282e9472b3e30, user_id=22703f484c6640198b6c3e316cec28dd, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:29.824472 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe328609-d6a8-4c6c-9311-cbf0b944a430 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:29.909010 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1183/2330] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:44:29 2022] PUT /identity/v3/projects/6a7f5f1e03b34fa8bd1282e9472b3e30/users/22703f484c6640198b6c3e316cec28dd/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:44:29.913220 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93323bd0-b57b-4a0c-8562-265145b074b5 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:29.939127 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93323bd0-b57b-4a0c-8562-265145b074b5 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:30.017687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957aac2-23fe-47f3-87b0-275573522b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:30.018547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957aac2-23fe-47f3-87b0-275573522b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:30.018837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957aac2-23fe-47f3-87b0-275573522b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:30.019116 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957aac2-23fe-47f3-87b0-275573522b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:30.020829 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957aac2-23fe-47f3-87b0-275573522b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:30.022464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957aac2-23fe-47f3-87b0-275573522b76 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:30.041849 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1148/2331] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:44:30.046800 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe328609-d6a8-4c6c-9311-cbf0b944a430 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:30.069826 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe328609-d6a8-4c6c-9311-cbf0b944a430 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:30.076545 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fc036-f0a3-4c45-b580-d54ba0356c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:30.076545 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fc036-f0a3-4c45-b580-d54ba0356c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:30.076545 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fc036-f0a3-4c45-b580-d54ba0356c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:30.076545 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fc036-f0a3-4c45-b580-d54ba0356c37 admin admin] PATH_INFO: `/v3/projects/6a7f5f1e03b34fa8bd1282e9472b3e30/users/22703f484c6640198b6c3e316cec28dd/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:30.078622 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fc036-f0a3-4c45-b580-d54ba0356c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7f5f1e03b34fa8bd1282e9472b3e30, user_id=22703f484c6640198b6c3e316cec28dd, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:30.078760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957aac2-23fe-47f3-87b0-275573522b76 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:30.080908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0957aac2-23fe-47f3-87b0-275573522b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:30.082122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fc036-f0a3-4c45-b580-d54ba0356c37 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:30.096145 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1184/2332] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:44:30 2022] PUT /identity/v3/projects/6a7f5f1e03b34fa8bd1282e9472b3e30/users/22703f484c6640198b6c3e316cec28dd/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:44:30.109449 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5ff95-b6fd-410b-b348-756944e94d9e None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:30.109832 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5ff95-b6fd-410b-b348-756944e94d9e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:30.110187 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5ff95-b6fd-410b-b348-756944e94d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:30.118082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957aac2-23fe-47f3-87b0-275573522b76 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:30.149873 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-ecc5ff95-b6fd-410b-b348-756944e94d9e None None] MFA Rules not processed for user `22703f484c6640198b6c3e316cec28dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:30.151316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ecc5ff95-b6fd-410b-b348-756944e94d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:30.204150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73891959-f270-4db5-a99d-32bc37e0447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:30.205374 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73891959-f270-4db5-a99d-32bc37e0447f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:30.205921 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73891959-f270-4db5-a99d-32bc37e0447f admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:30.206393 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73891959-f270-4db5-a99d-32bc37e0447f admin admin] PATH_INFO: `/v3/projects/6fb903185eb24e7ab9aa4be1aceb69a1` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:30.207946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73891959-f270-4db5-a99d-32bc37e0447f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb903185eb24e7ab9aa4be1aceb69a1)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:30.210692 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73891959-f270-4db5-a99d-32bc37e0447f admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:30.251470 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1185/2333] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:30.263986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5ff95-b6fd-410b-b348-756944e94d9e None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:30.266092 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ecc5ff95-b6fd-410b-b348-756944e94d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:30.361444 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5ff95-b6fd-410b-b348-756944e94d9e None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:30.376384 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-73891959-f270-4db5-a99d-32bc37e0447f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb903185eb24e7ab9aa4be1aceb69a1', 'request_id': 'req-73891959-f270-4db5-a99d-32bc37e0447f'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:30.382224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-73891959-f270-4db5-a99d-32bc37e0447f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb903185eb24e7ab9aa4be1aceb69a1', 'request_id': 'req-73891959-f270-4db5-a99d-32bc37e0447f'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:30.390432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-73891959-f270-4db5-a99d-32bc37e0447f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb903185eb24e7ab9aa4be1aceb69a1', 'request_id': 'req-73891959-f270-4db5-a99d-32bc37e0447f'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:30.415523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13eef1-c238-46e4-b503-0f0396dc9ff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:30.416274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13eef1-c238-46e4-b503-0f0396dc9ff5 service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:30.416630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13eef1-c238-46e4-b503-0f0396dc9ff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:30.416971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13eef1-c238-46e4-b503-0f0396dc9ff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:30.493678 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13eef1-c238-46e4-b503-0f0396dc9ff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:30.495255 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13eef1-c238-46e4-b503-0f0396dc9ff5 service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:30.507460 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1186/2334] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:44:30.508933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327b744-cf44-4755-a506-f853fc21e492 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:30.509226 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327b744-cf44-4755-a506-f853fc21e492 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:30.509505 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327b744-cf44-4755-a506-f853fc21e492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:30.534146 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-73891959-f270-4db5-a99d-32bc37e0447f admin admin] The token cache is being invalidate because project 6fb903185eb24e7ab9aa4be1aceb69a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:44:30.534530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-73891959-f270-4db5-a99d-32bc37e0447f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:30.538403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-73891959-f270-4db5-a99d-32bc37e0447f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:30.539493 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-3327b744-cf44-4755-a506-f853fc21e492 None None] MFA Rules not processed for user `d691506a2d8a43cf831d0265f85e9651`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:30.540287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1149/2335] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:44:30 2022] DELETE /identity/v3/projects/6fb903185eb24e7ab9aa4be1aceb69a1 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:30.544442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-3327b744-cf44-4755-a506-f853fc21e492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:30.704488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:30.761634 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1187/2336] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:30.945811 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:31.660605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:31.741274 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:32.088470 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:32.249631 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:32.429908 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:36.012309 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73891959-f270-4db5-a99d-32bc37e0447f admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:36.012309 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-73891959-f270-4db5-a99d-32bc37e0447f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:36.023220 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73891959-f270-4db5-a99d-32bc37e0447f admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:36.026997 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49443967-5abc-4cd8-8a88-ab01e4097ac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:36.027685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49443967-5abc-4cd8-8a88-ab01e4097ac3 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:36.027971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49443967-5abc-4cd8-8a88-ab01e4097ac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:36.028254 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49443967-5abc-4cd8-8a88-ab01e4097ac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:36.030163 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-49443967-5abc-4cd8-8a88-ab01e4097ac3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:36.086858 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:36.129336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49443967-5abc-4cd8-8a88-ab01e4097ac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:36.132115 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49443967-5abc-4cd8-8a88-ab01e4097ac3 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:36.150454 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1150/2337] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:42.802328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=39 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:43.853318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327b744-cf44-4755-a506-f853fc21e492 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:43.855589 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-3327b744-cf44-4755-a506-f853fc21e492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:43.937786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327b744-cf44-4755-a506-f853fc21e492 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:43.943235 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e33ba5-e90d-4843-bc9f-2beab91d154e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a3704fdba154f13ad3bf8ac00c916c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:43.944033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e33ba5-e90d-4843-bc9f-2beab91d154e service placement] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:43.944330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e33ba5-e90d-4843-bc9f-2beab91d154e service placement] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:43.944609 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e33ba5-e90d-4843-bc9f-2beab91d154e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:43.946435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-96e33ba5-e90d-4843-bc9f-2beab91d154e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:43.960791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e33ba5-e90d-4843-bc9f-2beab91d154e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:43.962491 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e33ba5-e90d-4843-bc9f-2beab91d154e service placement] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:43.975820 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1188/2338] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:46.219654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=8 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:50.905950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49443967-5abc-4cd8-8a88-ab01e4097ac3 service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:50.907728 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-49443967-5abc-4cd8-8a88-ab01e4097ac3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:50.970866 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49443967-5abc-4cd8-8a88-ab01e4097ac3 service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:50.974528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e60f4b-cd1d-40c3-b3ca-e01880b50bf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:50.975188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e60f4b-cd1d-40c3-b3ca-e01880b50bf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:50.979426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e60f4b-cd1d-40c3-b3ca-e01880b50bf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:50.979426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e60f4b-cd1d-40c3-b3ca-e01880b50bf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:50.979426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-c7e60f4b-cd1d-40c3-b3ca-e01880b50bf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:51.047724 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e60f4b-cd1d-40c3-b3ca-e01880b50bf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:51.050034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e60f4b-cd1d-40c3-b3ca-e01880b50bf7 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:51.060231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1151/2339] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:52.214450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e33ba5-e90d-4843-bc9f-2beab91d154e service placement] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:52.216081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-96e33ba5-e90d-4843-bc9f-2beab91d154e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:52.296171 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e33ba5-e90d-4843-bc9f-2beab91d154e service placement] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:52.301035 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a74bdc-3ce3-45d4-845d-bc4dcb3e7d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:52.301922 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a74bdc-3ce3-45d4-845d-bc4dcb3e7d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:52.302346 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a74bdc-3ce3-45d4-845d-bc4dcb3e7d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:52.302633 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a74bdc-3ce3-45d4-845d-bc4dcb3e7d4d admin admin] PATH_INFO: `/v3/users/212889cc70394bc2801a6170e6d4ddaa` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:52.303890 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a74bdc-3ce3-45d4-845d-bc4dcb3e7d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=212889cc70394bc2801a6170e6d4ddaa)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:52.305871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a74bdc-3ce3-45d4-845d-bc4dcb3e7d4d admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:52.484961 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f2a74bdc-3ce3-45d4-845d-bc4dcb3e7d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '212889cc70394bc2801a6170e6d4ddaa'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:52.501437 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f2a74bdc-3ce3-45d4-845d-bc4dcb3e7d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '212889cc70394bc2801a6170e6d4ddaa'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:52.585349 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f2a74bdc-3ce3-45d4-845d-bc4dcb3e7d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '212889cc70394bc2801a6170e6d4ddaa'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:52.586076 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f2a74bdc-3ce3-45d4-845d-bc4dcb3e7d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '212889cc70394bc2801a6170e6d4ddaa'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:52.595135 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f2a74bdc-3ce3-45d4-845d-bc4dcb3e7d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '212889cc70394bc2801a6170e6d4ddaa'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:52.621234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1189/2340] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:44:52 2022] DELETE /identity/v3/users/212889cc70394bc2801a6170e6d4ddaa => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:52.625884 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dbfa0-32b8-4ec6-9e61-98cc6a4eb93b None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:52.626736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dbfa0-32b8-4ec6-9e61-98cc6a4eb93b None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:52.627716 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dbfa0-32b8-4ec6-9e61-98cc6a4eb93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:52.646109 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-333dbfa0-32b8-4ec6-9e61-98cc6a4eb93b None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:52.647514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-333dbfa0-32b8-4ec6-9e61-98cc6a4eb93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:52.728639 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1152/2341] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:52.739568 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a74bdc-3ce3-45d4-845d-bc4dcb3e7d4d admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:52.746856 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f2a74bdc-3ce3-45d4-845d-bc4dcb3e7d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:52.753432 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:52.801661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a74bdc-3ce3-45d4-845d-bc4dcb3e7d4d admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:52.805334 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a214cc-507a-477d-8530-6377cd8b98ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:52.805983 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a214cc-507a-477d-8530-6377cd8b98ae service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:52.806262 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a214cc-507a-477d-8530-6377cd8b98ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:52.806538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a214cc-507a-477d-8530-6377cd8b98ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:52.816777 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a214cc-507a-477d-8530-6377cd8b98ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:52.818205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a214cc-507a-477d-8530-6377cd8b98ae service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:52.827931 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1190/2342] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:53.649432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dbfa0-32b8-4ec6-9e61-98cc6a4eb93b None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:53.651120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-333dbfa0-32b8-4ec6-9e61-98cc6a4eb93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:53.666570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dbfa0-32b8-4ec6-9e61-98cc6a4eb93b None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:53.671592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c0092-5689-4e6e-ac66-9275d17a328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:53.675305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c0092-5689-4e6e-ac66-9275d17a328c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:53.675305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c0092-5689-4e6e-ac66-9275d17a328c admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:53.675305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c0092-5689-4e6e-ac66-9275d17a328c admin admin] PATH_INFO: `/v3/projects/5f936b59fa1a45018fc6a41348602089` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:53.675305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c0092-5689-4e6e-ac66-9275d17a328c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f936b59fa1a45018fc6a41348602089)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:53.677220 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c0092-5689-4e6e-ac66-9275d17a328c admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:53.833151 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:53.838139 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-4b5c0092-5689-4e6e-ac66-9275d17a328c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f936b59fa1a45018fc6a41348602089', 'request_id': 'req-4b5c0092-5689-4e6e-ac66-9275d17a328c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:53.846936 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-4b5c0092-5689-4e6e-ac66-9275d17a328c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f936b59fa1a45018fc6a41348602089', 'request_id': 'req-4b5c0092-5689-4e6e-ac66-9275d17a328c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:53.856474 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-4b5c0092-5689-4e6e-ac66-9275d17a328c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f936b59fa1a45018fc6a41348602089', 'request_id': 'req-4b5c0092-5689-4e6e-ac66-9275d17a328c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:53.959294 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-4b5c0092-5689-4e6e-ac66-9275d17a328c admin admin] The token cache is being invalidate because project 5f936b59fa1a45018fc6a41348602089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:44:53.959742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-4b5c0092-5689-4e6e-ac66-9275d17a328c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:53.960430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-4b5c0092-5689-4e6e-ac66-9275d17a328c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:53.962098 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1153/2343] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:44:53 2022] DELETE /identity/v3/projects/5f936b59fa1a45018fc6a41348602089 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:53.966473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a214cc-507a-477d-8530-6377cd8b98ae service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:53.977711 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a214cc-507a-477d-8530-6377cd8b98ae service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:54.056241 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9c150-e086-4cc0-93dc-9d9155ae8dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:54.057702 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9c150-e086-4cc0-93dc-9d9155ae8dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:54.058457 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9c150-e086-4cc0-93dc-9d9155ae8dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:54.058841 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9c150-e086-4cc0-93dc-9d9155ae8dc4 admin admin] PATH_INFO: `/v3/users/22703f484c6640198b6c3e316cec28dd` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:54.060357 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9c150-e086-4cc0-93dc-9d9155ae8dc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22703f484c6640198b6c3e316cec28dd)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:54.062960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9c150-e086-4cc0-93dc-9d9155ae8dc4 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:54.396745 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-53d9c150-e086-4cc0-93dc-9d9155ae8dc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22703f484c6640198b6c3e316cec28dd'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:54.411179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-53d9c150-e086-4cc0-93dc-9d9155ae8dc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22703f484c6640198b6c3e316cec28dd'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:54.500358 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-53d9c150-e086-4cc0-93dc-9d9155ae8dc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22703f484c6640198b6c3e316cec28dd'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:54.501136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-53d9c150-e086-4cc0-93dc-9d9155ae8dc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22703f484c6640198b6c3e316cec28dd'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:54.512107 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-53d9c150-e086-4cc0-93dc-9d9155ae8dc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22703f484c6640198b6c3e316cec28dd'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:54.519454 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1191/2344] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:44:53 2022] DELETE /identity/v3/users/22703f484c6640198b6c3e316cec28dd => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:55.014936 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c0092-5689-4e6e-ac66-9275d17a328c admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:55.016655 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-4b5c0092-5689-4e6e-ac66-9275d17a328c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:55.030941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c0092-5689-4e6e-ac66-9275d17a328c admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:55.118669 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3339b-42ab-49cd-ad80-06647a6dd72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:55.120010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3339b-42ab-49cd-ad80-06647a6dd72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:55.120568 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3339b-42ab-49cd-ad80-06647a6dd72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:55.120924 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3339b-42ab-49cd-ad80-06647a6dd72c admin admin] PATH_INFO: `/v3/projects/6a7f5f1e03b34fa8bd1282e9472b3e30` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:55.122587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3339b-42ab-49cd-ad80-06647a6dd72c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a7f5f1e03b34fa8bd1282e9472b3e30)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:55.124979 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3339b-42ab-49cd-ad80-06647a6dd72c admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:55.270647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b7d3339b-42ab-49cd-ad80-06647a6dd72c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a7f5f1e03b34fa8bd1282e9472b3e30', 'request_id': 'req-b7d3339b-42ab-49cd-ad80-06647a6dd72c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:55.276834 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b7d3339b-42ab-49cd-ad80-06647a6dd72c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a7f5f1e03b34fa8bd1282e9472b3e30', 'request_id': 'req-b7d3339b-42ab-49cd-ad80-06647a6dd72c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:55.283931 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b7d3339b-42ab-49cd-ad80-06647a6dd72c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a7f5f1e03b34fa8bd1282e9472b3e30', 'request_id': 'req-b7d3339b-42ab-49cd-ad80-06647a6dd72c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:55.376343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b7d3339b-42ab-49cd-ad80-06647a6dd72c admin admin] The token cache is being invalidate because project 6a7f5f1e03b34fa8bd1282e9472b3e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:44:55.376343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b7d3339b-42ab-49cd-ad80-06647a6dd72c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:55.377402 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b7d3339b-42ab-49cd-ad80-06647a6dd72c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:55.379004 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1154/2345] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:44:55 2022] DELETE /identity/v3/projects/6a7f5f1e03b34fa8bd1282e9472b3e30 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:55.384628 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5b18f-ebf8-4cbb-8077-3d45da5ad649 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:55.385147 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5b18f-ebf8-4cbb-8077-3d45da5ad649 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:55.385273 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5b18f-ebf8-4cbb-8077-3d45da5ad649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:55.406064 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-29d5b18f-ebf8-4cbb-8077-3d45da5ad649 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:55.407660 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-29d5b18f-ebf8-4cbb-8077-3d45da5ad649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:55.455769 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:55.511968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1192/2346] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:44:55.522329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee49ac6-497b-4d58-8ff8-ae2e5e6b8ce1 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:55.522329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee49ac6-497b-4d58-8ff8-ae2e5e6b8ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:55.522788 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee49ac6-497b-4d58-8ff8-ae2e5e6b8ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:55.564106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-7ee49ac6-497b-4d58-8ff8-ae2e5e6b8ce1 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:55.564106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-7ee49ac6-497b-4d58-8ff8-ae2e5e6b8ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:55.573508 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1155/2347] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:55.577984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5b18f-ebf8-4cbb-8077-3d45da5ad649 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:55.589990 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5b18f-ebf8-4cbb-8077-3d45da5ad649 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:55.595068 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88508c-b00a-43e1-9937-9654685c3b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:55.596009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88508c-b00a-43e1-9937-9654685c3b58 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:55.596309 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88508c-b00a-43e1-9937-9654685c3b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:55.596727 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88508c-b00a-43e1-9937-9654685c3b58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:55.598179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88508c-b00a-43e1-9937-9654685c3b58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:44:55.598588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88508c-b00a-43e1-9937-9654685c3b58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:55.600852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88508c-b00a-43e1-9937-9654685c3b58 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:55.618124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1193/2348] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:44:55.623080 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee49ac6-497b-4d58-8ff8-ae2e5e6b8ce1 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:55.639075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee49ac6-497b-4d58-8ff8-ae2e5e6b8ce1 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:55.645849 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41d6a9-6d1f-4ce6-9ba5-1f0f41389136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:55.646575 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41d6a9-6d1f-4ce6-9ba5-1f0f41389136 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:55.646946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41d6a9-6d1f-4ce6-9ba5-1f0f41389136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:55.647380 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41d6a9-6d1f-4ce6-9ba5-1f0f41389136 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:55.648259 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41d6a9-6d1f-4ce6-9ba5-1f0f41389136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:55.651000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41d6a9-6d1f-4ce6-9ba5-1f0f41389136 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:56.613973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1156/2349] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:44:55 2022] POST /identity/v3/projects => generated 381 bytes in 991 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:44:56.618306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88508c-b00a-43e1-9937-9654685c3b58 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:56.630710 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88508c-b00a-43e1-9937-9654685c3b58 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:56.700410 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c61c53-086e-4aba-bebe-7995a8748eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:56.701122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c61c53-086e-4aba-bebe-7995a8748eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:56.701443 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c61c53-086e-4aba-bebe-7995a8748eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:56.701688 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c61c53-086e-4aba-bebe-7995a8748eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:56.702552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c61c53-086e-4aba-bebe-7995a8748eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:56.704384 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c61c53-086e-4aba-bebe-7995a8748eb6 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:56.810930 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1194/2350] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:44:56 2022] POST /identity/v3/users => generated 291 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:44:56.815780 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41d6a9-6d1f-4ce6-9ba5-1f0f41389136 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:56.826677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41d6a9-6d1f-4ce6-9ba5-1f0f41389136 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:56.836114 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec2d61-b0c9-4b35-a6c9-a1908e115245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:56.836851 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec2d61-b0c9-4b35-a6c9-a1908e115245 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:56.841038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec2d61-b0c9-4b35-a6c9-a1908e115245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:56.841353 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec2d61-b0c9-4b35-a6c9-a1908e115245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:56.842638 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec2d61-b0c9-4b35-a6c9-a1908e115245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:56.844615 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec2d61-b0c9-4b35-a6c9-a1908e115245 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:56.868395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1157/2351] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:44:56.872405 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c61c53-086e-4aba-bebe-7995a8748eb6 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:56.883500 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c61c53-086e-4aba-bebe-7995a8748eb6 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:56.888377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79894f-ceef-49b6-aa11-7fc08df5957e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:56.893772 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79894f-ceef-49b6-aa11-7fc08df5957e admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:56.893772 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79894f-ceef-49b6-aa11-7fc08df5957e admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:56.893772 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79894f-ceef-49b6-aa11-7fc08df5957e admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:56.893772 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79894f-ceef-49b6-aa11-7fc08df5957e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:56.893772 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79894f-ceef-49b6-aa11-7fc08df5957e admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:56.904845 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1195/2352] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:44:56.909941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec2d61-b0c9-4b35-a6c9-a1908e115245 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:56.920717 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec2d61-b0c9-4b35-a6c9-a1908e115245 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:56.926113 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6e47d-ed70-4fbc-81c3-ce9c79343e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:56.927212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6e47d-ed70-4fbc-81c3-ce9c79343e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:56.934003 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6e47d-ed70-4fbc-81c3-ce9c79343e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:56.934003 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6e47d-ed70-4fbc-81c3-ce9c79343e6b admin admin] PATH_INFO: `/v3/projects/1f66532af43f4fff88592b3f4ab844c1/users/36c8db2bee844a7ab9d4ae00c1a7e611/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:56.943884 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6e47d-ed70-4fbc-81c3-ce9c79343e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f66532af43f4fff88592b3f4ab844c1, user_id=36c8db2bee844a7ab9d4ae00c1a7e611, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:56.946641 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6e47d-ed70-4fbc-81c3-ce9c79343e6b admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:57.068579 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:57.075704 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1158/2353] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:44:56 2022] PUT /identity/v3/projects/1f66532af43f4fff88592b3f4ab844c1/users/36c8db2bee844a7ab9d4ae00c1a7e611/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:57.086905 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbe8b0-7cad-4661-8493-fb13351e937f None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:57.087121 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbe8b0-7cad-4661-8493-fb13351e937f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:57.087373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbe8b0-7cad-4661-8493-fb13351e937f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:57.121601 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-bbdbe8b0-7cad-4661-8493-fb13351e937f None None] MFA Rules not processed for user `36c8db2bee844a7ab9d4ae00c1a7e611`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:57.127484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-bbdbe8b0-7cad-4661-8493-fb13351e937f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:57.198693 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1196/2354] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:44:57.202104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6e47d-ed70-4fbc-81c3-ce9c79343e6b admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:57.269894 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6e47d-ed70-4fbc-81c3-ce9c79343e6b admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:57.274806 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98736e-7e77-4635-973a-2edf90f691fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:57.280999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98736e-7e77-4635-973a-2edf90f691fc admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:57.280999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98736e-7e77-4635-973a-2edf90f691fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:57.280999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98736e-7e77-4635-973a-2edf90f691fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:57.280999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98736e-7e77-4635-973a-2edf90f691fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:57.280999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98736e-7e77-4635-973a-2edf90f691fc admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:57.363105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1159/2355] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:44:57 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:44:57.364191 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbe8b0-7cad-4661-8493-fb13351e937f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:57.375870 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbe8b0-7cad-4661-8493-fb13351e937f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:57.404628 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:57.444336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282b793-4d9b-4b9e-9abd-63202f11b7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:57.445017 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282b793-4d9b-4b9e-9abd-63202f11b7e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:57.445303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282b793-4d9b-4b9e-9abd-63202f11b7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:57.445582 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282b793-4d9b-4b9e-9abd-63202f11b7e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:57.446313 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282b793-4d9b-4b9e-9abd-63202f11b7e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:57.448312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282b793-4d9b-4b9e-9abd-63202f11b7e7 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:57.570826 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1197/2356] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:44:57 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:44:57.578973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98736e-7e77-4635-973a-2edf90f691fc admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:57.600822 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98736e-7e77-4635-973a-2edf90f691fc admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:57.612414 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfab1f-7da5-4eae-8ee7-0425f8d72185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:57.613225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfab1f-7da5-4eae-8ee7-0425f8d72185 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:57.613445 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfab1f-7da5-4eae-8ee7-0425f8d72185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:57.613722 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfab1f-7da5-4eae-8ee7-0425f8d72185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:57.614489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfab1f-7da5-4eae-8ee7-0425f8d72185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:57.616177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfab1f-7da5-4eae-8ee7-0425f8d72185 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:57.631419 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1160/2357] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:44:57.632535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282b793-4d9b-4b9e-9abd-63202f11b7e7 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:57.644284 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282b793-4d9b-4b9e-9abd-63202f11b7e7 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:57.649258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fd224-3e07-4729-9416-126580cc45b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:57.650185 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fd224-3e07-4729-9416-126580cc45b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:57.650513 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fd224-3e07-4729-9416-126580cc45b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:57.650791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fd224-3e07-4729-9416-126580cc45b4 admin admin] PATH_INFO: `/v3/projects/5a5c73d460ef450e8fc6f9b10d29f179/users/fc1645cae6784ee39b308f201fb4ceeb/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:57.672830 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fd224-3e07-4729-9416-126580cc45b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5c73d460ef450e8fc6f9b10d29f179, user_id=fc1645cae6784ee39b308f201fb4ceeb, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:57.677001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fd224-3e07-4729-9416-126580cc45b4 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:57.797599 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1198/2358] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:44:57 2022] PUT /identity/v3/projects/5a5c73d460ef450e8fc6f9b10d29f179/users/fc1645cae6784ee39b308f201fb4ceeb/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:57.803544 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfab1f-7da5-4eae-8ee7-0425f8d72185 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:57.816026 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfab1f-7da5-4eae-8ee7-0425f8d72185 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:57.926499 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9474da1-e494-4b98-93a4-d605de782c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:57.929346 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9474da1-e494-4b98-93a4-d605de782c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:57.931111 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9474da1-e494-4b98-93a4-d605de782c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:57.931684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9474da1-e494-4b98-93a4-d605de782c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:57.933826 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9474da1-e494-4b98-93a4-d605de782c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:57.940355 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9474da1-e494-4b98-93a4-d605de782c98 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:57.974845 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1161/2359] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:44:57.980764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fd224-3e07-4729-9416-126580cc45b4 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:57.992737 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fd224-3e07-4729-9416-126580cc45b4 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:57.998922 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe676aa-37a3-495f-bb71-12ce0787b631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:57.999866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe676aa-37a3-495f-bb71-12ce0787b631 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:58.000301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe676aa-37a3-495f-bb71-12ce0787b631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:58.000587 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe676aa-37a3-495f-bb71-12ce0787b631 admin admin] PATH_INFO: `/v3/projects/5a5c73d460ef450e8fc6f9b10d29f179/users/fc1645cae6784ee39b308f201fb4ceeb/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:58.003759 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe676aa-37a3-495f-bb71-12ce0787b631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5c73d460ef450e8fc6f9b10d29f179, user_id=fc1645cae6784ee39b308f201fb4ceeb, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:58.006355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe676aa-37a3-495f-bb71-12ce0787b631 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:58.026341 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1199/2360] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:44:57 2022] PUT /identity/v3/projects/5a5c73d460ef450e8fc6f9b10d29f179/users/fc1645cae6784ee39b308f201fb4ceeb/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:58.035773 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd2aef-732a-43bf-a4e0-f3b3bfd545be None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:58.036045 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd2aef-732a-43bf-a4e0-f3b3bfd545be None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:58.036332 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd2aef-732a-43bf-a4e0-f3b3bfd545be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:58.070332 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-5ddd2aef-732a-43bf-a4e0-f3b3bfd545be None None] MFA Rules not processed for user `fc1645cae6784ee39b308f201fb4ceeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:58.071588 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5ddd2aef-732a-43bf-a4e0-f3b3bfd545be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:58.160349 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:58.171698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1162/2361] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:44:58.185095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe676aa-37a3-495f-bb71-12ce0787b631 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:58.187884 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-2fe676aa-37a3-495f-bb71-12ce0787b631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:58.284134 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe676aa-37a3-495f-bb71-12ce0787b631 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:58.289467 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b4221-df7d-495b-9d15-1312b972893f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:58.290140 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b4221-df7d-495b-9d15-1312b972893f service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:58.290424 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b4221-df7d-495b-9d15-1312b972893f service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:58.291432 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b4221-df7d-495b-9d15-1312b972893f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:58.312092 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b4221-df7d-495b-9d15-1312b972893f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:58.313566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b4221-df7d-495b-9d15-1312b972893f service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:58.326506 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1200/2362] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:58.479039 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd2aef-732a-43bf-a4e0-f3b3bfd545be None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:58.497341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd2aef-732a-43bf-a4e0-f3b3bfd545be None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:58.504385 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08381e93-600f-4497-ae5a-da50f2994ada service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:58.507101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08381e93-600f-4497-ae5a-da50f2994ada service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:58.507943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08381e93-600f-4497-ae5a-da50f2994ada service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:58.508468 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08381e93-600f-4497-ae5a-da50f2994ada service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:58.637505 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08381e93-600f-4497-ae5a-da50f2994ada service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:58.639524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08381e93-600f-4497-ae5a-da50f2994ada service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:58.654752 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1163/2363] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:44:59.275944 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b4221-df7d-495b-9d15-1312b972893f service cinder] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:59.339857 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b4221-df7d-495b-9d15-1312b972893f service cinder] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:59.344407 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aba6d3-769b-4cc5-97ab-ac10effbe7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:59.345278 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aba6d3-769b-4cc5-97ab-ac10effbe7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:59.345616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aba6d3-769b-4cc5-97ab-ac10effbe7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:59.346531 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aba6d3-769b-4cc5-97ab-ac10effbe7af admin admin] PATH_INFO: `/v3/users/36c8db2bee844a7ab9d4ae00c1a7e611` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:59.347779 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aba6d3-769b-4cc5-97ab-ac10effbe7af admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c8db2bee844a7ab9d4ae00c1a7e611)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:44:59.349721 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aba6d3-769b-4cc5-97ab-ac10effbe7af admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:44:59.374881 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:44:59.591332 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f5aba6d3-769b-4cc5-97ab-ac10effbe7af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c8db2bee844a7ab9d4ae00c1a7e611'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:59.604220 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f5aba6d3-769b-4cc5-97ab-ac10effbe7af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c8db2bee844a7ab9d4ae00c1a7e611'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:59.690699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f5aba6d3-769b-4cc5-97ab-ac10effbe7af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c8db2bee844a7ab9d4ae00c1a7e611'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:59.691494 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f5aba6d3-769b-4cc5-97ab-ac10effbe7af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c8db2bee844a7ab9d4ae00c1a7e611'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:59.702528 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f5aba6d3-769b-4cc5-97ab-ac10effbe7af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c8db2bee844a7ab9d4ae00c1a7e611'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:44:59.716483 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1201/2364] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:44:59 2022] DELETE /identity/v3/users/36c8db2bee844a7ab9d4ae00c1a7e611 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:44:59.720840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e799f-b245-4c1f-994b-34b8c9d15d2f None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:59.721370 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e799f-b245-4c1f-994b-34b8c9d15d2f None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:59.721524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e799f-b245-4c1f-994b-34b8c9d15d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:44:59.756082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-129e799f-b245-4c1f-994b-34b8c9d15d2f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:44:59.757735 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-129e799f-b245-4c1f-994b-34b8c9d15d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:59.892538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1164/2365] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:44:59.905119 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aba6d3-769b-4cc5-97ab-ac10effbe7af admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:44:59.906751 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f5aba6d3-769b-4cc5-97ab-ac10effbe7af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:44:59.988203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aba6d3-769b-4cc5-97ab-ac10effbe7af admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:44:59.993093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c7b93-f73f-49d2-a53b-e105b74a89cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:44:59.994019 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c7b93-f73f-49d2-a53b-e105b74a89cf service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:44:59.994382 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c7b93-f73f-49d2-a53b-e105b74a89cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:44:59.994868 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c7b93-f73f-49d2-a53b-e105b74a89cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:00.011422 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c7b93-f73f-49d2-a53b-e105b74a89cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:00.013189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c7b93-f73f-49d2-a53b-e105b74a89cf service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:00.025136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1202/2366] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:45:00.544369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e799f-b245-4c1f-994b-34b8c9d15d2f None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:00.546139 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-129e799f-b245-4c1f-994b-34b8c9d15d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:00.560798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e799f-b245-4c1f-994b-34b8c9d15d2f None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:00.568059 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1feeba-1829-4eab-a91f-6aaa49200d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:00.568943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1feeba-1829-4eab-a91f-6aaa49200d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:00.569232 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1feeba-1829-4eab-a91f-6aaa49200d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:00.569516 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1feeba-1829-4eab-a91f-6aaa49200d2e admin admin] PATH_INFO: `/v3/projects/1f66532af43f4fff88592b3f4ab844c1` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:00.578459 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1feeba-1829-4eab-a91f-6aaa49200d2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f66532af43f4fff88592b3f4ab844c1)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:00.580453 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1feeba-1829-4eab-a91f-6aaa49200d2e admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:00.704184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-cf1feeba-1829-4eab-a91f-6aaa49200d2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f66532af43f4fff88592b3f4ab844c1', 'request_id': 'req-cf1feeba-1829-4eab-a91f-6aaa49200d2e'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:00.711466 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-cf1feeba-1829-4eab-a91f-6aaa49200d2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f66532af43f4fff88592b3f4ab844c1', 'request_id': 'req-cf1feeba-1829-4eab-a91f-6aaa49200d2e'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:00.718466 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-cf1feeba-1829-4eab-a91f-6aaa49200d2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f66532af43f4fff88592b3f4ab844c1', 'request_id': 'req-cf1feeba-1829-4eab-a91f-6aaa49200d2e'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:00.796700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-cf1feeba-1829-4eab-a91f-6aaa49200d2e admin admin] The token cache is being invalidate because project 1f66532af43f4fff88592b3f4ab844c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:45:00.797374 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-cf1feeba-1829-4eab-a91f-6aaa49200d2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:00.799748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-cf1feeba-1829-4eab-a91f-6aaa49200d2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:00.804635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1165/2367] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:45:00 2022] DELETE /identity/v3/projects/1f66532af43f4fff88592b3f4ab844c1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:45:00.805715 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c7b93-f73f-49d2-a53b-e105b74a89cf service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:00.821431 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c7b93-f73f-49d2-a53b-e105b74a89cf service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:00.898894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d5f27-fd77-4fe4-8915-bc51d23c0a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:00.899810 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d5f27-fd77-4fe4-8915-bc51d23c0a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:00.900091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d5f27-fd77-4fe4-8915-bc51d23c0a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:00.900369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d5f27-fd77-4fe4-8915-bc51d23c0a30 admin admin] PATH_INFO: `/v3/users/fc1645cae6784ee39b308f201fb4ceeb` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:00.901980 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d5f27-fd77-4fe4-8915-bc51d23c0a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc1645cae6784ee39b308f201fb4ceeb)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:00.904222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d5f27-fd77-4fe4-8915-bc51d23c0a30 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:01.133188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:01.135228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-2b6d5f27-fd77-4fe4-8915-bc51d23c0a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc1645cae6784ee39b308f201fb4ceeb'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:01.160003 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-2b6d5f27-fd77-4fe4-8915-bc51d23c0a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc1645cae6784ee39b308f201fb4ceeb'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:01.254325 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-2b6d5f27-fd77-4fe4-8915-bc51d23c0a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc1645cae6784ee39b308f201fb4ceeb'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:01.260440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-2b6d5f27-fd77-4fe4-8915-bc51d23c0a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc1645cae6784ee39b308f201fb4ceeb'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:01.274248 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-2b6d5f27-fd77-4fe4-8915-bc51d23c0a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc1645cae6784ee39b308f201fb4ceeb'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:01.288392 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1203/2368] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:45:00 2022] DELETE /identity/v3/users/fc1645cae6784ee39b308f201fb4ceeb => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:45:01.741365 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1feeba-1829-4eab-a91f-6aaa49200d2e admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:01.742793 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-cf1feeba-1829-4eab-a91f-6aaa49200d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:01.758592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1feeba-1829-4eab-a91f-6aaa49200d2e admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:01.771910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:01.819845 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decaea5-1b47-46e3-86ef-a2fdb6b995eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:01.820719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decaea5-1b47-46e3-86ef-a2fdb6b995eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:01.821009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decaea5-1b47-46e3-86ef-a2fdb6b995eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:01.821293 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decaea5-1b47-46e3-86ef-a2fdb6b995eb admin admin] PATH_INFO: `/v3/projects/5a5c73d460ef450e8fc6f9b10d29f179` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:01.822524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decaea5-1b47-46e3-86ef-a2fdb6b995eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a5c73d460ef450e8fc6f9b10d29f179)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:01.824478 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decaea5-1b47-46e3-86ef-a2fdb6b995eb admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:01.945188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9decaea5-1b47-46e3-86ef-a2fdb6b995eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a5c73d460ef450e8fc6f9b10d29f179', 'request_id': 'req-9decaea5-1b47-46e3-86ef-a2fdb6b995eb'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:01.951814 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9decaea5-1b47-46e3-86ef-a2fdb6b995eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a5c73d460ef450e8fc6f9b10d29f179', 'request_id': 'req-9decaea5-1b47-46e3-86ef-a2fdb6b995eb'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:01.958796 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9decaea5-1b47-46e3-86ef-a2fdb6b995eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a5c73d460ef450e8fc6f9b10d29f179', 'request_id': 'req-9decaea5-1b47-46e3-86ef-a2fdb6b995eb'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:02.019449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9decaea5-1b47-46e3-86ef-a2fdb6b995eb admin admin] The token cache is being invalidate because project 5a5c73d460ef450e8fc6f9b10d29f179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:45:02.019847 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9decaea5-1b47-46e3-86ef-a2fdb6b995eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:02.020369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9decaea5-1b47-46e3-86ef-a2fdb6b995eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:02.021917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1166/2369] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:45:01 2022] DELETE /identity/v3/projects/5a5c73d460ef450e8fc6f9b10d29f179 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:45:02.026990 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0d7dd-63ad-43f5-8340-39cc8b346e8a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:02.027483 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0d7dd-63ad-43f5-8340-39cc8b346e8a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:02.027601 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0d7dd-63ad-43f5-8340-39cc8b346e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:02.046216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-29f0d7dd-63ad-43f5-8340-39cc8b346e8a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:02.047458 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-29f0d7dd-63ad-43f5-8340-39cc8b346e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:02.107164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1204/2370] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:45:02.116798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63741a29-8e80-4b48-b1c6-f6cb8a9df9cf None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:02.117112 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63741a29-8e80-4b48-b1c6-f6cb8a9df9cf None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:02.117394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63741a29-8e80-4b48-b1c6-f6cb8a9df9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:02.135676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-63741a29-8e80-4b48-b1c6-f6cb8a9df9cf None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:02.137182 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-63741a29-8e80-4b48-b1c6-f6cb8a9df9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:02.145495 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1167/2371] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:02.149774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0d7dd-63ad-43f5-8340-39cc8b346e8a None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:02.160868 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0d7dd-63ad-43f5-8340-39cc8b346e8a None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:02.165806 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b960c99-c2b5-4c48-a334-5c971b88231f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:02.166473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b960c99-c2b5-4c48-a334-5c971b88231f admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:02.166761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b960c99-c2b5-4c48-a334-5c971b88231f admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:02.167071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b960c99-c2b5-4c48-a334-5c971b88231f admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:02.167855 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b960c99-c2b5-4c48-a334-5c971b88231f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:45:02.168170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b960c99-c2b5-4c48-a334-5c971b88231f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:02.169775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b960c99-c2b5-4c48-a334-5c971b88231f admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:02.182568 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1205/2372] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:45:02.187283 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63741a29-8e80-4b48-b1c6-f6cb8a9df9cf None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:02.196402 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63741a29-8e80-4b48-b1c6-f6cb8a9df9cf None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:02.201139 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6e15b-4240-4c20-9f7d-f1c539d189d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:02.201790 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6e15b-4240-4c20-9f7d-f1c539d189d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:02.202073 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6e15b-4240-4c20-9f7d-f1c539d189d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:02.202351 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6e15b-4240-4c20-9f7d-f1c539d189d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:02.203039 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6e15b-4240-4c20-9f7d-f1c539d189d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:02.205107 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6e15b-4240-4c20-9f7d-f1c539d189d0 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:02.339457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1168/2373] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:45:02 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:45:02.341300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b960c99-c2b5-4c48-a334-5c971b88231f admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:02.352615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b960c99-c2b5-4c48-a334-5c971b88231f admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:02.415297 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065372c-f53a-4fa9-91e1-284fa9efbab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:02.415980 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065372c-f53a-4fa9-91e1-284fa9efbab3 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:02.416282 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065372c-f53a-4fa9-91e1-284fa9efbab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:02.416560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065372c-f53a-4fa9-91e1-284fa9efbab3 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:02.417279 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065372c-f53a-4fa9-91e1-284fa9efbab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:02.419205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065372c-f53a-4fa9-91e1-284fa9efbab3 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:02.517008 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1206/2374] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:45:02 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:45:02.521923 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6e15b-4240-4c20-9f7d-f1c539d189d0 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:02.533938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6e15b-4240-4c20-9f7d-f1c539d189d0 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:02.539180 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e9724-8821-4706-881c-87c9a87e4b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:02.539938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e9724-8821-4706-881c-87c9a87e4b83 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:02.540313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e9724-8821-4706-881c-87c9a87e4b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:02.541958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e9724-8821-4706-881c-87c9a87e4b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:02.542332 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e9724-8821-4706-881c-87c9a87e4b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:02.544954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e9724-8821-4706-881c-87c9a87e4b83 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:02.561941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065372c-f53a-4fa9-91e1-284fa9efbab3 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:02.563023 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1169/2375] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:45:02.575224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065372c-f53a-4fa9-91e1-284fa9efbab3 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:02.580780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4a4be-11c8-4058-b047-31985a405acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:02.581573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4a4be-11c8-4058-b047-31985a405acb admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:02.581914 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4a4be-11c8-4058-b047-31985a405acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:02.582195 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4a4be-11c8-4058-b047-31985a405acb admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:02.582925 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4a4be-11c8-4058-b047-31985a405acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:02.584548 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4a4be-11c8-4058-b047-31985a405acb admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:02.595163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1207/2376] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:45:02.600227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e9724-8821-4706-881c-87c9a87e4b83 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:02.610683 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e9724-8821-4706-881c-87c9a87e4b83 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:02.615897 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2615b-069f-42ff-a258-5c4738584b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:02.616840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2615b-069f-42ff-a258-5c4738584b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:02.617151 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2615b-069f-42ff-a258-5c4738584b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:02.617430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2615b-069f-42ff-a258-5c4738584b61 admin admin] PATH_INFO: `/v3/projects/b8ea0993186c4298b6310541123215a9/users/5142f1fe2e854157a9bd06359ff3ba48/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:02.633750 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2615b-069f-42ff-a258-5c4738584b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ea0993186c4298b6310541123215a9, user_id=5142f1fe2e854157a9bd06359ff3ba48, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:02.637042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2615b-069f-42ff-a258-5c4738584b61 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:02.717538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1170/2377] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:45:02 2022] PUT /identity/v3/projects/b8ea0993186c4298b6310541123215a9/users/5142f1fe2e854157a9bd06359ff3ba48/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:45:02.727901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68004144-15a6-4a6f-9dd6-e0c95cbd4529 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:02.728190 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68004144-15a6-4a6f-9dd6-e0c95cbd4529 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:02.728474 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68004144-15a6-4a6f-9dd6-e0c95cbd4529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:02.758053 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-68004144-15a6-4a6f-9dd6-e0c95cbd4529 None None] MFA Rules not processed for user `5142f1fe2e854157a9bd06359ff3ba48`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:02.759717 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-68004144-15a6-4a6f-9dd6-e0c95cbd4529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:02.777814 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:02.825372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1208/2378] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:45:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:02.836966 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2615b-069f-42ff-a258-5c4738584b61 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:02.839994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-22f2615b-069f-42ff-a258-5c4738584b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:02.890406 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:02.901806 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2615b-069f-42ff-a258-5c4738584b61 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:02.905489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c648d-7b70-49fb-a7b3-cda1040fc8d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:02.906140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c648d-7b70-49fb-a7b3-cda1040fc8d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:02.906424 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c648d-7b70-49fb-a7b3-cda1040fc8d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:02.906701 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c648d-7b70-49fb-a7b3-cda1040fc8d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:02.916307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c648d-7b70-49fb-a7b3-cda1040fc8d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:02.917824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c648d-7b70-49fb-a7b3-cda1040fc8d0 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:02.927631 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1171/2379] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:45:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:45:05.817295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa0d24-cb55-4375-b24e-e4fde511bf5f None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:05.817745 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa0d24-cb55-4375-b24e-e4fde511bf5f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:05.817842 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa0d24-cb55-4375-b24e-e4fde511bf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:05.839220 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-a7fa0d24-cb55-4375-b24e-e4fde511bf5f None None] MFA Rules not processed for user `87fcc3fa1cbe4afeaa0e455f2631411a`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:05.840833 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a7fa0d24-cb55-4375-b24e-e4fde511bf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:05.911411 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1209/2380] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:45:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:45:08.438784 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c648d-7b70-49fb-a7b3-cda1040fc8d0 service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:08.440394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-7e0c648d-7b70-49fb-a7b3-cda1040fc8d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:08.515848 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c648d-7b70-49fb-a7b3-cda1040fc8d0 service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:08.533415 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6399d-ad4a-4ebc-ba11-fc083f95e80b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:08.536030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6399d-ad4a-4ebc-ba11-fc083f95e80b service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:08.536585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6399d-ad4a-4ebc-ba11-fc083f95e80b service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:08.537111 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6399d-ad4a-4ebc-ba11-fc083f95e80b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:08.539924 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-99a6399d-ad4a-4ebc-ba11-fc083f95e80b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:08.615473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6399d-ad4a-4ebc-ba11-fc083f95e80b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:08.619995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6399d-ad4a-4ebc-ba11-fc083f95e80b service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:08.632167 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1172/2381] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:45:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:45:11.451340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa0d24-cb55-4375-b24e-e4fde511bf5f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:11.529906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa0d24-cb55-4375-b24e-e4fde511bf5f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:11.535162 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b16d24-54eb-4793-b425-8b157c902208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:11.536093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b16d24-54eb-4793-b425-8b157c902208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:11.536372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b16d24-54eb-4793-b425-8b157c902208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:11.536697 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b16d24-54eb-4793-b425-8b157c902208 admin admin] PATH_INFO: `/v3/users/5142f1fe2e854157a9bd06359ff3ba48` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:11.537966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b16d24-54eb-4793-b425-8b157c902208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5142f1fe2e854157a9bd06359ff3ba48)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:11.539943 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b16d24-54eb-4793-b425-8b157c902208 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:11.714433 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-e6b16d24-54eb-4793-b425-8b157c902208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5142f1fe2e854157a9bd06359ff3ba48'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:11.727570 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-e6b16d24-54eb-4793-b425-8b157c902208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5142f1fe2e854157a9bd06359ff3ba48'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:11.729470 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:11.837048 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-e6b16d24-54eb-4793-b425-8b157c902208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5142f1fe2e854157a9bd06359ff3ba48'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:11.837701 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-e6b16d24-54eb-4793-b425-8b157c902208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5142f1fe2e854157a9bd06359ff3ba48'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:11.845636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-e6b16d24-54eb-4793-b425-8b157c902208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5142f1fe2e854157a9bd06359ff3ba48'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:11.856187 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1210/2382] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:45:11 2022] DELETE /identity/v3/users/5142f1fe2e854157a9bd06359ff3ba48 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:45:11.857482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8a86f-3a8d-400d-aa34-075939c66dd4 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:11.857956 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8a86f-3a8d-400d-aa34-075939c66dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:11.858049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8a86f-3a8d-400d-aa34-075939c66dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:11.894661 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-16e8a86f-3a8d-400d-aa34-075939c66dd4 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:11.901954 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-16e8a86f-3a8d-400d-aa34-075939c66dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:11.979215 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1173/2383] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:45:11.997387 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b16d24-54eb-4793-b425-8b157c902208 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:11.999207 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e6b16d24-54eb-4793-b425-8b157c902208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:12.099320 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b16d24-54eb-4793-b425-8b157c902208 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:12.103905 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff58f39-b9de-48b1-8897-07bb71ecca8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:12.104814 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff58f39-b9de-48b1-8897-07bb71ecca8f service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:12.105238 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff58f39-b9de-48b1-8897-07bb71ecca8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:12.105583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff58f39-b9de-48b1-8897-07bb71ecca8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:12.139540 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff58f39-b9de-48b1-8897-07bb71ecca8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:12.145956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff58f39-b9de-48b1-8897-07bb71ecca8f service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:12.165934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1211/2384] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:45:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:45:13.124578 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8a86f-3a8d-400d-aa34-075939c66dd4 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:13.126174 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-16e8a86f-3a8d-400d-aa34-075939c66dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:13.139122 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8a86f-3a8d-400d-aa34-075939c66dd4 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:13.147713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b219f9-d420-4388-8f18-5b7f2e536a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:13.149035 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b219f9-d420-4388-8f18-5b7f2e536a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:13.149338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b219f9-d420-4388-8f18-5b7f2e536a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:13.149671 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b219f9-d420-4388-8f18-5b7f2e536a6c admin admin] PATH_INFO: `/v3/projects/b8ea0993186c4298b6310541123215a9` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:13.151217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b219f9-d420-4388-8f18-5b7f2e536a6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ea0993186c4298b6310541123215a9)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:13.153671 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b219f9-d420-4388-8f18-5b7f2e536a6c admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:13.250046 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:13.274314 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b2b219f9-d420-4388-8f18-5b7f2e536a6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ea0993186c4298b6310541123215a9', 'request_id': 'req-b2b219f9-d420-4388-8f18-5b7f2e536a6c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:13.278451 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b2b219f9-d420-4388-8f18-5b7f2e536a6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ea0993186c4298b6310541123215a9', 'request_id': 'req-b2b219f9-d420-4388-8f18-5b7f2e536a6c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:13.287674 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b2b219f9-d420-4388-8f18-5b7f2e536a6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ea0993186c4298b6310541123215a9', 'request_id': 'req-b2b219f9-d420-4388-8f18-5b7f2e536a6c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:13.398850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b2b219f9-d420-4388-8f18-5b7f2e536a6c admin admin] The token cache is being invalidate because project b8ea0993186c4298b6310541123215a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:45:13.399148 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b2b219f9-d420-4388-8f18-5b7f2e536a6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:13.399841 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b2b219f9-d420-4388-8f18-5b7f2e536a6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:13.406916 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760f5a8-99d6-4ac0-b5da-bf53bf9c71c2 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:13.407465 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760f5a8-99d6-4ac0-b5da-bf53bf9c71c2 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:13.407639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760f5a8-99d6-4ac0-b5da-bf53bf9c71c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:13.409554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1174/2385] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:45:13 2022] DELETE /identity/v3/projects/b8ea0993186c4298b6310541123215a9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:45:13.427147 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-3760f5a8-99d6-4ac0-b5da-bf53bf9c71c2 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:13.428418 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-3760f5a8-99d6-4ac0-b5da-bf53bf9c71c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:13.500320 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1212/2386] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:13.509457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfede98-3595-4f60-8363-edbc6005c2c8 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:13.509751 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfede98-3595-4f60-8363-edbc6005c2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:13.510038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfede98-3595-4f60-8363-edbc6005c2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:13.530156 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-5cfede98-3595-4f60-8363-edbc6005c2c8 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:13.531422 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5cfede98-3595-4f60-8363-edbc6005c2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:13.540676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1175/2387] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:13.544945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760f5a8-99d6-4ac0-b5da-bf53bf9c71c2 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:13.555331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760f5a8-99d6-4ac0-b5da-bf53bf9c71c2 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:13.560392 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3159be1-6886-4eeb-989f-3e6075191f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:13.561056 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3159be1-6886-4eeb-989f-3e6075191f21 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:13.561344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3159be1-6886-4eeb-989f-3e6075191f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:13.561698 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3159be1-6886-4eeb-989f-3e6075191f21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:13.562536 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3159be1-6886-4eeb-989f-3e6075191f21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:45:13.562855 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3159be1-6886-4eeb-989f-3e6075191f21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:13.564502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3159be1-6886-4eeb-989f-3e6075191f21 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:13.577586 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1213/2388] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:45:13.582471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfede98-3595-4f60-8363-edbc6005c2c8 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:13.592580 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfede98-3595-4f60-8363-edbc6005c2c8 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:13.599328 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28691501-ac0d-436a-8e77-5a30420562ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:13.599631 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28691501-ac0d-436a-8e77-5a30420562ad admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:13.599920 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28691501-ac0d-436a-8e77-5a30420562ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:13.600255 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28691501-ac0d-436a-8e77-5a30420562ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:13.601093 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28691501-ac0d-436a-8e77-5a30420562ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:13.603315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28691501-ac0d-436a-8e77-5a30420562ad admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:13.679312 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1176/2389] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:45:13 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:45:13.681879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3159be1-6886-4eeb-989f-3e6075191f21 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:13.693768 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3159be1-6886-4eeb-989f-3e6075191f21 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:13.768736 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596dc15-71cc-45a6-89fe-27cd427f9085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:13.769587 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596dc15-71cc-45a6-89fe-27cd427f9085 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:13.769874 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596dc15-71cc-45a6-89fe-27cd427f9085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:13.770150 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596dc15-71cc-45a6-89fe-27cd427f9085 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:13.770863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596dc15-71cc-45a6-89fe-27cd427f9085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:13.772945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596dc15-71cc-45a6-89fe-27cd427f9085 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:13.870551 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1214/2390] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:45:13 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:45:13.874600 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28691501-ac0d-436a-8e77-5a30420562ad admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:13.885630 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28691501-ac0d-436a-8e77-5a30420562ad admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:13.890958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1442c-9667-4af8-9fae-578f91477c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:13.898497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1442c-9667-4af8-9fae-578f91477c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:13.898814 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1442c-9667-4af8-9fae-578f91477c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:13.899069 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1442c-9667-4af8-9fae-578f91477c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:13.902311 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1442c-9667-4af8-9fae-578f91477c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:13.902311 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1442c-9667-4af8-9fae-578f91477c09 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:13.919831 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1177/2391] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:45:13.924816 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596dc15-71cc-45a6-89fe-27cd427f9085 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:13.932044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:13.940523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596dc15-71cc-45a6-89fe-27cd427f9085 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:13.945564 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c6d81-38ef-43ab-8ea1-5265036bbed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:13.946236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c6d81-38ef-43ab-8ea1-5265036bbed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:13.947225 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c6d81-38ef-43ab-8ea1-5265036bbed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:13.947225 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c6d81-38ef-43ab-8ea1-5265036bbed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:13.947542 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c6d81-38ef-43ab-8ea1-5265036bbed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:13.949159 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c6d81-38ef-43ab-8ea1-5265036bbed9 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:13.962751 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1215/2392] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:45:13.966871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1442c-9667-4af8-9fae-578f91477c09 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:13.977531 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1442c-9667-4af8-9fae-578f91477c09 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:13.982352 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d6e8f-967b-43c5-b182-9a25c1a89181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:13.983262 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d6e8f-967b-43c5-b182-9a25c1a89181 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:13.983571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d6e8f-967b-43c5-b182-9a25c1a89181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:13.983845 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d6e8f-967b-43c5-b182-9a25c1a89181 admin admin] PATH_INFO: `/v3/projects/a41814924cdb4db2bf5005ff50d85ab7/users/c2c1247d03f844efa991aaf2def8ce8e/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:14.001551 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d6e8f-967b-43c5-b182-9a25c1a89181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41814924cdb4db2bf5005ff50d85ab7, user_id=c2c1247d03f844efa991aaf2def8ce8e, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:14.005459 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d6e8f-967b-43c5-b182-9a25c1a89181 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:14.100938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1178/2393] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:45:13 2022] PUT /identity/v3/projects/a41814924cdb4db2bf5005ff50d85ab7/users/c2c1247d03f844efa991aaf2def8ce8e/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:45:14.116512 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af04d48-ca0b-4607-ab02-be179e974a91 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:14.116808 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af04d48-ca0b-4607-ab02-be179e974a91 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:14.117091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af04d48-ca0b-4607-ab02-be179e974a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:14.149241 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-0af04d48-ca0b-4607-ab02-be179e974a91 None None] MFA Rules not processed for user `c2c1247d03f844efa991aaf2def8ce8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:14.150471 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0af04d48-ca0b-4607-ab02-be179e974a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:14.218377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1216/2394] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:45:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:14.229146 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d6e8f-967b-43c5-b182-9a25c1a89181 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:14.305675 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d6e8f-967b-43c5-b182-9a25c1a89181 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:14.311313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68446854-f4a2-454e-a8c3-edc84cad0264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:14.312177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68446854-f4a2-454e-a8c3-edc84cad0264 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:14.312528 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68446854-f4a2-454e-a8c3-edc84cad0264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:14.317863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68446854-f4a2-454e-a8c3-edc84cad0264 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:14.317863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68446854-f4a2-454e-a8c3-edc84cad0264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:14.317863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68446854-f4a2-454e-a8c3-edc84cad0264 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:14.404186 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1179/2395] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:45:14 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:45:14.407876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af04d48-ca0b-4607-ab02-be179e974a91 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:14.420086 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af04d48-ca0b-4607-ab02-be179e974a91 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:14.482136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553449e-150c-48ba-9e42-96b78812cb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:14.482823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553449e-150c-48ba-9e42-96b78812cb56 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:14.483110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553449e-150c-48ba-9e42-96b78812cb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:14.483430 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553449e-150c-48ba-9e42-96b78812cb56 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:14.484129 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553449e-150c-48ba-9e42-96b78812cb56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:14.486078 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553449e-150c-48ba-9e42-96b78812cb56 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:14.552659 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1217/2396] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:45:14 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:45:14.556480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68446854-f4a2-454e-a8c3-edc84cad0264 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:14.567703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68446854-f4a2-454e-a8c3-edc84cad0264 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:14.573329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b1192-55a3-45d4-b24d-caa5ef243f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:14.574258 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b1192-55a3-45d4-b24d-caa5ef243f54 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:14.574642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b1192-55a3-45d4-b24d-caa5ef243f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:14.574987 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b1192-55a3-45d4-b24d-caa5ef243f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:14.575974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b1192-55a3-45d4-b24d-caa5ef243f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:14.577902 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b1192-55a3-45d4-b24d-caa5ef243f54 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:14.589334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1180/2397] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:45:14.593597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553449e-150c-48ba-9e42-96b78812cb56 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:14.604655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553449e-150c-48ba-9e42-96b78812cb56 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:14.609326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e026205-ee39-4381-bf16-bf3f23692ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:14.610225 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e026205-ee39-4381-bf16-bf3f23692ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:14.610512 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e026205-ee39-4381-bf16-bf3f23692ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:14.610791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e026205-ee39-4381-bf16-bf3f23692ec9 admin admin] PATH_INFO: `/v3/projects/d96ed67bab2a4922a2ba3bfb2546c116/users/7642ecebcc3946a298e221b4fe588ed2/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:14.629769 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e026205-ee39-4381-bf16-bf3f23692ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96ed67bab2a4922a2ba3bfb2546c116, user_id=7642ecebcc3946a298e221b4fe588ed2, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:14.633098 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e026205-ee39-4381-bf16-bf3f23692ec9 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:14.694412 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1218/2398] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:45:14 2022] PUT /identity/v3/projects/d96ed67bab2a4922a2ba3bfb2546c116/users/7642ecebcc3946a298e221b4fe588ed2/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:45:14.698554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b1192-55a3-45d4-b24d-caa5ef243f54 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:14.709021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b1192-55a3-45d4-b24d-caa5ef243f54 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:14.743140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:14.771292 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc95184-a4fe-41b9-a6fd-92153ab8a348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:14.771981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc95184-a4fe-41b9-a6fd-92153ab8a348 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:14.772269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc95184-a4fe-41b9-a6fd-92153ab8a348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:14.772548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc95184-a4fe-41b9-a6fd-92153ab8a348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:14.773298 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc95184-a4fe-41b9-a6fd-92153ab8a348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:14.774903 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc95184-a4fe-41b9-a6fd-92153ab8a348 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:14.785386 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1181/2399] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:45:14.789571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e026205-ee39-4381-bf16-bf3f23692ec9 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:14.800552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e026205-ee39-4381-bf16-bf3f23692ec9 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:14.806002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5a632-3bc9-486c-821c-14ecf712b857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:14.807061 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5a632-3bc9-486c-821c-14ecf712b857 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:14.807384 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5a632-3bc9-486c-821c-14ecf712b857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:14.807671 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5a632-3bc9-486c-821c-14ecf712b857 admin admin] PATH_INFO: `/v3/projects/d96ed67bab2a4922a2ba3bfb2546c116/users/7642ecebcc3946a298e221b4fe588ed2/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:14.809761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5a632-3bc9-486c-821c-14ecf712b857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96ed67bab2a4922a2ba3bfb2546c116, user_id=7642ecebcc3946a298e221b4fe588ed2, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:14.812560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5a632-3bc9-486c-821c-14ecf712b857 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:14.824369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1219/2400] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:45:14 2022] PUT /identity/v3/projects/d96ed67bab2a4922a2ba3bfb2546c116/users/7642ecebcc3946a298e221b4fe588ed2/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:45:14.835524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc12b9-b7f8-464f-af38-4b6767b0cfa3 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:14.835820 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc12b9-b7f8-464f-af38-4b6767b0cfa3 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:14.836219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc12b9-b7f8-464f-af38-4b6767b0cfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:14.872831 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-c4fc12b9-b7f8-464f-af38-4b6767b0cfa3 None None] MFA Rules not processed for user `7642ecebcc3946a298e221b4fe588ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:14.874100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-c4fc12b9-b7f8-464f-af38-4b6767b0cfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:14.947176 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1182/2401] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:45:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:14.958778 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5a632-3bc9-486c-821c-14ecf712b857 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:14.961125 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1ea5a632-3bc9-486c-821c-14ecf712b857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:14.998578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:15.024671 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5a632-3bc9-486c-821c-14ecf712b857 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:15.028355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c0f54-cb73-4697-8310-91a1972aba5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:15.029006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c0f54-cb73-4697-8310-91a1972aba5c service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:15.029290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c0f54-cb73-4697-8310-91a1972aba5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:15.029564 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c0f54-cb73-4697-8310-91a1972aba5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:15.091217 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c0f54-cb73-4697-8310-91a1972aba5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:15.092843 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c0f54-cb73-4697-8310-91a1972aba5c service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:15.104226 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1220/2402] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:45:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:45:19.215509 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc12b9-b7f8-464f-af38-4b6767b0cfa3 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:19.286919 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc12b9-b7f8-464f-af38-4b6767b0cfa3 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:19.292191 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8561327-c1f3-4ec9-bfcd-8ff7b4dba92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:19.293077 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8561327-c1f3-4ec9-bfcd-8ff7b4dba92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:19.293360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8561327-c1f3-4ec9-bfcd-8ff7b4dba92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:19.293633 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8561327-c1f3-4ec9-bfcd-8ff7b4dba92d admin admin] PATH_INFO: `/v3/users/c2c1247d03f844efa991aaf2def8ce8e` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:19.294826 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8561327-c1f3-4ec9-bfcd-8ff7b4dba92d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2c1247d03f844efa991aaf2def8ce8e)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:19.296791 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8561327-c1f3-4ec9-bfcd-8ff7b4dba92d admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:19.525642 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b8561327-c1f3-4ec9-bfcd-8ff7b4dba92d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2c1247d03f844efa991aaf2def8ce8e'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:19.530987 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:19.539710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b8561327-c1f3-4ec9-bfcd-8ff7b4dba92d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2c1247d03f844efa991aaf2def8ce8e'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:19.546949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b8561327-c1f3-4ec9-bfcd-8ff7b4dba92d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2c1247d03f844efa991aaf2def8ce8e'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:19.619798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b8561327-c1f3-4ec9-bfcd-8ff7b4dba92d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2c1247d03f844efa991aaf2def8ce8e'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:19.620460 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b8561327-c1f3-4ec9-bfcd-8ff7b4dba92d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2c1247d03f844efa991aaf2def8ce8e'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:19.627772 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1183/2403] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:45:19 2022] DELETE /identity/v3/users/c2c1247d03f844efa991aaf2def8ce8e => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:45:19.632621 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc716c-6e8e-4663-9ea8-f814f82abdb0 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:19.633121 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc716c-6e8e-4663-9ea8-f814f82abdb0 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:19.633121 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc716c-6e8e-4663-9ea8-f814f82abdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:19.653777 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-f8bc716c-6e8e-4663-9ea8-f814f82abdb0 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:19.655095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f8bc716c-6e8e-4663-9ea8-f814f82abdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:19.729214 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1221/2404] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:19.738905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8561327-c1f3-4ec9-bfcd-8ff7b4dba92d admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:19.740366 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b8561327-c1f3-4ec9-bfcd-8ff7b4dba92d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:19.807878 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8561327-c1f3-4ec9-bfcd-8ff7b4dba92d admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:19.813173 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e3afd-733b-4874-94ac-ddadad38c8bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:19.813867 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e3afd-733b-4874-94ac-ddadad38c8bf service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:19.814132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e3afd-733b-4874-94ac-ddadad38c8bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:19.814411 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e3afd-733b-4874-94ac-ddadad38c8bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:19.824217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e3afd-733b-4874-94ac-ddadad38c8bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:19.825657 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e3afd-733b-4874-94ac-ddadad38c8bf service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:19.835928 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1184/2405] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:45:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:45:20.325062 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc716c-6e8e-4663-9ea8-f814f82abdb0 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:20.326578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f8bc716c-6e8e-4663-9ea8-f814f82abdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:20.341543 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc716c-6e8e-4663-9ea8-f814f82abdb0 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:20.350246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcf3d8-21f0-456a-af75-412813dbb9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:20.351878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcf3d8-21f0-456a-af75-412813dbb9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:20.352480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcf3d8-21f0-456a-af75-412813dbb9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:20.352973 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcf3d8-21f0-456a-af75-412813dbb9b7 admin admin] PATH_INFO: `/v3/projects/a41814924cdb4db2bf5005ff50d85ab7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:20.356039 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcf3d8-21f0-456a-af75-412813dbb9b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41814924cdb4db2bf5005ff50d85ab7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:20.359587 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcf3d8-21f0-456a-af75-412813dbb9b7 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:20.533669 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0fbcf3d8-21f0-456a-af75-412813dbb9b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41814924cdb4db2bf5005ff50d85ab7', 'request_id': 'req-0fbcf3d8-21f0-456a-af75-412813dbb9b7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:20.625100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0fbcf3d8-21f0-456a-af75-412813dbb9b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41814924cdb4db2bf5005ff50d85ab7', 'request_id': 'req-0fbcf3d8-21f0-456a-af75-412813dbb9b7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:20.631423 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0fbcf3d8-21f0-456a-af75-412813dbb9b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41814924cdb4db2bf5005ff50d85ab7', 'request_id': 'req-0fbcf3d8-21f0-456a-af75-412813dbb9b7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:20.643103 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0fbcf3d8-21f0-456a-af75-412813dbb9b7 admin admin] The token cache is being invalidate because project a41814924cdb4db2bf5005ff50d85ab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:45:20.643781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0fbcf3d8-21f0-456a-af75-412813dbb9b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:20.644473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0fbcf3d8-21f0-456a-af75-412813dbb9b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:20.646188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1222/2406] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:45:20 2022] DELETE /identity/v3/projects/a41814924cdb4db2bf5005ff50d85ab7 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:45:20.650026 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e3afd-733b-4874-94ac-ddadad38c8bf service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:20.660275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e3afd-733b-4874-94ac-ddadad38c8bf service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:20.717709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a733c4b-1b87-4356-b00b-b4d79cc7026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:20.718576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a733c4b-1b87-4356-b00b-b4d79cc7026f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:20.718861 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a733c4b-1b87-4356-b00b-b4d79cc7026f admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:20.719142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a733c4b-1b87-4356-b00b-b4d79cc7026f admin admin] PATH_INFO: `/v3/users/7642ecebcc3946a298e221b4fe588ed2` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:20.720395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a733c4b-1b87-4356-b00b-b4d79cc7026f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7642ecebcc3946a298e221b4fe588ed2)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:20.723022 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a733c4b-1b87-4356-b00b-b4d79cc7026f admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:20.891584 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-3a733c4b-1b87-4356-b00b-b4d79cc7026f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7642ecebcc3946a298e221b4fe588ed2'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:20.904858 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-3a733c4b-1b87-4356-b00b-b4d79cc7026f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7642ecebcc3946a298e221b4fe588ed2'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:20.913102 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-3a733c4b-1b87-4356-b00b-b4d79cc7026f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7642ecebcc3946a298e221b4fe588ed2'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:20.915995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:20.991876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-3a733c4b-1b87-4356-b00b-b4d79cc7026f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7642ecebcc3946a298e221b4fe588ed2'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:20.992910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-3a733c4b-1b87-4356-b00b-b4d79cc7026f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7642ecebcc3946a298e221b4fe588ed2'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:21.004359 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1185/2407] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:45:20 2022] DELETE /identity/v3/users/7642ecebcc3946a298e221b4fe588ed2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:45:21.445138 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcf3d8-21f0-456a-af75-412813dbb9b7 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:21.446712 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0fbcf3d8-21f0-456a-af75-412813dbb9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:21.462929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcf3d8-21f0-456a-af75-412813dbb9b7 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:21.471939 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:21.528381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785a347-c76c-45ed-97a4-0c40d6a14c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:21.529253 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785a347-c76c-45ed-97a4-0c40d6a14c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:21.529533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785a347-c76c-45ed-97a4-0c40d6a14c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:21.529812 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785a347-c76c-45ed-97a4-0c40d6a14c61 admin admin] PATH_INFO: `/v3/projects/d96ed67bab2a4922a2ba3bfb2546c116` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:21.531007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785a347-c76c-45ed-97a4-0c40d6a14c61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96ed67bab2a4922a2ba3bfb2546c116)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:21.532997 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785a347-c76c-45ed-97a4-0c40d6a14c61 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:21.700735 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f785a347-c76c-45ed-97a4-0c40d6a14c61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96ed67bab2a4922a2ba3bfb2546c116', 'request_id': 'req-f785a347-c76c-45ed-97a4-0c40d6a14c61'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:21.767822 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f785a347-c76c-45ed-97a4-0c40d6a14c61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96ed67bab2a4922a2ba3bfb2546c116', 'request_id': 'req-f785a347-c76c-45ed-97a4-0c40d6a14c61'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:21.775100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f785a347-c76c-45ed-97a4-0c40d6a14c61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96ed67bab2a4922a2ba3bfb2546c116', 'request_id': 'req-f785a347-c76c-45ed-97a4-0c40d6a14c61'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:21.792884 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f785a347-c76c-45ed-97a4-0c40d6a14c61 admin admin] The token cache is being invalidate because project d96ed67bab2a4922a2ba3bfb2546c116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:45:21.793175 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f785a347-c76c-45ed-97a4-0c40d6a14c61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:21.793831 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f785a347-c76c-45ed-97a4-0c40d6a14c61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:21.795468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1223/2408] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:45:21 2022] DELETE /identity/v3/projects/d96ed67bab2a4922a2ba3bfb2546c116 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:45:21.802324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a69c6e-18f6-4cc8-9041-12146bf10d6e None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:21.802806 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a69c6e-18f6-4cc8-9041-12146bf10d6e None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:21.802890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a69c6e-18f6-4cc8-9041-12146bf10d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:21.822215 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-74a69c6e-18f6-4cc8-9041-12146bf10d6e None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:21.823530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-74a69c6e-18f6-4cc8-9041-12146bf10d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:21.886023 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1186/2409] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:21.956362 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690a4a0-b614-4c86-bb65-b477c42f5bcc None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:21.956651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690a4a0-b614-4c86-bb65-b477c42f5bcc None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:21.957503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690a4a0-b614-4c86-bb65-b477c42f5bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:21.976027 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-9690a4a0-b614-4c86-bb65-b477c42f5bcc None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:21.977220 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-9690a4a0-b614-4c86-bb65-b477c42f5bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:21.985502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1224/2410] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:21.990259 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a69c6e-18f6-4cc8-9041-12146bf10d6e None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:22.000348 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a69c6e-18f6-4cc8-9041-12146bf10d6e None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:22.005465 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb63194-2dd2-45e4-ad3e-8afa05958b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:22.006142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb63194-2dd2-45e4-ad3e-8afa05958b9f admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:22.006421 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb63194-2dd2-45e4-ad3e-8afa05958b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:22.013063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb63194-2dd2-45e4-ad3e-8afa05958b9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:22.013063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb63194-2dd2-45e4-ad3e-8afa05958b9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:45:22.013063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb63194-2dd2-45e4-ad3e-8afa05958b9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:22.013063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb63194-2dd2-45e4-ad3e-8afa05958b9f admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:22.023387 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1187/2411] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:45:22.027927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690a4a0-b614-4c86-bb65-b477c42f5bcc None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:22.038193 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690a4a0-b614-4c86-bb65-b477c42f5bcc None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:22.042878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2e83f-97f8-44bc-b287-00e638563055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:22.043573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e83f-97f8-44bc-b287-00e638563055 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:22.043856 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e83f-97f8-44bc-b287-00e638563055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:22.044132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e83f-97f8-44bc-b287-00e638563055 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:22.044844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2e83f-97f8-44bc-b287-00e638563055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:22.046781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2e83f-97f8-44bc-b287-00e638563055 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:22.137268 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1225/2412] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:45:22 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:45:22.141238 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb63194-2dd2-45e4-ad3e-8afa05958b9f admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:22.152418 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb63194-2dd2-45e4-ad3e-8afa05958b9f admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:22.210547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdac433-0605-4527-8b65-4e6d50d639c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:22.211149 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdac433-0605-4527-8b65-4e6d50d639c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:22.211540 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdac433-0605-4527-8b65-4e6d50d639c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:22.211888 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdac433-0605-4527-8b65-4e6d50d639c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:22.212598 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdac433-0605-4527-8b65-4e6d50d639c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:22.222179 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdac433-0605-4527-8b65-4e6d50d639c1 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:22.305853 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1188/2413] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:45:22 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:45:22.309991 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2e83f-97f8-44bc-b287-00e638563055 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:22.321851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2e83f-97f8-44bc-b287-00e638563055 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:22.326633 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c774364-d3e0-46c6-8a33-a1fbec495a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:22.327319 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c774364-d3e0-46c6-8a33-a1fbec495a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:22.327610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c774364-d3e0-46c6-8a33-a1fbec495a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:22.327889 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c774364-d3e0-46c6-8a33-a1fbec495a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:22.328622 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c774364-d3e0-46c6-8a33-a1fbec495a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:22.330213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c774364-d3e0-46c6-8a33-a1fbec495a27 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:22.341468 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1226/2414] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:45:22.345484 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdac433-0605-4527-8b65-4e6d50d639c1 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:22.355592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdac433-0605-4527-8b65-4e6d50d639c1 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:22.360293 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b441c56-d7f4-42d7-b241-a5fcfd26ebd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:22.360932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b441c56-d7f4-42d7-b241-a5fcfd26ebd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:22.361214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b441c56-d7f4-42d7-b241-a5fcfd26ebd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:22.361489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b441c56-d7f4-42d7-b241-a5fcfd26ebd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:22.362213 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b441c56-d7f4-42d7-b241-a5fcfd26ebd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:22.363925 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b441c56-d7f4-42d7-b241-a5fcfd26ebd8 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:22.373870 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1189/2415] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:45:22.378349 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c774364-d3e0-46c6-8a33-a1fbec495a27 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:22.388941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c774364-d3e0-46c6-8a33-a1fbec495a27 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:22.393601 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52d0bc-d787-4627-ba7d-7b9b7d3d653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:22.395163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52d0bc-d787-4627-ba7d-7b9b7d3d653c admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:22.395487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52d0bc-d787-4627-ba7d-7b9b7d3d653c admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:22.395759 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52d0bc-d787-4627-ba7d-7b9b7d3d653c admin admin] PATH_INFO: `/v3/projects/44961de446554720b84be121cdd96409/users/d6bbe24e9bd8425387494eb5f69f38f1/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:22.410832 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52d0bc-d787-4627-ba7d-7b9b7d3d653c admin admin] RBAC: Authorizing `identity:create_grant(project_id=44961de446554720b84be121cdd96409, user_id=d6bbe24e9bd8425387494eb5f69f38f1, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:22.413791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52d0bc-d787-4627-ba7d-7b9b7d3d653c admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:22.483630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1227/2416] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:45:22 2022] PUT /identity/v3/projects/44961de446554720b84be121cdd96409/users/d6bbe24e9bd8425387494eb5f69f38f1/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:45:22.494149 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3cddd-30f7-42f7-8eb8-148ebef415d7 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:22.494532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3cddd-30f7-42f7-8eb8-148ebef415d7 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:22.494709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3cddd-30f7-42f7-8eb8-148ebef415d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:22.523343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-75a3cddd-30f7-42f7-8eb8-148ebef415d7 None None] MFA Rules not processed for user `d6bbe24e9bd8425387494eb5f69f38f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:22.524482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-75a3cddd-30f7-42f7-8eb8-148ebef415d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:22.579108 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:22.596567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1190/2417] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:45:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:22.607312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52d0bc-d787-4627-ba7d-7b9b7d3d653c admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:22.609178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-bd52d0bc-d787-4627-ba7d-7b9b7d3d653c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:22.652722 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:22.667999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52d0bc-d787-4627-ba7d-7b9b7d3d653c admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:22.671923 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa039b21-5df1-4833-8c07-57e40cb3ab6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:22.672571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa039b21-5df1-4833-8c07-57e40cb3ab6b service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:22.672859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa039b21-5df1-4833-8c07-57e40cb3ab6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:22.673136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa039b21-5df1-4833-8c07-57e40cb3ab6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:22.682809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa039b21-5df1-4833-8c07-57e40cb3ab6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:22.684337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa039b21-5df1-4833-8c07-57e40cb3ab6b service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:22.694088 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1228/2418] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:45:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:45:31.307019 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba848d15-0615-4abc-b606-1d32a4ceae49 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:31.307594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba848d15-0615-4abc-b606-1d32a4ceae49 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:31.307705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba848d15-0615-4abc-b606-1d32a4ceae49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:31.326741 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-ba848d15-0615-4abc-b606-1d32a4ceae49 None None] MFA Rules not processed for user `5ec758ef106b49f4985845b3c106f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:31.327977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ba848d15-0615-4abc-b606-1d32a4ceae49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:31.389169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1191/2419] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Jul 12 14:45:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:31.445429 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa039b21-5df1-4833-8c07-57e40cb3ab6b service cinder] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:31.446894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-aa039b21-5df1-4833-8c07-57e40cb3ab6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:31.521971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa039b21-5df1-4833-8c07-57e40cb3ab6b service cinder] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:31.527189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ad64b-fbfb-4c71-ad81-9fbe7878a1d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad12085f356a4f0682bb70ad231a10b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:31.527908 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ad64b-fbfb-4c71-ad81-9fbe7878a1d8 service swift] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:31.528268 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ad64b-fbfb-4c71-ad81-9fbe7878a1d8 service swift] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:31.528569 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ad64b-fbfb-4c71-ad81-9fbe7878a1d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:31.539326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ad64b-fbfb-4c71-ad81-9fbe7878a1d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:31.541323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ad64b-fbfb-4c71-ad81-9fbe7878a1d8 service swift] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:31.554763 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1229/2420] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Jul 12 14:45:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:45:38.374711 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba848d15-0615-4abc-b606-1d32a4ceae49 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:38.463525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba848d15-0615-4abc-b606-1d32a4ceae49 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:38.472230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cc2d7-02c2-481a-a267-b8cc54079d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:38.474805 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cc2d7-02c2-481a-a267-b8cc54079d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:38.475909 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cc2d7-02c2-481a-a267-b8cc54079d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:38.478414 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cc2d7-02c2-481a-a267-b8cc54079d6e admin admin] PATH_INFO: `/v3/users/d6bbe24e9bd8425387494eb5f69f38f1` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:38.480933 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cc2d7-02c2-481a-a267-b8cc54079d6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6bbe24e9bd8425387494eb5f69f38f1)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:38.483428 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cc2d7-02c2-481a-a267-b8cc54079d6e admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:38.653366 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-674cc2d7-02c2-481a-a267-b8cc54079d6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6bbe24e9bd8425387494eb5f69f38f1'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:38.671349 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-674cc2d7-02c2-481a-a267-b8cc54079d6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6bbe24e9bd8425387494eb5f69f38f1'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:38.682075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-674cc2d7-02c2-481a-a267-b8cc54079d6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6bbe24e9bd8425387494eb5f69f38f1'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:38.710234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c952c-bb6d-4c7d-9639-37cb10106976 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:38.710899 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c952c-bb6d-4c7d-9639-37cb10106976 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:38.710899 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c952c-bb6d-4c7d-9639-37cb10106976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:38.731682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-d25c952c-bb6d-4c7d-9639-37cb10106976 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:38.735630 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-674cc2d7-02c2-481a-a267-b8cc54079d6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6bbe24e9bd8425387494eb5f69f38f1'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:38.736400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-674cc2d7-02c2-481a-a267-b8cc54079d6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6bbe24e9bd8425387494eb5f69f38f1'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:38.737307 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d25c952c-bb6d-4c7d-9639-37cb10106976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:38.747154 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1192/2421] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:45:38 2022] DELETE /identity/v3/users/d6bbe24e9bd8425387494eb5f69f38f1 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:45:38.750664 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1230/2422] 10.222.0.59 () {58 vars in 1016 bytes} [Tue Jul 12 14:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:45:38.752056 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a717f-eaed-4641-8340-47f5f6d1d70c None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:38.752358 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a717f-eaed-4641-8340-47f5f6d1d70c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:38.752639 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a717f-eaed-4641-8340-47f5f6d1d70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:38.775677 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c952c-bb6d-4c7d-9639-37cb10106976 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:38.777255 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d25c952c-bb6d-4c7d-9639-37cb10106976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:38.787064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-493a717f-eaed-4641-8340-47f5f6d1d70c None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:38.790929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-493a717f-eaed-4641-8340-47f5f6d1d70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:38.805692 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:38.887798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1193/2423] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:38.904496 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a717f-eaed-4641-8340-47f5f6d1d70c None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:38.907028 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-493a717f-eaed-4641-8340-47f5f6d1d70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:38.913479 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c952c-bb6d-4c7d-9639-37cb10106976 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:39.009814 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a717f-eaed-4641-8340-47f5f6d1d70c None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:39.014454 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0f6fb-8a48-4974-95c7-234b09892f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:39.015377 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0f6fb-8a48-4974-95c7-234b09892f4f service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:39.015744 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0f6fb-8a48-4974-95c7-234b09892f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:39.016963 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0f6fb-8a48-4974-95c7-234b09892f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:39.025210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:39.040179 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0f6fb-8a48-4974-95c7-234b09892f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:39.043855 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0f6fb-8a48-4974-95c7-234b09892f4f service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:39.052195 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd74505-7bfe-46fd-b119-29e879f88263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:39.052994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd74505-7bfe-46fd-b119-29e879f88263 service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:39.054099 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd74505-7bfe-46fd-b119-29e879f88263 service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:39.055892 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd74505-7bfe-46fd-b119-29e879f88263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:39.057616 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1194/2424] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:45:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:45:39.069177 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd74505-7bfe-46fd-b119-29e879f88263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:39.070955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd74505-7bfe-46fd-b119-29e879f88263 service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:39.098005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1231/2425] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:45:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:45:39.861944 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0f6fb-8a48-4974-95c7-234b09892f4f service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:39.864564 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-54f0f6fb-8a48-4974-95c7-234b09892f4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:39.878506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0f6fb-8a48-4974-95c7-234b09892f4f service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:39.883478 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b412055-2876-42ab-9c20-5a428e34ea9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:39.884357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b412055-2876-42ab-9c20-5a428e34ea9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:39.884643 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b412055-2876-42ab-9c20-5a428e34ea9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:39.884919 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b412055-2876-42ab-9c20-5a428e34ea9e admin admin] PATH_INFO: `/v3/projects/44961de446554720b84be121cdd96409` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:39.893614 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b412055-2876-42ab-9c20-5a428e34ea9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=44961de446554720b84be121cdd96409)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:39.896122 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b412055-2876-42ab-9c20-5a428e34ea9e admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:40.457019 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-5b412055-2876-42ab-9c20-5a428e34ea9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44961de446554720b84be121cdd96409', 'request_id': 'req-5b412055-2876-42ab-9c20-5a428e34ea9e'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:40.481284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-5b412055-2876-42ab-9c20-5a428e34ea9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44961de446554720b84be121cdd96409', 'request_id': 'req-5b412055-2876-42ab-9c20-5a428e34ea9e'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:40.481284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-5b412055-2876-42ab-9c20-5a428e34ea9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44961de446554720b84be121cdd96409', 'request_id': 'req-5b412055-2876-42ab-9c20-5a428e34ea9e'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:40.592172 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-5b412055-2876-42ab-9c20-5a428e34ea9e admin admin] The token cache is being invalidate because project 44961de446554720b84be121cdd96409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:45:40.592706 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-5b412055-2876-42ab-9c20-5a428e34ea9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:40.593560 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-5b412055-2876-42ab-9c20-5a428e34ea9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:45:40.595304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1195/2426] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:45:39 2022] DELETE /identity/v3/projects/44961de446554720b84be121cdd96409 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:45:45.188901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346afd2-8d7d-4ee7-a70e-12aada8f108f None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:45.189500 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346afd2-8d7d-4ee7-a70e-12aada8f108f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:45.189500 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346afd2-8d7d-4ee7-a70e-12aada8f108f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:45.209481 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-7346afd2-8d7d-4ee7-a70e-12aada8f108f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:45.210647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7346afd2-8d7d-4ee7-a70e-12aada8f108f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:45.284070 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1232/2427] 10.222.0.59 () {58 vars in 1016 bytes} [Tue Jul 12 14:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:45.310893 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b412055-2876-42ab-9c20-5a428e34ea9e admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:45.312669 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5b412055-2876-42ab-9c20-5a428e34ea9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:45.358357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:45:45.391962 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b412055-2876-42ab-9c20-5a428e34ea9e admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:45.398553 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8257c-95d4-4e2a-978e-0af01459f789 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:45.399202 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8257c-95d4-4e2a-978e-0af01459f789 service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:45.400335 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8257c-95d4-4e2a-978e-0af01459f789 service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:45.400335 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8257c-95d4-4e2a-978e-0af01459f789 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:45.407994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8257c-95d4-4e2a-978e-0af01459f789 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:45.409573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8257c-95d4-4e2a-978e-0af01459f789 service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:45.418864 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1196/2428] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:45:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:45:51.741543 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f5c2d-2518-43aa-b517-e12d66750cd8 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:51.742170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f5c2d-2518-43aa-b517-e12d66750cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:51.742170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f5c2d-2518-43aa-b517-e12d66750cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:51.760720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-a96f5c2d-2518-43aa-b517-e12d66750cd8 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:51.761918 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a96f5c2d-2518-43aa-b517-e12d66750cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:51.770320 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1233/2429] 10.222.0.59 () {58 vars in 1016 bytes} [Tue Jul 12 14:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:51.792956 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8257c-95d4-4e2a-978e-0af01459f789 service nova] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:51.794592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b1f8257c-95d4-4e2a-978e-0af01459f789 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:51.809124 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8257c-95d4-4e2a-978e-0af01459f789 service nova] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:51.814889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657359b-0870-4782-904e-79282f22cce6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:51.815600 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657359b-0870-4782-904e-79282f22cce6 service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:51.815885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657359b-0870-4782-904e-79282f22cce6 service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:51.820535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657359b-0870-4782-904e-79282f22cce6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:51.825342 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657359b-0870-4782-904e-79282f22cce6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:51.826986 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657359b-0870-4782-904e-79282f22cce6 service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:51.837308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1197/2430] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:45:56.176921 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97644e9-29aa-43cc-92ee-53eafe125ab9 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:56.177609 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97644e9-29aa-43cc-92ee-53eafe125ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:56.177609 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97644e9-29aa-43cc-92ee-53eafe125ab9 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:56.180092 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1234/2431] 10.222.0.40 () {54 vars in 921 bytes} [Tue Jul 12 14:45:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:45:56.186871 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090a960-a5ae-4843-8630-7beec87e5b00 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:56.187431 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090a960-a5ae-4843-8630-7beec87e5b00 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:56.187588 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090a960-a5ae-4843-8630-7beec87e5b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:56.214636 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-a090a960-a5ae-4843-8630-7beec87e5b00 None None] MFA Rules not processed for user `122fc227de9d4f87a66e4a0d86ff0b16`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:56.217033 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-a090a960-a5ae-4843-8630-7beec87e5b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:56.234638 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1198/2432] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Jul 12 14:45:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:56.241226 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97644e9-29aa-43cc-92ee-53eafe125ab9 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:56.243752 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b97644e9-29aa-43cc-92ee-53eafe125ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:56.307581 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97644e9-29aa-43cc-92ee-53eafe125ab9 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:56.312720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d4be3-53dc-480b-b70f-b7621265fdb9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37932500740c4ccb96358bd751d01598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:56.313491 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d4be3-53dc-480b-b70f-b7621265fdb9 service glance] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:56.313847 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d4be3-53dc-480b-b70f-b7621265fdb9 service glance] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:56.314395 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d4be3-53dc-480b-b70f-b7621265fdb9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:56.329337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d4be3-53dc-480b-b70f-b7621265fdb9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:56.330975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d4be3-53dc-480b-b70f-b7621265fdb9 service glance] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:56.346216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1235/2433] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:45:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:45:56.559044 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff0dce-6455-4c00-a99d-f7c13264da2f None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:56.559368 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff0dce-6455-4c00-a99d-f7c13264da2f None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:56.559676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff0dce-6455-4c00-a99d-f7c13264da2f None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:56.561156 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1199/2434] 10.222.0.40 () {54 vars in 921 bytes} [Tue Jul 12 14:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:45:56.566396 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ca49d-b49c-46a9-882e-1b5652d1cde8 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:56.566683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ca49d-b49c-46a9-882e-1b5652d1cde8 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:56.566962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ca49d-b49c-46a9-882e-1b5652d1cde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:56.586759 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-357ca49d-b49c-46a9-882e-1b5652d1cde8 None None] MFA Rules not processed for user `2af2d348fc984ed897fd58196b433b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:56.588018 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-357ca49d-b49c-46a9-882e-1b5652d1cde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:56.657192 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1236/2435] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Jul 12 14:45:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:56.669477 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611a5f3-9638-4eb7-8f1c-b9ec1498781c None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:56.669802 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ca49d-b49c-46a9-882e-1b5652d1cde8 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:56.669935 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611a5f3-9638-4eb7-8f1c-b9ec1498781c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:56.670265 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611a5f3-9638-4eb7-8f1c-b9ec1498781c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:56.671956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-357ca49d-b49c-46a9-882e-1b5652d1cde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:56.684414 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ca49d-b49c-46a9-882e-1b5652d1cde8 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:56.688520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fdc83-2f94-4850-ab1a-3befefa4e669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:56.689196 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fdc83-2f94-4850-ab1a-3befefa4e669 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:56.689485 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fdc83-2f94-4850-ab1a-3befefa4e669 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:56.689765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fdc83-2f94-4850-ab1a-3befefa4e669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:56.691344 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-4611a5f3-9638-4eb7-8f1c-b9ec1498781c None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:56.692555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-4611a5f3-9638-4eb7-8f1c-b9ec1498781c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:56.701563 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1200/2436] 10.222.0.59 () {58 vars in 1016 bytes} [Tue Jul 12 14:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:56.704610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fdc83-2f94-4850-ab1a-3befefa4e669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:56.706058 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fdc83-2f94-4850-ab1a-3befefa4e669 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:56.715529 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1237/2437] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:45:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:45:56.724110 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611a5f3-9638-4eb7-8f1c-b9ec1498781c None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:56.738012 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611a5f3-9638-4eb7-8f1c-b9ec1498781c None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:56.744980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2c13e-7c6a-4ac6-9a1a-87789a6ac9f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:56.745766 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2c13e-7c6a-4ac6-9a1a-87789a6ac9f4 service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:56.746113 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2c13e-7c6a-4ac6-9a1a-87789a6ac9f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:56.746392 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2c13e-7c6a-4ac6-9a1a-87789a6ac9f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:56.755319 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2c13e-7c6a-4ac6-9a1a-87789a6ac9f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:56.758173 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2c13e-7c6a-4ac6-9a1a-87789a6ac9f4 service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:56.769477 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1201/2438] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:45:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:45:56.813131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02829f-dea5-4115-9872-d8fb68c2496a None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:56.813413 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02829f-dea5-4115-9872-d8fb68c2496a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:56.813694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02829f-dea5-4115-9872-d8fb68c2496a None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:56.815064 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1238/2439] 10.222.0.40 () {54 vars in 921 bytes} [Tue Jul 12 14:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:45:56.821269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05718b-6ed9-4502-a631-1cbd6b68971f None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:56.821554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05718b-6ed9-4502-a631-1cbd6b68971f None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:56.821834 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05718b-6ed9-4502-a631-1cbd6b68971f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:56.841400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-5e05718b-6ed9-4502-a631-1cbd6b68971f None None] MFA Rules not processed for user `122fc227de9d4f87a66e4a0d86ff0b16`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:45:56.842608 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5e05718b-6ed9-4502-a631-1cbd6b68971f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:45:56.852352 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1202/2440] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Jul 12 14:45:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:45:56.864754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02829f-dea5-4115-9872-d8fb68c2496a None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:45:56.880379 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02829f-dea5-4115-9872-d8fb68c2496a None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:45:56.884892 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f15f49-aa24-4540-af49-6250ad74e969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:45:56.885583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f15f49-aa24-4540-af49-6250ad74e969 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:45:56.885875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f15f49-aa24-4540-af49-6250ad74e969 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:45:56.886190 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f15f49-aa24-4540-af49-6250ad74e969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:45:56.898752 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f15f49-aa24-4540-af49-6250ad74e969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:45:56.900299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f15f49-aa24-4540-af49-6250ad74e969 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:45:56.912882 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1239/2441] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:45:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:46:01.895809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d735ac4-4aec-4e6b-9dbd-82c154a537b1 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:46:01.896341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d735ac4-4aec-4e6b-9dbd-82c154a537b1 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:46:01.896566 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d735ac4-4aec-4e6b-9dbd-82c154a537b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:46:01.915063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-2d735ac4-4aec-4e6b-9dbd-82c154a537b1 None None] MFA Rules not processed for user `5ec758ef106b49f4985845b3c106f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:46:01.916338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2d735ac4-4aec-4e6b-9dbd-82c154a537b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:46:01.944462 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9c72d-a301-4e13-8c6d-3dc68c9a10ef None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:46:01.945096 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9c72d-a301-4e13-8c6d-3dc68c9a10ef None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:46:01.945096 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9c72d-a301-4e13-8c6d-3dc68c9a10ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:46:01.958213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:01.965464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-43e9c72d-a301-4e13-8c6d-3dc68c9a10ef None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:46:01.966681 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-43e9c72d-a301-4e13-8c6d-3dc68c9a10ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:46:01.976693 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1240/2442] 10.222.0.59 () {58 vars in 1016 bytes} [Tue Jul 12 14:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:46:01.978905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1203/2443] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Jul 12 14:46:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:46:01.989601 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9c72d-a301-4e13-8c6d-3dc68c9a10ef None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:46:01.991887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-43e9c72d-a301-4e13-8c6d-3dc68c9a10ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:46:02.012151 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d735ac4-4aec-4e6b-9dbd-82c154a537b1 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:46:02.026256 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d735ac4-4aec-4e6b-9dbd-82c154a537b1 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:46:02.033758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d2ce0-4162-406c-be68-159cac3e7dd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:46:02.034598 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d2ce0-4162-406c-be68-159cac3e7dd0 service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:46:02.034988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d2ce0-4162-406c-be68-159cac3e7dd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:46:02.035401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d2ce0-4162-406c-be68-159cac3e7dd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:46:02.048270 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d2ce0-4162-406c-be68-159cac3e7dd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:46:02.050260 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d2ce0-4162-406c-be68-159cac3e7dd0 service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:46:02.062393 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1204/2444] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:46:02.078575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9c72d-a301-4e13-8c6d-3dc68c9a10ef None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:46:02.084102 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d9232-6b5b-4840-8211-0ea7a72085de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad12085f356a4f0682bb70ad231a10b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:46:02.084803 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d9232-6b5b-4840-8211-0ea7a72085de service swift] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:46:02.085098 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d9232-6b5b-4840-8211-0ea7a72085de service swift] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:46:02.085382 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d9232-6b5b-4840-8211-0ea7a72085de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:46:02.095836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d9232-6b5b-4840-8211-0ea7a72085de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:46:02.097613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d9232-6b5b-4840-8211-0ea7a72085de service swift] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:46:02.106857 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1241/2445] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Jul 12 14:46:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:46:12.057216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=68 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:12.103427 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=32 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:28.292950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54a19f-7e19-4cbe-8dd5-b1941d00bb53 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:46:28.293525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54a19f-7e19-4cbe-8dd5-b1941d00bb53 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:46:28.293525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54a19f-7e19-4cbe-8dd5-b1941d00bb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:46:28.312187 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-fe54a19f-7e19-4cbe-8dd5-b1941d00bb53 None None] MFA Rules not processed for user `5ec758ef106b49f4985845b3c106f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:46:28.313391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fe54a19f-7e19-4cbe-8dd5-b1941d00bb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:46:28.320760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1205/2446] 10.222.0.40 () {58 vars in 967 bytes} [Tue Jul 12 14:46:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:46:28.334681 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d9232-6b5b-4840-8211-0ea7a72085de service swift] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:46:28.345879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d9232-6b5b-4840-8211-0ea7a72085de service swift] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:46:28.351632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0f11b-6146-49d0-81de-8b83324612c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad12085f356a4f0682bb70ad231a10b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:46:28.352288 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0f11b-6146-49d0-81de-8b83324612c5 service swift] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:46:28.352571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0f11b-6146-49d0-81de-8b83324612c5 service swift] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:46:28.352962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0f11b-6146-49d0-81de-8b83324612c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:46:28.362135 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0f11b-6146-49d0-81de-8b83324612c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:46:28.363768 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0f11b-6146-49d0-81de-8b83324612c5 service swift] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:46:28.373231 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1242/2447] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Jul 12 14:46:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:46:29.903483 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a47de2-ea35-40d9-bfa1-ba6ff1ba1e24 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:46:29.904055 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a47de2-ea35-40d9-bfa1-ba6ff1ba1e24 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:46:29.904055 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a47de2-ea35-40d9-bfa1-ba6ff1ba1e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:46:29.923879 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-79a47de2-ea35-40d9-bfa1-ba6ff1ba1e24 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:46:29.925101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-79a47de2-ea35-40d9-bfa1-ba6ff1ba1e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:46:29.933825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1206/2448] 10.222.0.59 () {58 vars in 1016 bytes} [Tue Jul 12 14:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:46:29.958116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0f11b-6146-49d0-81de-8b83324612c5 service swift] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:46:29.972823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0f11b-6146-49d0-81de-8b83324612c5 service swift] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:46:29.979910 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d46cae-7000-4aa5-ae92-225ed3ea742d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:46:29.980537 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d46cae-7000-4aa5-ae92-225ed3ea742d service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:46:29.980829 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d46cae-7000-4aa5-ae92-225ed3ea742d service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:46:29.981141 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d46cae-7000-4aa5-ae92-225ed3ea742d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:46:29.990071 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d46cae-7000-4aa5-ae92-225ed3ea742d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:46:29.991722 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d46cae-7000-4aa5-ae92-225ed3ea742d service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:46:30.003130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1243/2449] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:46:39.918385 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=6 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:39.998225 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=12 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:41.576282 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a47de2-ea35-40d9-bfa1-ba6ff1ba1e24 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:46:41.577722 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-79a47de2-ea35-40d9-bfa1-ba6ff1ba1e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:46:41.590809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a47de2-ea35-40d9-bfa1-ba6ff1ba1e24 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:46:41.594441 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ba1be-9ce2-440f-af1f-46403894f61f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:46:41.595091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ba1be-9ce2-440f-af1f-46403894f61f service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:46:41.595417 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ba1be-9ce2-440f-af1f-46403894f61f service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:46:41.595703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ba1be-9ce2-440f-af1f-46403894f61f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:46:41.597475 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-dc5ba1be-9ce2-440f-af1f-46403894f61f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:46:41.611635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ba1be-9ce2-440f-af1f-46403894f61f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:46:41.613083 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ba1be-9ce2-440f-af1f-46403894f61f service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:46:41.625015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1207/2450] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:46:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:46:42.801451 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d46cae-7000-4aa5-ae92-225ed3ea742d service nova] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:46:42.811061 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d46cae-7000-4aa5-ae92-225ed3ea742d service nova] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:46:42.814677 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08df02-0d6a-4eee-b0be-0ce4f5738e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:46:42.815353 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08df02-0d6a-4eee-b0be-0ce4f5738e09 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:46:42.815644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08df02-0d6a-4eee-b0be-0ce4f5738e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:46:42.815925 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08df02-0d6a-4eee-b0be-0ce4f5738e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:46:42.817681 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0a08df02-0d6a-4eee-b0be-0ce4f5738e09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:46:42.835441 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08df02-0d6a-4eee-b0be-0ce4f5738e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:46:42.838722 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08df02-0d6a-4eee-b0be-0ce4f5738e09 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:46:42.854075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1244/2451] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:46:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:46:50.413753 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09376a8-2150-418f-827c-41605287560b None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:46:50.414323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09376a8-2150-418f-827c-41605287560b None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:46:50.414323 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09376a8-2150-418f-827c-41605287560b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:46:50.433469 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-b09376a8-2150-418f-827c-41605287560b None None] MFA Rules not processed for user `d691506a2d8a43cf831d0265f85e9651`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:46:50.434774 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b09376a8-2150-418f-827c-41605287560b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:46:50.491133 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1208/2452] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:46:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:46:52.846967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=6 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:46:59.653854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08df02-0d6a-4eee-b0be-0ce4f5738e09 service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:46:59.655330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0a08df02-0d6a-4eee-b0be-0ce4f5738e09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:46:59.715000 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08df02-0d6a-4eee-b0be-0ce4f5738e09 service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:46:59.718872 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903736c5-78bf-45b2-bc3f-0e8a3a36e634 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:46:59.719601 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903736c5-78bf-45b2-bc3f-0e8a3a36e634 service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:46:59.719891 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903736c5-78bf-45b2-bc3f-0e8a3a36e634 service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:46:59.720175 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903736c5-78bf-45b2-bc3f-0e8a3a36e634 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:46:59.722577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-903736c5-78bf-45b2-bc3f-0e8a3a36e634 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:46:59.790930 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903736c5-78bf-45b2-bc3f-0e8a3a36e634 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:46:59.792482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903736c5-78bf-45b2-bc3f-0e8a3a36e634 service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:46:59.801796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1245/2453] 10.222.0.40 () {60 vars in 1396 bytes} [Tue Jul 12 14:46:59 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3260 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:47:00.484253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=31 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:09.797518 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=48 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:10.846265 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663783b3-78cd-429e-b71a-4a548ddaf048 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:10.847172 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663783b3-78cd-429e-b71a-4a548ddaf048 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:10.847172 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663783b3-78cd-429e-b71a-4a548ddaf048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:10.867221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-663783b3-78cd-429e-b71a-4a548ddaf048 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:47:10.868548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-663783b3-78cd-429e-b71a-4a548ddaf048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:47:10.876833 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1209/2454] 10.222.0.59 () {58 vars in 1016 bytes} [Tue Jul 12 14:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:47:10.907665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903736c5-78bf-45b2-bc3f-0e8a3a36e634 service cinder] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:47:10.927366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903736c5-78bf-45b2-bc3f-0e8a3a36e634 service cinder] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:47:10.933567 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53025782-4669-4ff7-b082-b84a582b895f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:47:10.936227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53025782-4669-4ff7-b082-b84a582b895f service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:10.936227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53025782-4669-4ff7-b082-b84a582b895f service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:10.936227 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53025782-4669-4ff7-b082-b84a582b895f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:10.944113 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53025782-4669-4ff7-b082-b84a582b895f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:47:10.945706 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53025782-4669-4ff7-b082-b84a582b895f service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:47:10.956445 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1246/2455] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:47:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:47:17.396837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca80ca-7ece-41ba-8d6c-af120ae83fd3 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:17.401483 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca80ca-7ece-41ba-8d6c-af120ae83fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:17.401483 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca80ca-7ece-41ba-8d6c-af120ae83fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:17.428174 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-76ca80ca-7ece-41ba-8d6c-af120ae83fd3 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:47:17.430181 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-76ca80ca-7ece-41ba-8d6c-af120ae83fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:47:17.447018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1210/2456] 10.222.0.59 () {58 vars in 1016 bytes} [Tue Jul 12 14:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:47:17.468175 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53025782-4669-4ff7-b082-b84a582b895f service nova] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:47:17.486815 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53025782-4669-4ff7-b082-b84a582b895f service nova] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:47:17.493937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eff861-5517-49d3-b0af-691a3eb6c7b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:47:17.494620 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eff861-5517-49d3-b0af-691a3eb6c7b4 service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:17.494904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eff861-5517-49d3-b0af-691a3eb6c7b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:17.495184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eff861-5517-49d3-b0af-691a3eb6c7b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:17.508020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eff861-5517-49d3-b0af-691a3eb6c7b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:47:17.510409 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eff861-5517-49d3-b0af-691a3eb6c7b4 service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:47:17.523874 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1247/2457] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:47:22.355234 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998c06e-28a7-4f5a-8a77-7e4e1539d7d0 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:22.355986 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998c06e-28a7-4f5a-8a77-7e4e1539d7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:22.355986 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998c06e-28a7-4f5a-8a77-7e4e1539d7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:22.376300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-7998c06e-28a7-4f5a-8a77-7e4e1539d7d0 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:47:22.377558 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-7998c06e-28a7-4f5a-8a77-7e4e1539d7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:47:22.386928 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1211/2458] 10.222.0.59 () {58 vars in 1016 bytes} [Tue Jul 12 14:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:47:22.413391 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eff861-5517-49d3-b0af-691a3eb6c7b4 service nova] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:47:22.426415 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eff861-5517-49d3-b0af-691a3eb6c7b4 service nova] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:47:22.433673 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c4b38-1b50-4fa4-82ae-83d0be54ed4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:47:22.434480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c4b38-1b50-4fa4-82ae-83d0be54ed4a service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:22.434884 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c4b38-1b50-4fa4-82ae-83d0be54ed4a service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:22.435056 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c4b38-1b50-4fa4-82ae-83d0be54ed4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:22.444840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c4b38-1b50-4fa4-82ae-83d0be54ed4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:47:22.447132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c4b38-1b50-4fa4-82ae-83d0be54ed4a service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:47:22.458549 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1248/2459] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:47:23.708665 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998c06e-28a7-4f5a-8a77-7e4e1539d7d0 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:47:23.733398 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998c06e-28a7-4f5a-8a77-7e4e1539d7d0 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:47:23.737410 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686ead7-e0dc-40e5-a4d6-828e69071543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:47:23.738094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686ead7-e0dc-40e5-a4d6-828e69071543 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:23.738385 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686ead7-e0dc-40e5-a4d6-828e69071543 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:23.738661 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686ead7-e0dc-40e5-a4d6-828e69071543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:23.740690 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-3686ead7-e0dc-40e5-a4d6-828e69071543 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:47:23.752768 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686ead7-e0dc-40e5-a4d6-828e69071543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:47:23.754159 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686ead7-e0dc-40e5-a4d6-828e69071543 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:47:23.764165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1212/2460] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:47:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:47:25.225075 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c4b38-1b50-4fa4-82ae-83d0be54ed4a service nova] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:47:25.238333 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c4b38-1b50-4fa4-82ae-83d0be54ed4a service nova] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:47:25.245254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5ed7b-c8a0-4345-8b73-535ea1de6187 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:47:25.246070 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5ed7b-c8a0-4345-8b73-535ea1de6187 service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:25.246271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5ed7b-c8a0-4345-8b73-535ea1de6187 service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:25.246546 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5ed7b-c8a0-4345-8b73-535ea1de6187 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:25.251072 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ffe5ed7b-c8a0-4345-8b73-535ea1de6187 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:47:25.325784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5ed7b-c8a0-4345-8b73-535ea1de6187 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:47:25.327535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5ed7b-c8a0-4345-8b73-535ea1de6187 service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:47:25.338655 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1249/2461] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:47:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:47:29.838242 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada06fd-8839-402b-825f-ec0e46a41aa1 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:29.838791 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada06fd-8839-402b-825f-ec0e46a41aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:29.838887 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada06fd-8839-402b-825f-ec0e46a41aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:29.858569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-eada06fd-8839-402b-825f-ec0e46a41aa1 None None] MFA Rules not processed for user `abb27a4eecd14ab89a1d349fa3bdc0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:47:29.859898 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-eada06fd-8839-402b-825f-ec0e46a41aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:47:29.868340 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1213/2462] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:47:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:47:30.851673 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270de798-abfd-4dc6-8599-263a6c3d07f5 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:30.853048 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270de798-abfd-4dc6-8599-263a6c3d07f5 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:30.853048 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270de798-abfd-4dc6-8599-263a6c3d07f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:30.875736 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-270de798-abfd-4dc6-8599-263a6c3d07f5 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:47:30.877544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-270de798-abfd-4dc6-8599-263a6c3d07f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:47:30.889950 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1250/2463] 10.222.0.59 () {58 vars in 1016 bytes} [Tue Jul 12 14:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:47:30.920999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada06fd-8839-402b-825f-ec0e46a41aa1 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:47:30.949249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada06fd-8839-402b-825f-ec0e46a41aa1 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:47:30.958831 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97089644-cdd7-4766-a908-f0b7a7ebae17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:47:30.960005 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97089644-cdd7-4766-a908-f0b7a7ebae17 service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:30.960553 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97089644-cdd7-4766-a908-f0b7a7ebae17 service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:30.961253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97089644-cdd7-4766-a908-f0b7a7ebae17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:30.978417 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97089644-cdd7-4766-a908-f0b7a7ebae17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:47:30.981952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97089644-cdd7-4766-a908-f0b7a7ebae17 service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:47:30.999683 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1214/2464] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:47:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:47:32.318414 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270de798-abfd-4dc6-8599-263a6c3d07f5 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:47:32.334182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270de798-abfd-4dc6-8599-263a6c3d07f5 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:47:32.341608 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23d117-9d90-4770-b823-0e3433caa3cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:47:32.342582 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23d117-9d90-4770-b823-0e3433caa3cd service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:32.342876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23d117-9d90-4770-b823-0e3433caa3cd service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:32.343172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23d117-9d90-4770-b823-0e3433caa3cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:32.345172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-2c23d117-9d90-4770-b823-0e3433caa3cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:47:32.360988 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23d117-9d90-4770-b823-0e3433caa3cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:47:32.363623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23d117-9d90-4770-b823-0e3433caa3cd service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:47:32.383723 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1251/2465] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:47:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:47:39.317256 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95007d-cd76-43e0-baba-2077ee64ba0c None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:39.318097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95007d-cd76-43e0-baba-2077ee64ba0c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:39.318097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95007d-cd76-43e0-baba-2077ee64ba0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:39.484096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-2d95007d-cd76-43e0-baba-2077ee64ba0c None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:47:39.484953 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23d117-9d90-4770-b823-0e3433caa3cd service nova] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:47:39.486498 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2d95007d-cd76-43e0-baba-2077ee64ba0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:47:39.553429 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1215/2466] 10.222.0.59 () {58 vars in 1016 bytes} [Tue Jul 12 14:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:47:39.565694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23d117-9d90-4770-b823-0e3433caa3cd service nova] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:47:39.573015 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ebbd5-09da-472e-893f-0fdc3aea1c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:47:39.573703 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ebbd5-09da-472e-893f-0fdc3aea1c98 service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:39.573989 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ebbd5-09da-472e-893f-0fdc3aea1c98 service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:39.574268 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ebbd5-09da-472e-893f-0fdc3aea1c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:39.576769 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-aa9ebbd5-09da-472e-893f-0fdc3aea1c98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:47:39.608215 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ebbd5-09da-472e-893f-0fdc3aea1c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:47:39.612473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ebbd5-09da-472e-893f-0fdc3aea1c98 service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:47:39.616567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95007d-cd76-43e0-baba-2077ee64ba0c None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:47:39.636395 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1252/2467] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:47:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:47:39.647050 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95007d-cd76-43e0-baba-2077ee64ba0c None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:47:39.658699 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925a8b2-804d-4209-a6d9-57901c435cb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:47:39.659886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925a8b2-804d-4209-a6d9-57901c435cb7 service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:39.660443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925a8b2-804d-4209-a6d9-57901c435cb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:39.660980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925a8b2-804d-4209-a6d9-57901c435cb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:39.683894 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925a8b2-804d-4209-a6d9-57901c435cb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:47:39.688953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925a8b2-804d-4209-a6d9-57901c435cb7 service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:47:39.716684 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1216/2468] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:47:47.693139 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ebbd5-09da-472e-893f-0fdc3aea1c98 service nova] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:47:47.701045 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=80 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:47.707586 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ebbd5-09da-472e-893f-0fdc3aea1c98 service nova] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:47:47.716990 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff544ec-1fe2-4ae6-9cb9-6ff575a5046d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:47:47.717690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff544ec-1fe2-4ae6-9cb9-6ff575a5046d service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:47:47.717970 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff544ec-1fe2-4ae6-9cb9-6ff575a5046d service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:47:47.718250 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff544ec-1fe2-4ae6-9cb9-6ff575a5046d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:47:47.720731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1ff544ec-1fe2-4ae6-9cb9-6ff575a5046d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:47:47.807031 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff544ec-1fe2-4ae6-9cb9-6ff575a5046d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:47:47.809194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff544ec-1fe2-4ae6-9cb9-6ff575a5046d service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:47:47.821692 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1253/2469] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:47:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:47:49.702387 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=69 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:47:58.014839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=27 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:48:00.963606 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ced09b-6557-464c-9221-23ddf217239e None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:00.964204 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ced09b-6557-464c-9221-23ddf217239e None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:00.964531 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ced09b-6557-464c-9221-23ddf217239e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:01.022536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-f7ced09b-6557-464c-9221-23ddf217239e None None] MFA Rules not processed for user `87fcc3fa1cbe4afeaa0e455f2631411a`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:48:01.024588 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-f7ced09b-6557-464c-9221-23ddf217239e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:01.032278 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1217/2470] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:48:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:48:01.467623 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff544ec-1fe2-4ae6-9cb9-6ff575a5046d service nova] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:48:01.494559 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff544ec-1fe2-4ae6-9cb9-6ff575a5046d service nova] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:48:01.499042 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903740de-ace3-41b6-a4a8-8cb19e8096f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:48:01.499991 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903740de-ace3-41b6-a4a8-8cb19e8096f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:01.500422 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903740de-ace3-41b6-a4a8-8cb19e8096f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:01.500756 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903740de-ace3-41b6-a4a8-8cb19e8096f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:01.503011 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-903740de-ace3-41b6-a4a8-8cb19e8096f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:01.537209 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903740de-ace3-41b6-a4a8-8cb19e8096f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:48:01.540269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903740de-ace3-41b6-a4a8-8cb19e8096f5 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:48:01.557609 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1254/2471] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:48:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:48:02.076195 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ced09b-6557-464c-9221-23ddf217239e None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:48:02.077850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-f7ced09b-6557-464c-9221-23ddf217239e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:02.172916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ced09b-6557-464c-9221-23ddf217239e None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:48:02.179428 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b4c22-ee07-4dd6-8a73-31318d645a70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a3704fdba154f13ad3bf8ac00c916c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:48:02.180758 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b4c22-ee07-4dd6-8a73-31318d645a70 service placement] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:02.181191 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b4c22-ee07-4dd6-8a73-31318d645a70 service placement] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:02.181535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b4c22-ee07-4dd6-8a73-31318d645a70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:02.183728 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-446b4c22-ee07-4dd6-8a73-31318d645a70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:02.197182 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b4c22-ee07-4dd6-8a73-31318d645a70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:48:02.204659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b4c22-ee07-4dd6-8a73-31318d645a70 service placement] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:48:02.217096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1218/2472] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:48:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:48:07.143996 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc1c33-817a-4bf0-9043-0209db46d384 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:07.144588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc1c33-817a-4bf0-9043-0209db46d384 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:07.145241 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc1c33-817a-4bf0-9043-0209db46d384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:07.176259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-d6fc1c33-817a-4bf0-9043-0209db46d384 None None] MFA Rules not processed for user `61f2fb5928004be4bc85b9aa1d12eef7`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:48:07.181177 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d6fc1c33-817a-4bf0-9043-0209db46d384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:07.189934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1255/2473] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:48:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:48:12.211680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=35 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:48:15.165697 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b4c22-ee07-4dd6-8a73-31318d645a70 service placement] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:48:15.190792 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b4c22-ee07-4dd6-8a73-31318d645a70 service placement] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:48:15.201590 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988f272-f10d-41d3-8b8e-83d170aa8104 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:48:15.202755 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988f272-f10d-41d3-8b8e-83d170aa8104 service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:15.203265 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988f272-f10d-41d3-8b8e-83d170aa8104 service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:15.203883 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988f272-f10d-41d3-8b8e-83d170aa8104 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:15.207393 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0988f272-f10d-41d3-8b8e-83d170aa8104 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:15.223465 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988f272-f10d-41d3-8b8e-83d170aa8104 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:48:15.225157 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988f272-f10d-41d3-8b8e-83d170aa8104 service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:48:15.243540 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1219/2474] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:48:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:48:17.169361 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=18 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:48:20.140475 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc1c33-817a-4bf0-9043-0209db46d384 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:48:20.163595 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc1c33-817a-4bf0-9043-0209db46d384 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:48:20.173707 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709e919-7478-466c-8d8e-fad2a3482beb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:48:20.174895 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709e919-7478-466c-8d8e-fad2a3482beb service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:20.175448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709e919-7478-466c-8d8e-fad2a3482beb service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:20.175950 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709e919-7478-466c-8d8e-fad2a3482beb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:20.179238 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-6709e919-7478-466c-8d8e-fad2a3482beb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:20.302311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709e919-7478-466c-8d8e-fad2a3482beb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:48:20.305677 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709e919-7478-466c-8d8e-fad2a3482beb service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:48:20.324639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1256/2475] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:48:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:48:25.233470 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=6 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:48:25.774575 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988f272-f10d-41d3-8b8e-83d170aa8104 service nova] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:48:25.776317 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0988f272-f10d-41d3-8b8e-83d170aa8104 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:25.792757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988f272-f10d-41d3-8b8e-83d170aa8104 service nova] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:48:25.798598 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e9448-e3ce-4d38-8d5f-3cf5210127e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a3704fdba154f13ad3bf8ac00c916c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:48:25.799450 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e9448-e3ce-4d38-8d5f-3cf5210127e2 service placement] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:25.799783 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e9448-e3ce-4d38-8d5f-3cf5210127e2 service placement] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:25.800070 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e9448-e3ce-4d38-8d5f-3cf5210127e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:25.802041 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0f7e9448-e3ce-4d38-8d5f-3cf5210127e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:25.816685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e9448-e3ce-4d38-8d5f-3cf5210127e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:48:25.818639 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e9448-e3ce-4d38-8d5f-3cf5210127e2 service placement] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:48:25.834473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1220/2476] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:48:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:48:25.930372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709e919-7478-466c-8d8e-fad2a3482beb service nova] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:48:25.932829 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-6709e919-7478-466c-8d8e-fad2a3482beb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:25.951389 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709e919-7478-466c-8d8e-fad2a3482beb service nova] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:48:25.956972 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25fb7c-fd62-4b50-9b29-988c72495dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:48:25.957946 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25fb7c-fd62-4b50-9b29-988c72495dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:25.958274 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25fb7c-fd62-4b50-9b29-988c72495dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:25.958618 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25fb7c-fd62-4b50-9b29-988c72495dca admin admin] PATH_INFO: `/v3/users/d691506a2d8a43cf831d0265f85e9651` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:25.960150 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25fb7c-fd62-4b50-9b29-988c72495dca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d691506a2d8a43cf831d0265f85e9651)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:48:25.962828 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25fb7c-fd62-4b50-9b29-988c72495dca admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:48:26.172960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-ec25fb7c-fd62-4b50-9b29-988c72495dca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd691506a2d8a43cf831d0265f85e9651'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:26.186820 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-ec25fb7c-fd62-4b50-9b29-988c72495dca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd691506a2d8a43cf831d0265f85e9651'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:26.265568 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-ec25fb7c-fd62-4b50-9b29-988c72495dca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd691506a2d8a43cf831d0265f85e9651'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:26.266211 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-ec25fb7c-fd62-4b50-9b29-988c72495dca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd691506a2d8a43cf831d0265f85e9651'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:26.275265 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-ec25fb7c-fd62-4b50-9b29-988c72495dca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd691506a2d8a43cf831d0265f85e9651'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:26.282312 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1257/2477] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:48:25 2022] DELETE /identity/v3/users/d691506a2d8a43cf831d0265f85e9651 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:48:26.821431 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e9448-e3ce-4d38-8d5f-3cf5210127e2 service placement] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:48:26.840253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e9448-e3ce-4d38-8d5f-3cf5210127e2 service placement] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:48:26.959905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632838f-8926-405d-8b99-b16852f777bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:48:26.962181 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632838f-8926-405d-8b99-b16852f777bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:26.962702 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632838f-8926-405d-8b99-b16852f777bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:26.963269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632838f-8926-405d-8b99-b16852f777bd admin admin] PATH_INFO: `/v3/projects/d3cd168575c549aaafc5901dad18795a` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:26.968233 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632838f-8926-405d-8b99-b16852f777bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3cd168575c549aaafc5901dad18795a)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:48:26.969806 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632838f-8926-405d-8b99-b16852f777bd admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:48:27.144731 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b632838f-8926-405d-8b99-b16852f777bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3cd168575c549aaafc5901dad18795a', 'request_id': 'req-b632838f-8926-405d-8b99-b16852f777bd'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:27.155633 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b632838f-8926-405d-8b99-b16852f777bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3cd168575c549aaafc5901dad18795a', 'request_id': 'req-b632838f-8926-405d-8b99-b16852f777bd'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:27.162986 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b632838f-8926-405d-8b99-b16852f777bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3cd168575c549aaafc5901dad18795a', 'request_id': 'req-b632838f-8926-405d-8b99-b16852f777bd'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:27.246764 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b632838f-8926-405d-8b99-b16852f777bd admin admin] The token cache is being invalidate because project d3cd168575c549aaafc5901dad18795a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:48:27.247300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b632838f-8926-405d-8b99-b16852f777bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:27.248442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-b632838f-8926-405d-8b99-b16852f777bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:27.250688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1221/2478] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:48:26 2022] DELETE /identity/v3/projects/d3cd168575c549aaafc5901dad18795a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:48:27.256880 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0cf24-b573-4bff-8967-fac344193ece None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:27.257463 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0cf24-b573-4bff-8967-fac344193ece None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:27.257958 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0cf24-b573-4bff-8967-fac344193ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:27.289370 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-b4e0cf24-b573-4bff-8967-fac344193ece None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:48:27.291498 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b4e0cf24-b573-4bff-8967-fac344193ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:27.385251 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1258/2479] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:48:27.393640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbc1b9-b944-4323-a11b-2f0199094902 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:27.394007 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbc1b9-b944-4323-a11b-2f0199094902 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:27.394200 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbc1b9-b944-4323-a11b-2f0199094902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:27.427861 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-7ecbc1b9-b944-4323-a11b-2f0199094902 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:48:27.431007 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-7ecbc1b9-b944-4323-a11b-2f0199094902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:27.444933 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1222/2480] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:48:27.450416 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0cf24-b573-4bff-8967-fac344193ece None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:48:27.466821 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0cf24-b573-4bff-8967-fac344193ece None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:48:27.475483 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee5539-d4b0-4f95-870e-f76c3653b3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:48:27.477209 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee5539-d4b0-4f95-870e-f76c3653b3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:27.478661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee5539-d4b0-4f95-870e-f76c3653b3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:27.479168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee5539-d4b0-4f95-870e-f76c3653b3e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:27.480629 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee5539-d4b0-4f95-870e-f76c3653b3e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:48:27.481169 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee5539-d4b0-4f95-870e-f76c3653b3e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:48:27.484652 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee5539-d4b0-4f95-870e-f76c3653b3e8 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:48:27.499064 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:48:27.510203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1259/2481] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:48:27.518799 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbc1b9-b944-4323-a11b-2f0199094902 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:48:27.535764 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbc1b9-b944-4323-a11b-2f0199094902 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:48:27.546063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396854fa-f76e-4d48-bade-098e372e5f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:48:27.547261 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396854fa-f76e-4d48-bade-098e372e5f0f admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:27.547808 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396854fa-f76e-4d48-bade-098e372e5f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:27.548659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396854fa-f76e-4d48-bade-098e372e5f0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:27.549727 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396854fa-f76e-4d48-bade-098e372e5f0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:48:27.554357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396854fa-f76e-4d48-bade-098e372e5f0f admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:48:27.691198 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1223/2482] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:48:27 2022] POST /identity/v3/projects => generated 397 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:48:27.697921 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee5539-d4b0-4f95-870e-f76c3653b3e8 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:48:27.712590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee5539-d4b0-4f95-870e-f76c3653b3e8 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:48:27.788684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf37fa-4603-4abb-b59c-59a42255e9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:48:27.791064 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf37fa-4603-4abb-b59c-59a42255e9ca admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:27.791602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf37fa-4603-4abb-b59c-59a42255e9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:27.792095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf37fa-4603-4abb-b59c-59a42255e9ca admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:27.793404 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf37fa-4603-4abb-b59c-59a42255e9ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:48:27.797806 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf37fa-4603-4abb-b59c-59a42255e9ca admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:48:27.919931 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1260/2483] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:48:27 2022] POST /identity/v3/users => generated 299 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:48:27.924573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396854fa-f76e-4d48-bade-098e372e5f0f admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:48:27.938508 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396854fa-f76e-4d48-bade-098e372e5f0f admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:48:27.946014 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe005e1a-d3b1-414c-b48e-9a4ee1f02ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:48:27.947062 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe005e1a-d3b1-414c-b48e-9a4ee1f02ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:27.947531 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe005e1a-d3b1-414c-b48e-9a4ee1f02ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:27.947964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe005e1a-d3b1-414c-b48e-9a4ee1f02ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:27.948949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe005e1a-d3b1-414c-b48e-9a4ee1f02ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:48:27.951712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe005e1a-d3b1-414c-b48e-9a4ee1f02ba5 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:48:27.972244 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1224/2484] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:48:27.976009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf37fa-4603-4abb-b59c-59a42255e9ca admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:48:27.994236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf37fa-4603-4abb-b59c-59a42255e9ca admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:48:28.005618 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f38a7b-e1cb-4ec3-b7be-72a0a25a5e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:48:28.006720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f38a7b-e1cb-4ec3-b7be-72a0a25a5e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:28.007183 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f38a7b-e1cb-4ec3-b7be-72a0a25a5e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:28.007731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f38a7b-e1cb-4ec3-b7be-72a0a25a5e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:28.011626 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f38a7b-e1cb-4ec3-b7be-72a0a25a5e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:48:28.020205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f38a7b-e1cb-4ec3-b7be-72a0a25a5e33 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:48:28.037772 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1261/2485] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:48:28.042464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe005e1a-d3b1-414c-b48e-9a4ee1f02ba5 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:48:28.059778 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe005e1a-d3b1-414c-b48e-9a4ee1f02ba5 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:48:28.065938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84cf3f-a912-474d-9cbc-8d0b5497bac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:48:28.066856 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84cf3f-a912-474d-9cbc-8d0b5497bac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:28.067372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84cf3f-a912-474d-9cbc-8d0b5497bac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:28.067823 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84cf3f-a912-474d-9cbc-8d0b5497bac3 admin admin] PATH_INFO: `/v3/projects/5b0a49ac394f4714974a045d52784643/users/42ea45824fdd424a8039c62285a88cce/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:28.088531 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84cf3f-a912-474d-9cbc-8d0b5497bac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0a49ac394f4714974a045d52784643, user_id=42ea45824fdd424a8039c62285a88cce, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:48:28.091705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84cf3f-a912-474d-9cbc-8d0b5497bac3 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:48:28.192444 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1225/2486] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:48:28 2022] PUT /identity/v3/projects/5b0a49ac394f4714974a045d52784643/users/42ea45824fdd424a8039c62285a88cce/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:48:28.204570 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67248d76-b30c-43ce-8229-7064c5d4b662 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:28.205092 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67248d76-b30c-43ce-8229-7064c5d4b662 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:28.205355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67248d76-b30c-43ce-8229-7064c5d4b662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:28.238477 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-67248d76-b30c-43ce-8229-7064c5d4b662 None None] MFA Rules not processed for user `42ea45824fdd424a8039c62285a88cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:48:28.239865 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-67248d76-b30c-43ce-8229-7064c5d4b662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:28.325615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1262/2487] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:48:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:48:28.338337 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84cf3f-a912-474d-9cbc-8d0b5497bac3 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:48:28.340425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-6b84cf3f-a912-474d-9cbc-8d0b5497bac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:28.346049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:48:28.437552 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84cf3f-a912-474d-9cbc-8d0b5497bac3 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:48:28.441914 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62bebf-f092-4b4c-ac14-0ea22fbaf3dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:48:28.442606 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62bebf-f092-4b4c-ac14-0ea22fbaf3dd service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:28.443218 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62bebf-f092-4b4c-ac14-0ea22fbaf3dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:28.443677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62bebf-f092-4b4c-ac14-0ea22fbaf3dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:28.454730 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62bebf-f092-4b4c-ac14-0ea22fbaf3dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:48:28.456164 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62bebf-f092-4b4c-ac14-0ea22fbaf3dd service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:48:28.467259 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1226/2488] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:48:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:48:36.018920 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67248d76-b30c-43ce-8229-7064c5d4b662 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:48:36.095651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67248d76-b30c-43ce-8229-7064c5d4b662 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:48:36.102024 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68593fd-d8d2-4118-ae9c-b5a85ed0b33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:48:36.103111 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68593fd-d8d2-4118-ae9c-b5a85ed0b33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:36.103433 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68593fd-d8d2-4118-ae9c-b5a85ed0b33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:36.103820 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68593fd-d8d2-4118-ae9c-b5a85ed0b33a admin admin] PATH_INFO: `/v3/users/42ea45824fdd424a8039c62285a88cce` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:36.105184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68593fd-d8d2-4118-ae9c-b5a85ed0b33a admin admin] RBAC: Authorizing `identity:delete_user(user_id=42ea45824fdd424a8039c62285a88cce)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:48:36.107234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68593fd-d8d2-4118-ae9c-b5a85ed0b33a admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:48:36.113704 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:48:36.344828 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b68593fd-d8d2-4118-ae9c-b5a85ed0b33a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42ea45824fdd424a8039c62285a88cce'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:36.363768 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b68593fd-d8d2-4118-ae9c-b5a85ed0b33a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42ea45824fdd424a8039c62285a88cce'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:36.442507 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b68593fd-d8d2-4118-ae9c-b5a85ed0b33a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42ea45824fdd424a8039c62285a88cce'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:36.443367 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b68593fd-d8d2-4118-ae9c-b5a85ed0b33a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42ea45824fdd424a8039c62285a88cce'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:36.453304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-b68593fd-d8d2-4118-ae9c-b5a85ed0b33a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42ea45824fdd424a8039c62285a88cce'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:36.460870 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1263/2489] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:48:36 2022] DELETE /identity/v3/users/42ea45824fdd424a8039c62285a88cce => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:48:36.466008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53963b-3c53-4afc-b951-4379c8b83ef9 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:36.466827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53963b-3c53-4afc-b951-4379c8b83ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:36.466990 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53963b-3c53-4afc-b951-4379c8b83ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:36.486088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-fa53963b-3c53-4afc-b951-4379c8b83ef9 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:48:36.487362 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fa53963b-3c53-4afc-b951-4379c8b83ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:36.557176 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1227/2490] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:48:36.569545 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68593fd-d8d2-4118-ae9c-b5a85ed0b33a admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:48:36.572053 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b68593fd-d8d2-4118-ae9c-b5a85ed0b33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:36.658496 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68593fd-d8d2-4118-ae9c-b5a85ed0b33a admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:48:36.665029 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13276694-101d-4b3b-b44c-005bb93ba956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:48:36.666170 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13276694-101d-4b3b-b44c-005bb93ba956 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:36.666669 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13276694-101d-4b3b-b44c-005bb93ba956 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:36.667172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13276694-101d-4b3b-b44c-005bb93ba956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:36.685554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13276694-101d-4b3b-b44c-005bb93ba956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:48:36.688446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13276694-101d-4b3b-b44c-005bb93ba956 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:48:36.707942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1264/2491] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:48:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:48:37.235619 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53963b-3c53-4afc-b951-4379c8b83ef9 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:48:37.237156 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fa53963b-3c53-4afc-b951-4379c8b83ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:37.254308 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53963b-3c53-4afc-b951-4379c8b83ef9 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:48:37.261142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd9531-5c3c-429c-9f0b-e3ed969dda2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:48:37.263338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd9531-5c3c-429c-9f0b-e3ed969dda2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:37.263338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd9531-5c3c-429c-9f0b-e3ed969dda2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:37.263338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd9531-5c3c-429c-9f0b-e3ed969dda2a admin admin] PATH_INFO: `/v3/projects/5b0a49ac394f4714974a045d52784643` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:37.264510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd9531-5c3c-429c-9f0b-e3ed969dda2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b0a49ac394f4714974a045d52784643)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:48:37.266607 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd9531-5c3c-429c-9f0b-e3ed969dda2a admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:48:37.457287 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-1cdd9531-5c3c-429c-9f0b-e3ed969dda2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b0a49ac394f4714974a045d52784643', 'request_id': 'req-1cdd9531-5c3c-429c-9f0b-e3ed969dda2a'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:37.465321 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-1cdd9531-5c3c-429c-9f0b-e3ed969dda2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b0a49ac394f4714974a045d52784643', 'request_id': 'req-1cdd9531-5c3c-429c-9f0b-e3ed969dda2a'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:37.473061 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-1cdd9531-5c3c-429c-9f0b-e3ed969dda2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b0a49ac394f4714974a045d52784643', 'request_id': 'req-1cdd9531-5c3c-429c-9f0b-e3ed969dda2a'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:37.590651 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-1cdd9531-5c3c-429c-9f0b-e3ed969dda2a admin admin] The token cache is being invalidate because project 5b0a49ac394f4714974a045d52784643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:48:37.592169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-1cdd9531-5c3c-429c-9f0b-e3ed969dda2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:37.592169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-1cdd9531-5c3c-429c-9f0b-e3ed969dda2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:48:37.593531 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1228/2492] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:48:37 2022] DELETE /identity/v3/projects/5b0a49ac394f4714974a045d52784643 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:48:46.699154 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:48:47.586670 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:48:54.436954 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ea66c-e5fa-4409-ac4e-5539f50d59a2 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:54.437475 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ea66c-e5fa-4409-ac4e-5539f50d59a2 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:54.437583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ea66c-e5fa-4409-ac4e-5539f50d59a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:54.474161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-823ea66c-e5fa-4409-ac4e-5539f50d59a2 None None] MFA Rules not processed for user `5ec758ef106b49f4985845b3c106f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:48:54.475728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-823ea66c-e5fa-4409-ac4e-5539f50d59a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:54.574228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1265/2493] 10.222.0.40 () {58 vars in 967 bytes} [Tue Jul 12 14:48:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:48:54.806291 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd9531-5c3c-429c-9f0b-e3ed969dda2a admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:48:54.808301 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-1cdd9531-5c3c-429c-9f0b-e3ed969dda2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:54.937953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd9531-5c3c-429c-9f0b-e3ed969dda2a admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:48:54.948729 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f7ec0-3982-4748-8236-deb29b8158fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad12085f356a4f0682bb70ad231a10b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:48:54.950039 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f7ec0-3982-4748-8236-deb29b8158fb service swift] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:54.950612 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f7ec0-3982-4748-8236-deb29b8158fb service swift] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:54.951122 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f7ec0-3982-4748-8236-deb29b8158fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:54.967764 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f7ec0-3982-4748-8236-deb29b8158fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:48:54.969010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f7ec0-3982-4748-8236-deb29b8158fb service swift] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:48:54.980193 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1229/2494] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Jul 12 14:48:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:48:56.490640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ea66c-e5fa-4409-ac4e-5539f50d59a2 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:48:56.493426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-823ea66c-e5fa-4409-ac4e-5539f50d59a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:56.565808 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ea66c-e5fa-4409-ac4e-5539f50d59a2 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:48:56.569945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8c709-559e-4b8f-92cb-f323909a8349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:48:56.571659 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8c709-559e-4b8f-92cb-f323909a8349 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:48:56.571912 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8c709-559e-4b8f-92cb-f323909a8349 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:48:56.572185 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8c709-559e-4b8f-92cb-f323909a8349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:48:56.574190 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b0f8c709-559e-4b8f-92cb-f323909a8349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:48:56.665039 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8c709-559e-4b8f-92cb-f323909a8349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:48:56.666433 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8c709-559e-4b8f-92cb-f323909a8349 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:48:56.679078 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1266/2495] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:49:02.173738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f7ec0-3982-4748-8236-deb29b8158fb service swift] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:02.176504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ba6f7ec0-3982-4748-8236-deb29b8158fb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:02.297782 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f7ec0-3982-4748-8236-deb29b8158fb service swift] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:02.311799 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae6712-5454-45cd-87c0-d9b7a77427ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a3704fdba154f13ad3bf8ac00c916c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:02.312670 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae6712-5454-45cd-87c0-d9b7a77427ce service placement] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:02.313117 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae6712-5454-45cd-87c0-d9b7a77427ce service placement] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:02.313540 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae6712-5454-45cd-87c0-d9b7a77427ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:02.316151 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b5ae6712-5454-45cd-87c0-d9b7a77427ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:02.332135 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae6712-5454-45cd-87c0-d9b7a77427ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:02.333828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae6712-5454-45cd-87c0-d9b7a77427ce service placement] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:02.350142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1230/2496] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:49:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:49:06.674019 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=79 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:08.468344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8c709-559e-4b8f-92cb-f323909a8349 service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:08.470450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b0f8c709-559e-4b8f-92cb-f323909a8349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:08.488102 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8c709-559e-4b8f-92cb-f323909a8349 service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:08.494255 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4443d9-c91d-47a8-b843-0e13b0b42f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:08.495329 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4443d9-c91d-47a8-b843-0e13b0b42f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:08.495689 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4443d9-c91d-47a8-b843-0e13b0b42f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:08.496004 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4443d9-c91d-47a8-b843-0e13b0b42f13 admin admin] PATH_INFO: `/v3/users/582f3de5b2e8433da1300551829fc401` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:08.497487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4443d9-c91d-47a8-b843-0e13b0b42f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=582f3de5b2e8433da1300551829fc401)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:08.500045 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4443d9-c91d-47a8-b843-0e13b0b42f13 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:08.705536 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0c4443d9-c91d-47a8-b843-0e13b0b42f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '582f3de5b2e8433da1300551829fc401'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:08.724418 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0c4443d9-c91d-47a8-b843-0e13b0b42f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '582f3de5b2e8433da1300551829fc401'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:08.746372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae6712-5454-45cd-87c0-d9b7a77427ce service placement] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:08.762610 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae6712-5454-45cd-87c0-d9b7a77427ce service placement] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:08.769271 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b153df-fa4a-4008-8f84-40427e572470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:08.770427 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b153df-fa4a-4008-8f84-40427e572470 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:08.770921 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b153df-fa4a-4008-8f84-40427e572470 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:08.771557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b153df-fa4a-4008-8f84-40427e572470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:08.775258 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-71b153df-fa4a-4008-8f84-40427e572470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:08.791849 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b153df-fa4a-4008-8f84-40427e572470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:08.794619 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b153df-fa4a-4008-8f84-40427e572470 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:08.806047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1231/2497] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:49:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:49:08.815690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0c4443d9-c91d-47a8-b843-0e13b0b42f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '582f3de5b2e8433da1300551829fc401'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:08.815690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0c4443d9-c91d-47a8-b843-0e13b0b42f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '582f3de5b2e8433da1300551829fc401'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:08.828881 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-0c4443d9-c91d-47a8-b843-0e13b0b42f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '582f3de5b2e8433da1300551829fc401'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:08.847966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1267/2498] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:49:08 2022] DELETE /identity/v3/users/582f3de5b2e8433da1300551829fc401 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:49:09.247745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b153df-fa4a-4008-8f84-40427e572470 service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:09.271735 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b153df-fa4a-4008-8f84-40427e572470 service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:09.352738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f99ef6-4f47-4713-88bd-32c65b324da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:09.354253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f99ef6-4f47-4713-88bd-32c65b324da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:09.354854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f99ef6-4f47-4713-88bd-32c65b324da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:09.355243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f99ef6-4f47-4713-88bd-32c65b324da8 admin admin] PATH_INFO: `/v3/projects/57f1c80543064e2a9cefff4372d84fbe` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:09.357919 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f99ef6-4f47-4713-88bd-32c65b324da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f1c80543064e2a9cefff4372d84fbe)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:09.367938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f99ef6-4f47-4713-88bd-32c65b324da8 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:09.378456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:09.505611 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-63f99ef6-4f47-4713-88bd-32c65b324da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f1c80543064e2a9cefff4372d84fbe', 'request_id': 'req-63f99ef6-4f47-4713-88bd-32c65b324da8'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:09.513621 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-63f99ef6-4f47-4713-88bd-32c65b324da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f1c80543064e2a9cefff4372d84fbe', 'request_id': 'req-63f99ef6-4f47-4713-88bd-32c65b324da8'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:09.522394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-63f99ef6-4f47-4713-88bd-32c65b324da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f1c80543064e2a9cefff4372d84fbe', 'request_id': 'req-63f99ef6-4f47-4713-88bd-32c65b324da8'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:09.605876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-63f99ef6-4f47-4713-88bd-32c65b324da8 admin admin] The token cache is being invalidate because project 57f1c80543064e2a9cefff4372d84fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:49:09.606339 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-63f99ef6-4f47-4713-88bd-32c65b324da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:09.607090 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-63f99ef6-4f47-4713-88bd-32c65b324da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:09.608888 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1232/2499] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:49:09 2022] DELETE /identity/v3/projects/57f1c80543064e2a9cefff4372d84fbe => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:49:09.613089 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4443d9-c91d-47a8-b843-0e13b0b42f13 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:09.614606 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0c4443d9-c91d-47a8-b843-0e13b0b42f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:09.630126 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4443d9-c91d-47a8-b843-0e13b0b42f13 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:09.706487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1af6f-ad7c-4689-aca9-3f070744584b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:09.708175 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1af6f-ad7c-4689-aca9-3f070744584b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:09.708672 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1af6f-ad7c-4689-aca9-3f070744584b admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:09.709240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1af6f-ad7c-4689-aca9-3f070744584b admin admin] PATH_INFO: `/v3/users/12900a1818d5493a9f51f44dbd6999c4` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:09.711990 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1af6f-ad7c-4689-aca9-3f070744584b admin admin] RBAC: Authorizing `identity:delete_user(user_id=12900a1818d5493a9f51f44dbd6999c4)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:09.716020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1af6f-ad7c-4689-aca9-3f070744584b admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:09.994495 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-d8f1af6f-ad7c-4689-aca9-3f070744584b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12900a1818d5493a9f51f44dbd6999c4'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:10.026096 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-d8f1af6f-ad7c-4689-aca9-3f070744584b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12900a1818d5493a9f51f44dbd6999c4'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:10.140265 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-d8f1af6f-ad7c-4689-aca9-3f070744584b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12900a1818d5493a9f51f44dbd6999c4'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:10.140934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-d8f1af6f-ad7c-4689-aca9-3f070744584b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12900a1818d5493a9f51f44dbd6999c4'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:10.144678 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:10.154862 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-d8f1af6f-ad7c-4689-aca9-3f070744584b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12900a1818d5493a9f51f44dbd6999c4'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:10.168275 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1268/2500] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:49:09 2022] DELETE /identity/v3/users/12900a1818d5493a9f51f44dbd6999c4 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:49:10.546144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f99ef6-4f47-4713-88bd-32c65b324da8 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:10.549181 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-63f99ef6-4f47-4713-88bd-32c65b324da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:10.582511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f99ef6-4f47-4713-88bd-32c65b324da8 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:10.690686 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f3e18-2701-4c46-a4bf-2c4590dcb72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:10.691783 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f3e18-2701-4c46-a4bf-2c4590dcb72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:10.692169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f3e18-2701-4c46-a4bf-2c4590dcb72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:10.692589 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f3e18-2701-4c46-a4bf-2c4590dcb72d admin admin] PATH_INFO: `/v3/projects/41617e5dd61241c8b6dd8904fb6d9750` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:10.694341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f3e18-2701-4c46-a4bf-2c4590dcb72d admin admin] RBAC: Authorizing `identity:delete_project(project_id=41617e5dd61241c8b6dd8904fb6d9750)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:10.697892 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f3e18-2701-4c46-a4bf-2c4590dcb72d admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:10.857783 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-363f3e18-2701-4c46-a4bf-2c4590dcb72d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41617e5dd61241c8b6dd8904fb6d9750', 'request_id': 'req-363f3e18-2701-4c46-a4bf-2c4590dcb72d'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:10.871821 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-363f3e18-2701-4c46-a4bf-2c4590dcb72d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41617e5dd61241c8b6dd8904fb6d9750', 'request_id': 'req-363f3e18-2701-4c46-a4bf-2c4590dcb72d'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:10.890468 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-363f3e18-2701-4c46-a4bf-2c4590dcb72d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41617e5dd61241c8b6dd8904fb6d9750', 'request_id': 'req-363f3e18-2701-4c46-a4bf-2c4590dcb72d'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:11.066984 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-363f3e18-2701-4c46-a4bf-2c4590dcb72d admin admin] The token cache is being invalidate because project 41617e5dd61241c8b6dd8904fb6d9750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:49:11.067341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-363f3e18-2701-4c46-a4bf-2c4590dcb72d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:11.068008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-363f3e18-2701-4c46-a4bf-2c4590dcb72d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:11.070648 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1233/2501] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:49:10 2022] DELETE /identity/v3/projects/41617e5dd61241c8b6dd8904fb6d9750 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:49:13.502373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1af6f-ad7c-4689-aca9-3f070744584b admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:13.510209 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d8f1af6f-ad7c-4689-aca9-3f070744584b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:13.534273 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1af6f-ad7c-4689-aca9-3f070744584b admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:13.605926 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d906d-c994-4c55-bda3-2b629e1182a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:13.606927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d906d-c994-4c55-bda3-2b629e1182a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:13.607216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d906d-c994-4c55-bda3-2b629e1182a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:13.607534 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d906d-c994-4c55-bda3-2b629e1182a7 admin admin] PATH_INFO: `/v3/users/abb27a4eecd14ab89a1d349fa3bdc0e3` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:13.608928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d906d-c994-4c55-bda3-2b629e1182a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb27a4eecd14ab89a1d349fa3bdc0e3)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:13.610904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d906d-c994-4c55-bda3-2b629e1182a7 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:13.840993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dc0d906d-c994-4c55-bda3-2b629e1182a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb27a4eecd14ab89a1d349fa3bdc0e3'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:13.857020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dc0d906d-c994-4c55-bda3-2b629e1182a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb27a4eecd14ab89a1d349fa3bdc0e3'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:13.931892 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dc0d906d-c994-4c55-bda3-2b629e1182a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb27a4eecd14ab89a1d349fa3bdc0e3'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:13.932545 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dc0d906d-c994-4c55-bda3-2b629e1182a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb27a4eecd14ab89a1d349fa3bdc0e3'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:13.941143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dc0d906d-c994-4c55-bda3-2b629e1182a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb27a4eecd14ab89a1d349fa3bdc0e3'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:13.948989 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1269/2502] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:49:13 2022] DELETE /identity/v3/users/abb27a4eecd14ab89a1d349fa3bdc0e3 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:49:14.281070 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f3e18-2701-4c46-a4bf-2c4590dcb72d admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:14.283226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-363f3e18-2701-4c46-a4bf-2c4590dcb72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:14.302701 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f3e18-2701-4c46-a4bf-2c4590dcb72d admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:14.341975 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:14.381324 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006564fa-4c2a-4d45-9515-f7468e78181c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:14.382746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006564fa-4c2a-4d45-9515-f7468e78181c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:14.383106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006564fa-4c2a-4d45-9515-f7468e78181c admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:14.383666 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006564fa-4c2a-4d45-9515-f7468e78181c admin admin] PATH_INFO: `/v3/projects/1cd64aef2efa46cea9056b3310da3638` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:14.387676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006564fa-4c2a-4d45-9515-f7468e78181c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cd64aef2efa46cea9056b3310da3638)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:14.389065 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006564fa-4c2a-4d45-9515-f7468e78181c admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:14.510843 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-006564fa-4c2a-4d45-9515-f7468e78181c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cd64aef2efa46cea9056b3310da3638', 'request_id': 'req-006564fa-4c2a-4d45-9515-f7468e78181c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:14.518622 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-006564fa-4c2a-4d45-9515-f7468e78181c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cd64aef2efa46cea9056b3310da3638', 'request_id': 'req-006564fa-4c2a-4d45-9515-f7468e78181c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:14.527402 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-006564fa-4c2a-4d45-9515-f7468e78181c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cd64aef2efa46cea9056b3310da3638', 'request_id': 'req-006564fa-4c2a-4d45-9515-f7468e78181c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:14.586653 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-006564fa-4c2a-4d45-9515-f7468e78181c admin admin] The token cache is being invalidate because project 1cd64aef2efa46cea9056b3310da3638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:49:14.587013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-006564fa-4c2a-4d45-9515-f7468e78181c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:14.587823 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-006564fa-4c2a-4d45-9515-f7468e78181c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:14.589599 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1234/2503] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:49:14 2022] DELETE /identity/v3/projects/1cd64aef2efa46cea9056b3310da3638 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:49:14.595498 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d634a-18da-4f65-bc68-00c9ce81289c None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:14.596113 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d634a-18da-4f65-bc68-00c9ce81289c None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:14.596113 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d634a-18da-4f65-bc68-00c9ce81289c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:14.616958 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-860d634a-18da-4f65-bc68-00c9ce81289c None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:49:14.618389 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-860d634a-18da-4f65-bc68-00c9ce81289c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:14.721425 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1270/2504] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:49:14.731625 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8c935-6d8d-41ea-848d-e2cdd12dcb65 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:14.731978 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8c935-6d8d-41ea-848d-e2cdd12dcb65 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:14.732300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8c935-6d8d-41ea-848d-e2cdd12dcb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:14.753950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-34c8c935-6d8d-41ea-848d-e2cdd12dcb65 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:49:14.757441 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-34c8c935-6d8d-41ea-848d-e2cdd12dcb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:14.764061 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1235/2505] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:49:14.769599 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d634a-18da-4f65-bc68-00c9ce81289c None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:14.788345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d634a-18da-4f65-bc68-00c9ce81289c None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:14.796900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d69a2c-7538-409d-bbcc-20b3ac48c54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:14.798154 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d69a2c-7538-409d-bbcc-20b3ac48c54c admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:14.798644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d69a2c-7538-409d-bbcc-20b3ac48c54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:14.799148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d69a2c-7538-409d-bbcc-20b3ac48c54c admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:14.800418 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d69a2c-7538-409d-bbcc-20b3ac48c54c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:49:14.800925 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d69a2c-7538-409d-bbcc-20b3ac48c54c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:14.804697 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d69a2c-7538-409d-bbcc-20b3ac48c54c admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:14.813702 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:14.821095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1271/2506] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:49:14.827027 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8c935-6d8d-41ea-848d-e2cdd12dcb65 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:14.844022 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8c935-6d8d-41ea-848d-e2cdd12dcb65 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:14.852581 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b77ec-c710-47a8-94c3-e8822053ee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:14.853741 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b77ec-c710-47a8-94c3-e8822053ee95 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:14.854236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b77ec-c710-47a8-94c3-e8822053ee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:14.854713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b77ec-c710-47a8-94c3-e8822053ee95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:14.856026 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b77ec-c710-47a8-94c3-e8822053ee95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:14.859855 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b77ec-c710-47a8-94c3-e8822053ee95 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:14.953902 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1236/2507] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:49:14 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:49:14.958621 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d69a2c-7538-409d-bbcc-20b3ac48c54c admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:14.970513 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d69a2c-7538-409d-bbcc-20b3ac48c54c admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:15.041810 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11192eb-97f1-4006-9a1c-0e8e83de73df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:15.042409 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11192eb-97f1-4006-9a1c-0e8e83de73df admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:15.042696 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11192eb-97f1-4006-9a1c-0e8e83de73df admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:15.042975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11192eb-97f1-4006-9a1c-0e8e83de73df admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:15.043739 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11192eb-97f1-4006-9a1c-0e8e83de73df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:15.045726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11192eb-97f1-4006-9a1c-0e8e83de73df admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:15.124622 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1272/2508] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:49:14 2022] POST /identity/v3/users => generated 284 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:49:15.129237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b77ec-c710-47a8-94c3-e8822053ee95 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:15.140949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b77ec-c710-47a8-94c3-e8822053ee95 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:15.147071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de2a2b-df2c-4569-bd85-c4cd8ed7152b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:15.148088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de2a2b-df2c-4569-bd85-c4cd8ed7152b admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:15.148488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de2a2b-df2c-4569-bd85-c4cd8ed7152b admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:15.148862 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de2a2b-df2c-4569-bd85-c4cd8ed7152b admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:15.150099 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de2a2b-df2c-4569-bd85-c4cd8ed7152b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:15.151930 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de2a2b-df2c-4569-bd85-c4cd8ed7152b admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:15.165839 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1237/2509] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:49:15.171712 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11192eb-97f1-4006-9a1c-0e8e83de73df admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:15.186561 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11192eb-97f1-4006-9a1c-0e8e83de73df admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:15.194489 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662d9a6-5cba-4da0-b560-3fcf68dddee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:15.196133 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662d9a6-5cba-4da0-b560-3fcf68dddee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:15.196610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662d9a6-5cba-4da0-b560-3fcf68dddee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:15.197094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662d9a6-5cba-4da0-b560-3fcf68dddee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:15.198503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662d9a6-5cba-4da0-b560-3fcf68dddee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:15.201499 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662d9a6-5cba-4da0-b560-3fcf68dddee1 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:15.222037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1273/2510] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:49:15.227306 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de2a2b-df2c-4569-bd85-c4cd8ed7152b admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:15.238435 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de2a2b-df2c-4569-bd85-c4cd8ed7152b admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:15.244067 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133fa2e-272b-4b2d-aea0-409ca3a01c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:15.245028 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133fa2e-272b-4b2d-aea0-409ca3a01c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:15.245316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133fa2e-272b-4b2d-aea0-409ca3a01c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:15.245601 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133fa2e-272b-4b2d-aea0-409ca3a01c84 admin admin] PATH_INFO: `/v3/projects/8f820c3ae9c14828983b7cfc2373d3c8/users/ff7af75fa00f4deba40da4175b7a5159/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:15.264672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133fa2e-272b-4b2d-aea0-409ca3a01c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f820c3ae9c14828983b7cfc2373d3c8, user_id=ff7af75fa00f4deba40da4175b7a5159, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:15.268360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133fa2e-272b-4b2d-aea0-409ca3a01c84 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:15.375708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1238/2511] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:49:15 2022] PUT /identity/v3/projects/8f820c3ae9c14828983b7cfc2373d3c8/users/ff7af75fa00f4deba40da4175b7a5159/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:49:15.387654 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90792c-3ec8-4dbe-bd0c-abeb6604bd6a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:15.387944 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90792c-3ec8-4dbe-bd0c-abeb6604bd6a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:15.388231 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90792c-3ec8-4dbe-bd0c-abeb6604bd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:15.422814 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-fa90792c-3ec8-4dbe-bd0c-abeb6604bd6a None None] MFA Rules not processed for user `ff7af75fa00f4deba40da4175b7a5159`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:49:15.424194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-fa90792c-3ec8-4dbe-bd0c-abeb6604bd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:15.507570 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1274/2512] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:49:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:49:15.519819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133fa2e-272b-4b2d-aea0-409ca3a01c84 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:15.523426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-e133fa2e-272b-4b2d-aea0-409ca3a01c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:15.615402 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133fa2e-272b-4b2d-aea0-409ca3a01c84 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:15.621981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcf328-9ceb-4f71-b9be-9e76346e87d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:15.623113 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcf328-9ceb-4f71-b9be-9e76346e87d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:15.623641 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcf328-9ceb-4f71-b9be-9e76346e87d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:15.624127 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcf328-9ceb-4f71-b9be-9e76346e87d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:15.636440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:15.641349 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcf328-9ceb-4f71-b9be-9e76346e87d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:15.644179 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcf328-9ceb-4f71-b9be-9e76346e87d0 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:15.661608 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1239/2513] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:49:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:49:25.503883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:25.742995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:29.127757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90792c-3ec8-4dbe-bd0c-abeb6604bd6a None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:29.241434 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90792c-3ec8-4dbe-bd0c-abeb6604bd6a None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:29.249898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7d0a3-0e74-413a-add5-caf2933358aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:29.251470 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7d0a3-0e74-413a-add5-caf2933358aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:29.251965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7d0a3-0e74-413a-add5-caf2933358aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:29.252500 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7d0a3-0e74-413a-add5-caf2933358aa admin admin] PATH_INFO: `/v3/users/ff7af75fa00f4deba40da4175b7a5159` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:29.254662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7d0a3-0e74-413a-add5-caf2933358aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff7af75fa00f4deba40da4175b7a5159)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:29.257931 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7d0a3-0e74-413a-add5-caf2933358aa admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:29.478126 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1bc7d0a3-0e74-413a-add5-caf2933358aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff7af75fa00f4deba40da4175b7a5159'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:29.493684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1bc7d0a3-0e74-413a-add5-caf2933358aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff7af75fa00f4deba40da4175b7a5159'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:29.562417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1bc7d0a3-0e74-413a-add5-caf2933358aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff7af75fa00f4deba40da4175b7a5159'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:29.563050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1bc7d0a3-0e74-413a-add5-caf2933358aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff7af75fa00f4deba40da4175b7a5159'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:29.573868 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1bc7d0a3-0e74-413a-add5-caf2933358aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff7af75fa00f4deba40da4175b7a5159'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:29.581483 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1275/2514] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:49:29 2022] DELETE /identity/v3/users/ff7af75fa00f4deba40da4175b7a5159 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:49:29.586937 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23b299-8f63-4e64-951e-ae4a1953d633 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:29.587665 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23b299-8f63-4e64-951e-ae4a1953d633 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:29.587665 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23b299-8f63-4e64-951e-ae4a1953d633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:29.606952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-4e23b299-8f63-4e64-951e-ae4a1953d633 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:49:29.608429 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-4e23b299-8f63-4e64-951e-ae4a1953d633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:29.681897 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1240/2515] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:49:29.693139 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7d0a3-0e74-413a-add5-caf2933358aa admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:29.699309 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1bc7d0a3-0e74-413a-add5-caf2933358aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:29.780756 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7d0a3-0e74-413a-add5-caf2933358aa admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:29.785178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2abaa0-16bc-4ccc-9f5d-45e4bfe9a1f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:29.785922 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2abaa0-16bc-4ccc-9f5d-45e4bfe9a1f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:29.786314 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2abaa0-16bc-4ccc-9f5d-45e4bfe9a1f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:29.786681 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2abaa0-16bc-4ccc-9f5d-45e4bfe9a1f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:29.798336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2abaa0-16bc-4ccc-9f5d-45e4bfe9a1f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:29.799856 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2abaa0-16bc-4ccc-9f5d-45e4bfe9a1f1 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:29.812362 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1276/2516] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:49:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:49:30.326474 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23b299-8f63-4e64-951e-ae4a1953d633 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:30.333553 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-4e23b299-8f63-4e64-951e-ae4a1953d633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:30.343476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23b299-8f63-4e64-951e-ae4a1953d633 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:30.351909 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b4000-6f6b-4e67-b747-f8a6b1bf173d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:30.353636 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b4000-6f6b-4e67-b747-f8a6b1bf173d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:30.354231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b4000-6f6b-4e67-b747-f8a6b1bf173d admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:30.354787 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b4000-6f6b-4e67-b747-f8a6b1bf173d admin admin] PATH_INFO: `/v3/projects/8f820c3ae9c14828983b7cfc2373d3c8` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:30.357336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b4000-6f6b-4e67-b747-f8a6b1bf173d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f820c3ae9c14828983b7cfc2373d3c8)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:30.361188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b4000-6f6b-4e67-b747-f8a6b1bf173d admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:30.544132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-086b4000-6f6b-4e67-b747-f8a6b1bf173d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f820c3ae9c14828983b7cfc2373d3c8', 'request_id': 'req-086b4000-6f6b-4e67-b747-f8a6b1bf173d'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:30.554328 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-086b4000-6f6b-4e67-b747-f8a6b1bf173d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f820c3ae9c14828983b7cfc2373d3c8', 'request_id': 'req-086b4000-6f6b-4e67-b747-f8a6b1bf173d'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:30.566971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-086b4000-6f6b-4e67-b747-f8a6b1bf173d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f820c3ae9c14828983b7cfc2373d3c8', 'request_id': 'req-086b4000-6f6b-4e67-b747-f8a6b1bf173d'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:30.660207 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-086b4000-6f6b-4e67-b747-f8a6b1bf173d admin admin] The token cache is being invalidate because project 8f820c3ae9c14828983b7cfc2373d3c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:49:30.660894 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-086b4000-6f6b-4e67-b747-f8a6b1bf173d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:30.661151 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-086b4000-6f6b-4e67-b747-f8a6b1bf173d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:30.664430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1241/2517] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:49:30 2022] DELETE /identity/v3/projects/8f820c3ae9c14828983b7cfc2373d3c8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:49:30.671201 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e5c83-8a45-465a-b7c7-049957436d2b None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:30.671804 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e5c83-8a45-465a-b7c7-049957436d2b None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:30.672204 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e5c83-8a45-465a-b7c7-049957436d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:30.698161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-0e6e5c83-8a45-465a-b7c7-049957436d2b None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:49:30.699757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0e6e5c83-8a45-465a-b7c7-049957436d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:30.720901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:30.771124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1277/2518] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:49:30.780134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30746d5d-fc5f-479c-975d-09c3820c0bd7 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:30.780423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30746d5d-fc5f-479c-975d-09c3820c0bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:30.780703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30746d5d-fc5f-479c-975d-09c3820c0bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:30.802471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-30746d5d-fc5f-479c-975d-09c3820c0bd7 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:49:30.803755 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-30746d5d-fc5f-479c-975d-09c3820c0bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:30.812521 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1242/2519] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:49:30.817268 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e5c83-8a45-465a-b7c7-049957436d2b None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:30.830049 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e5c83-8a45-465a-b7c7-049957436d2b None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:30.835888 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d81df-a953-4396-97b8-5bd948ec74ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:30.838574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d81df-a953-4396-97b8-5bd948ec74ad admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:30.838574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d81df-a953-4396-97b8-5bd948ec74ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:30.838574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d81df-a953-4396-97b8-5bd948ec74ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:30.838574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d81df-a953-4396-97b8-5bd948ec74ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:49:30.838944 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d81df-a953-4396-97b8-5bd948ec74ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:30.840738 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d81df-a953-4396-97b8-5bd948ec74ad admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:30.855005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1278/2520] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:49:30.859732 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30746d5d-fc5f-479c-975d-09c3820c0bd7 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:30.870264 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30746d5d-fc5f-479c-975d-09c3820c0bd7 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:30.883021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006ef09-b998-4981-a729-ec3d91bcfc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:30.890647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006ef09-b998-4981-a729-ec3d91bcfc69 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:30.890647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006ef09-b998-4981-a729-ec3d91bcfc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:30.890647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006ef09-b998-4981-a729-ec3d91bcfc69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:30.890647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006ef09-b998-4981-a729-ec3d91bcfc69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:30.890647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006ef09-b998-4981-a729-ec3d91bcfc69 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:30.999634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1243/2521] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:49:30 2022] POST /identity/v3/projects => generated 357 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:49:31.004303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d81df-a953-4396-97b8-5bd948ec74ad admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:31.015042 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d81df-a953-4396-97b8-5bd948ec74ad admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:31.083650 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846591e-7b93-4f07-b24e-d745e4088a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:31.084331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846591e-7b93-4f07-b24e-d745e4088a2e admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:31.084611 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846591e-7b93-4f07-b24e-d745e4088a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:31.084888 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846591e-7b93-4f07-b24e-d745e4088a2e admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:31.086122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846591e-7b93-4f07-b24e-d745e4088a2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:31.088091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846591e-7b93-4f07-b24e-d745e4088a2e admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:31.174542 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1279/2522] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:49:31 2022] POST /identity/v3/users => generated 279 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:49:31.179338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006ef09-b998-4981-a729-ec3d91bcfc69 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:31.190454 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006ef09-b998-4981-a729-ec3d91bcfc69 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:31.196051 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50c416-6bce-40f0-8c99-51832bb1896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:31.196768 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50c416-6bce-40f0-8c99-51832bb1896a admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:31.197044 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50c416-6bce-40f0-8c99-51832bb1896a admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:31.197327 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50c416-6bce-40f0-8c99-51832bb1896a admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:31.198081 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50c416-6bce-40f0-8c99-51832bb1896a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:31.199773 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50c416-6bce-40f0-8c99-51832bb1896a admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:31.212893 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1244/2523] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:49:31.217435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846591e-7b93-4f07-b24e-d745e4088a2e admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:31.229214 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846591e-7b93-4f07-b24e-d745e4088a2e admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:31.234124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c31550-7361-49c3-8a1a-f23e83598bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:31.234807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c31550-7361-49c3-8a1a-f23e83598bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:31.235089 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c31550-7361-49c3-8a1a-f23e83598bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:31.235397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c31550-7361-49c3-8a1a-f23e83598bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:31.236155 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c31550-7361-49c3-8a1a-f23e83598bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:31.237801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c31550-7361-49c3-8a1a-f23e83598bc5 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:31.249539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1280/2524] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:49:31.254162 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50c416-6bce-40f0-8c99-51832bb1896a admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:31.264818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50c416-6bce-40f0-8c99-51832bb1896a admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:31.270090 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b16ad8-2411-4f57-9ed9-4e6d0d96b956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:31.271007 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b16ad8-2411-4f57-9ed9-4e6d0d96b956 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:31.271353 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b16ad8-2411-4f57-9ed9-4e6d0d96b956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:31.271637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b16ad8-2411-4f57-9ed9-4e6d0d96b956 admin admin] PATH_INFO: `/v3/projects/0d1359bf3ef14a8e87a6634ebb7c1adf/users/6323153a2a5e4c9c91b91f5a53a71d87/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:31.290282 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b16ad8-2411-4f57-9ed9-4e6d0d96b956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1359bf3ef14a8e87a6634ebb7c1adf, user_id=6323153a2a5e4c9c91b91f5a53a71d87, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:31.293042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b16ad8-2411-4f57-9ed9-4e6d0d96b956 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:31.374793 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1245/2525] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:49:31 2022] PUT /identity/v3/projects/0d1359bf3ef14a8e87a6634ebb7c1adf/users/6323153a2a5e4c9c91b91f5a53a71d87/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:49:31.387438 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd31f7a-81dd-46ac-9a7e-5aaf9026d0eb None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:31.387724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd31f7a-81dd-46ac-9a7e-5aaf9026d0eb None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:31.388006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd31f7a-81dd-46ac-9a7e-5aaf9026d0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:31.419873 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-2dd31f7a-81dd-46ac-9a7e-5aaf9026d0eb None None] MFA Rules not processed for user `6323153a2a5e4c9c91b91f5a53a71d87`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:49:31.421104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-2dd31f7a-81dd-46ac-9a7e-5aaf9026d0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:31.499198 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1281/2526] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:49:31.504336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b16ad8-2411-4f57-9ed9-4e6d0d96b956 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:31.530674 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:31.580412 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b16ad8-2411-4f57-9ed9-4e6d0d96b956 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:31.587861 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce23d8-56b9-4536-bad9-7c3381ee51c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:31.588643 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce23d8-56b9-4536-bad9-7c3381ee51c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:31.588930 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce23d8-56b9-4536-bad9-7c3381ee51c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:31.589208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce23d8-56b9-4536-bad9-7c3381ee51c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:31.589908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce23d8-56b9-4536-bad9-7c3381ee51c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:31.592074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce23d8-56b9-4536-bad9-7c3381ee51c7 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:31.679645 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1246/2527] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:49:31 2022] POST /identity/v3/projects => generated 353 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:49:31.685650 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd31f7a-81dd-46ac-9a7e-5aaf9026d0eb None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:31.698716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd31f7a-81dd-46ac-9a7e-5aaf9026d0eb None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:31.714684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:31.769096 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9083471-8318-44d6-a83c-a1ff1f553393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:31.769744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9083471-8318-44d6-a83c-a1ff1f553393 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:31.770070 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9083471-8318-44d6-a83c-a1ff1f553393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:31.770402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9083471-8318-44d6-a83c-a1ff1f553393 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:31.771224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9083471-8318-44d6-a83c-a1ff1f553393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:31.773543 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9083471-8318-44d6-a83c-a1ff1f553393 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:31.855429 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1282/2528] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:49:31 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:49:31.859612 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce23d8-56b9-4536-bad9-7c3381ee51c7 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:31.872224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce23d8-56b9-4536-bad9-7c3381ee51c7 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:31.877917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e45754-b813-4ead-be8e-8712db05ff1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:31.878767 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e45754-b813-4ead-be8e-8712db05ff1a admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:31.879155 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e45754-b813-4ead-be8e-8712db05ff1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:31.879600 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e45754-b813-4ead-be8e-8712db05ff1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:31.880876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e45754-b813-4ead-be8e-8712db05ff1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:31.883443 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e45754-b813-4ead-be8e-8712db05ff1a admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:31.895128 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1247/2529] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:49:31.900243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9083471-8318-44d6-a83c-a1ff1f553393 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:31.911633 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9083471-8318-44d6-a83c-a1ff1f553393 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:31.916945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc639e55-1d8a-453d-b5a0-79ceb62d927e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:31.917942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc639e55-1d8a-453d-b5a0-79ceb62d927e admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:31.918359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc639e55-1d8a-453d-b5a0-79ceb62d927e admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:31.918837 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc639e55-1d8a-453d-b5a0-79ceb62d927e admin admin] PATH_INFO: `/v3/projects/b50f96ce12984dd9a35634327b0f9f9b/users/3fa42afba1ec48438c0855160902911d/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:31.938258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc639e55-1d8a-453d-b5a0-79ceb62d927e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50f96ce12984dd9a35634327b0f9f9b, user_id=3fa42afba1ec48438c0855160902911d, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:31.941271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc639e55-1d8a-453d-b5a0-79ceb62d927e admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:32.030763 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1283/2530] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:49:31 2022] PUT /identity/v3/projects/b50f96ce12984dd9a35634327b0f9f9b/users/3fa42afba1ec48438c0855160902911d/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:49:32.035725 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e45754-b813-4ead-be8e-8712db05ff1a admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:32.048112 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e45754-b813-4ead-be8e-8712db05ff1a admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:32.116389 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6eee5-15ee-48f4-b2df-c8447935820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:32.117702 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6eee5-15ee-48f4-b2df-c8447935820b admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:32.117986 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6eee5-15ee-48f4-b2df-c8447935820b admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:32.118266 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6eee5-15ee-48f4-b2df-c8447935820b admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:32.119011 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6eee5-15ee-48f4-b2df-c8447935820b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:32.120714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6eee5-15ee-48f4-b2df-c8447935820b admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:32.133828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1248/2531] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:49:32.140136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc639e55-1d8a-453d-b5a0-79ceb62d927e admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:32.157688 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc639e55-1d8a-453d-b5a0-79ceb62d927e admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:32.166848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776f9f0-a5c9-476f-b8fd-a81fd9980b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:32.168415 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776f9f0-a5c9-476f-b8fd-a81fd9980b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:32.168878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776f9f0-a5c9-476f-b8fd-a81fd9980b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:32.169362 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776f9f0-a5c9-476f-b8fd-a81fd9980b82 admin admin] PATH_INFO: `/v3/projects/b50f96ce12984dd9a35634327b0f9f9b/users/3fa42afba1ec48438c0855160902911d/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:32.173166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776f9f0-a5c9-476f-b8fd-a81fd9980b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50f96ce12984dd9a35634327b0f9f9b, user_id=3fa42afba1ec48438c0855160902911d, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:32.178153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776f9f0-a5c9-476f-b8fd-a81fd9980b82 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:32.198168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1284/2532] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:49:32 2022] PUT /identity/v3/projects/b50f96ce12984dd9a35634327b0f9f9b/users/3fa42afba1ec48438c0855160902911d/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:49:32.217216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eb935-42c6-4ca2-894f-8e0bc7c82fee None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:32.217734 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eb935-42c6-4ca2-894f-8e0bc7c82fee None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:32.218217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eb935-42c6-4ca2-894f-8e0bc7c82fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:32.266952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-961eb935-42c6-4ca2-894f-8e0bc7c82fee None None] MFA Rules not processed for user `3fa42afba1ec48438c0855160902911d`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:49:32.268608 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-961eb935-42c6-4ca2-894f-8e0bc7c82fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:32.349612 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1249/2533] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:49:32 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:49:32.364841 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776f9f0-a5c9-476f-b8fd-a81fd9980b82 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:32.367861 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1776f9f0-a5c9-476f-b8fd-a81fd9980b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:32.434288 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776f9f0-a5c9-476f-b8fd-a81fd9980b82 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:32.438143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48a1d9-73af-4d29-bbcf-f8ff4a638970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:32.439013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48a1d9-73af-4d29-bbcf-f8ff4a638970 service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:32.439197 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48a1d9-73af-4d29-bbcf-f8ff4a638970 service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:32.439629 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48a1d9-73af-4d29-bbcf-f8ff4a638970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:32.451487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48a1d9-73af-4d29-bbcf-f8ff4a638970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:32.452961 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48a1d9-73af-4d29-bbcf-f8ff4a638970 service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:32.464725 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1285/2534] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:49:32 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:49:32.667564 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eb935-42c6-4ca2-894f-8e0bc7c82fee None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:32.678597 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eb935-42c6-4ca2-894f-8e0bc7c82fee None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:32.683705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823024e-0a55-4ce1-b328-24b7392b0bc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:32.684709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823024e-0a55-4ce1-b328-24b7392b0bc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:32.685041 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823024e-0a55-4ce1-b328-24b7392b0bc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:32.685385 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823024e-0a55-4ce1-b328-24b7392b0bc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:32.700586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:32.755828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823024e-0a55-4ce1-b328-24b7392b0bc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:32.757381 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823024e-0a55-4ce1-b328-24b7392b0bc0 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:32.768522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1250/2535] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:49:32 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:49:42.458962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=62,keystone:INSERT=5 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:42.894028 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=21 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:56.335415 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48a1d9-73af-4d29-bbcf-f8ff4a638970 service cinder] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:56.414927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48a1d9-73af-4d29-bbcf-f8ff4a638970 service cinder] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:56.420305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732dd05d-f95d-44e4-91a0-c883e883f7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:56.421265 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dd05d-f95d-44e4-91a0-c883e883f7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:56.422234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dd05d-f95d-44e4-91a0-c883e883f7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:56.422234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dd05d-f95d-44e4-91a0-c883e883f7a6 admin admin] PATH_INFO: `/v3/users/6323153a2a5e4c9c91b91f5a53a71d87` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:56.423179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732dd05d-f95d-44e4-91a0-c883e883f7a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6323153a2a5e4c9c91b91f5a53a71d87)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:56.425215 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732dd05d-f95d-44e4-91a0-c883e883f7a6 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:56.657774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-732dd05d-f95d-44e4-91a0-c883e883f7a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6323153a2a5e4c9c91b91f5a53a71d87'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:56.680044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-732dd05d-f95d-44e4-91a0-c883e883f7a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6323153a2a5e4c9c91b91f5a53a71d87'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:56.767910 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-732dd05d-f95d-44e4-91a0-c883e883f7a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6323153a2a5e4c9c91b91f5a53a71d87'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:56.768810 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-732dd05d-f95d-44e4-91a0-c883e883f7a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6323153a2a5e4c9c91b91f5a53a71d87'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:56.778161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-732dd05d-f95d-44e4-91a0-c883e883f7a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6323153a2a5e4c9c91b91f5a53a71d87'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:56.785059 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1286/2536] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:49:56 2022] DELETE /identity/v3/users/6323153a2a5e4c9c91b91f5a53a71d87 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:49:56.790746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afe011-b4a6-4a15-b25a-6a539363fcd9 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:56.791424 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afe011-b4a6-4a15-b25a-6a539363fcd9 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:56.791424 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afe011-b4a6-4a15-b25a-6a539363fcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:56.813172 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-51afe011-b4a6-4a15-b25a-6a539363fcd9 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:49:56.814525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-51afe011-b4a6-4a15-b25a-6a539363fcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:56.921709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1251/2537] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:49:56.933748 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732dd05d-f95d-44e4-91a0-c883e883f7a6 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:56.935133 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-732dd05d-f95d-44e4-91a0-c883e883f7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:57.018913 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732dd05d-f95d-44e4-91a0-c883e883f7a6 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:57.021408 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd6d3e-94ca-4147-a29c-93ce6f7fa3ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:57.022958 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd6d3e-94ca-4147-a29c-93ce6f7fa3ce service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:57.023484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd6d3e-94ca-4147-a29c-93ce6f7fa3ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:57.023977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd6d3e-94ca-4147-a29c-93ce6f7fa3ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:57.040610 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd6d3e-94ca-4147-a29c-93ce6f7fa3ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:57.042376 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd6d3e-94ca-4147-a29c-93ce6f7fa3ce service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:57.054137 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1287/2538] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:49:57.633602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afe011-b4a6-4a15-b25a-6a539363fcd9 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:57.636113 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-51afe011-b4a6-4a15-b25a-6a539363fcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:57.657373 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afe011-b4a6-4a15-b25a-6a539363fcd9 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:57.664327 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46de4e2-9658-45dd-9275-392991ba3491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:57.665239 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46de4e2-9658-45dd-9275-392991ba3491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:57.665523 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46de4e2-9658-45dd-9275-392991ba3491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:57.665836 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46de4e2-9658-45dd-9275-392991ba3491 admin admin] PATH_INFO: `/v3/projects/0d1359bf3ef14a8e87a6634ebb7c1adf` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:57.675086 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46de4e2-9658-45dd-9275-392991ba3491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d1359bf3ef14a8e87a6634ebb7c1adf)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:57.677207 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46de4e2-9658-45dd-9275-392991ba3491 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:57.805074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e46de4e2-9658-45dd-9275-392991ba3491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d1359bf3ef14a8e87a6634ebb7c1adf', 'request_id': 'req-e46de4e2-9658-45dd-9275-392991ba3491'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:57.812953 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e46de4e2-9658-45dd-9275-392991ba3491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d1359bf3ef14a8e87a6634ebb7c1adf', 'request_id': 'req-e46de4e2-9658-45dd-9275-392991ba3491'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:57.821508 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e46de4e2-9658-45dd-9275-392991ba3491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d1359bf3ef14a8e87a6634ebb7c1adf', 'request_id': 'req-e46de4e2-9658-45dd-9275-392991ba3491'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:57.932916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e46de4e2-9658-45dd-9275-392991ba3491 admin admin] The token cache is being invalidate because project 0d1359bf3ef14a8e87a6634ebb7c1adf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:49:57.933411 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e46de4e2-9658-45dd-9275-392991ba3491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:57.936149 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e46de4e2-9658-45dd-9275-392991ba3491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:57.938863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1252/2539] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:49:57 2022] DELETE /identity/v3/projects/0d1359bf3ef14a8e87a6634ebb7c1adf => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:49:57.944817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd6d3e-94ca-4147-a29c-93ce6f7fa3ce service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:57.958504 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd6d3e-94ca-4147-a29c-93ce6f7fa3ce service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:57.990879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:58.056236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633d895-6cd3-441f-989d-5c930f2bd583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:58.057712 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633d895-6cd3-441f-989d-5c930f2bd583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:58.058244 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633d895-6cd3-441f-989d-5c930f2bd583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:58.058721 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633d895-6cd3-441f-989d-5c930f2bd583 admin admin] PATH_INFO: `/v3/users/3fa42afba1ec48438c0855160902911d` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:58.060781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633d895-6cd3-441f-989d-5c930f2bd583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fa42afba1ec48438c0855160902911d)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:58.063197 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633d895-6cd3-441f-989d-5c930f2bd583 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:58.338446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1633d895-6cd3-441f-989d-5c930f2bd583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fa42afba1ec48438c0855160902911d'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:58.361516 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1633d895-6cd3-441f-989d-5c930f2bd583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fa42afba1ec48438c0855160902911d'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:58.499639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1633d895-6cd3-441f-989d-5c930f2bd583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fa42afba1ec48438c0855160902911d'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:58.500358 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1633d895-6cd3-441f-989d-5c930f2bd583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fa42afba1ec48438c0855160902911d'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:58.510148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1633d895-6cd3-441f-989d-5c930f2bd583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fa42afba1ec48438c0855160902911d'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:58.519134 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1288/2540] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:49:57 2022] DELETE /identity/v3/users/3fa42afba1ec48438c0855160902911d => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:49:59.037182 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46de4e2-9658-45dd-9275-392991ba3491 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:59.039599 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-e46de4e2-9658-45dd-9275-392991ba3491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:59.062705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46de4e2-9658-45dd-9275-392991ba3491 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:59.141509 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ee501-9607-471d-b920-9ea2d260a28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:59.142280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ee501-9607-471d-b920-9ea2d260a28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:59.142599 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ee501-9607-471d-b920-9ea2d260a28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:59.142876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ee501-9607-471d-b920-9ea2d260a28b admin admin] PATH_INFO: `/v3/projects/b50f96ce12984dd9a35634327b0f9f9b` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:59.144586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ee501-9607-471d-b920-9ea2d260a28b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b50f96ce12984dd9a35634327b0f9f9b)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:59.146601 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ee501-9607-471d-b920-9ea2d260a28b admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:59.260551 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:59.286256 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-872ee501-9607-471d-b920-9ea2d260a28b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b50f96ce12984dd9a35634327b0f9f9b', 'request_id': 'req-872ee501-9607-471d-b920-9ea2d260a28b'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:59.295139 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-872ee501-9607-471d-b920-9ea2d260a28b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b50f96ce12984dd9a35634327b0f9f9b', 'request_id': 'req-872ee501-9607-471d-b920-9ea2d260a28b'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:59.304985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-872ee501-9607-471d-b920-9ea2d260a28b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b50f96ce12984dd9a35634327b0f9f9b', 'request_id': 'req-872ee501-9607-471d-b920-9ea2d260a28b'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:59.412601 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-872ee501-9607-471d-b920-9ea2d260a28b admin admin] The token cache is being invalidate because project b50f96ce12984dd9a35634327b0f9f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:49:59.412601 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-872ee501-9607-471d-b920-9ea2d260a28b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:59.412601 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-872ee501-9607-471d-b920-9ea2d260a28b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:49:59.415741 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1253/2541] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:49:59 2022] DELETE /identity/v3/projects/b50f96ce12984dd9a35634327b0f9f9b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:49:59.421721 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dd8c7-a602-4561-87ff-9ad0d017c952 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:59.422464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dd8c7-a602-4561-87ff-9ad0d017c952 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:59.422464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0dd8c7-a602-4561-87ff-9ad0d017c952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:59.444891 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-4c0dd8c7-a602-4561-87ff-9ad0d017c952 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:49:59.446569 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-4c0dd8c7-a602-4561-87ff-9ad0d017c952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:59.562124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1289/2542] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:49:59.574093 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a4374-0d90-4d42-8edd-2c99b42b3a3e None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:59.574429 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a4374-0d90-4d42-8edd-2c99b42b3a3e None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:59.574768 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a4374-0d90-4d42-8edd-2c99b42b3a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:59.600618 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-ee6a4374-0d90-4d42-8edd-2c99b42b3a3e None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:49:59.602594 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ee6a4374-0d90-4d42-8edd-2c99b42b3a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:49:59.613444 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1254/2543] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:49:59.618578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0dd8c7-a602-4561-87ff-9ad0d017c952 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:59.633430 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0dd8c7-a602-4561-87ff-9ad0d017c952 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:59.639677 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008030b3-e833-4ca1-920b-deb8c622c64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:59.640509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008030b3-e833-4ca1-920b-deb8c622c64a admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:59.642359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008030b3-e833-4ca1-920b-deb8c622c64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:59.642359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008030b3-e833-4ca1-920b-deb8c622c64a admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:59.642359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008030b3-e833-4ca1-920b-deb8c622c64a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:49:59.642359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008030b3-e833-4ca1-920b-deb8c622c64a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:59.645106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008030b3-e833-4ca1-920b-deb8c622c64a admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:59.662968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1290/2544] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:49:59.667980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a4374-0d90-4d42-8edd-2c99b42b3a3e None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:59.684700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a4374-0d90-4d42-8edd-2c99b42b3a3e None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:59.693330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b011fe-9ffb-4943-baad-8e9a579c3943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:59.694746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b011fe-9ffb-4943-baad-8e9a579c3943 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:59.697245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b011fe-9ffb-4943-baad-8e9a579c3943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:59.697245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b011fe-9ffb-4943-baad-8e9a579c3943 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:59.697245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b011fe-9ffb-4943-baad-8e9a579c3943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:59.698902 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b011fe-9ffb-4943-baad-8e9a579c3943 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:49:59.879153 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1255/2545] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:49:59 2022] POST /identity/v3/projects => generated 363 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:49:59.884063 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008030b3-e833-4ca1-920b-deb8c622c64a admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:49:59.897980 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008030b3-e833-4ca1-920b-deb8c622c64a admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:49:59.936728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:49:59.978168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a93b0-b3a7-4f7d-90ed-dd225292f020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:49:59.978894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a93b0-b3a7-4f7d-90ed-dd225292f020 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:49:59.979195 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a93b0-b3a7-4f7d-90ed-dd225292f020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:49:59.979622 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a93b0-b3a7-4f7d-90ed-dd225292f020 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:49:59.980399 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a93b0-b3a7-4f7d-90ed-dd225292f020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:49:59.982513 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a93b0-b3a7-4f7d-90ed-dd225292f020 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:00.108817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1291/2546] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:49:59 2022] POST /identity/v3/users => generated 282 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:50:00.114162 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b011fe-9ffb-4943-baad-8e9a579c3943 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:00.128017 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b011fe-9ffb-4943-baad-8e9a579c3943 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:00.135995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e3e8c-c56c-4c2a-81ac-8922952444e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:00.136748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e3e8c-c56c-4c2a-81ac-8922952444e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:00.137028 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e3e8c-c56c-4c2a-81ac-8922952444e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:00.137369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e3e8c-c56c-4c2a-81ac-8922952444e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:00.138232 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e3e8c-c56c-4c2a-81ac-8922952444e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:00.141354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e3e8c-c56c-4c2a-81ac-8922952444e3 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:00.159481 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1256/2547] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:50:00.167798 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a93b0-b3a7-4f7d-90ed-dd225292f020 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:00.190512 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a93b0-b3a7-4f7d-90ed-dd225292f020 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:00.212146 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483617c2-cb30-4432-87d3-3b555d07fe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:00.213370 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483617c2-cb30-4432-87d3-3b555d07fe6d admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:00.215345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483617c2-cb30-4432-87d3-3b555d07fe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:00.215858 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483617c2-cb30-4432-87d3-3b555d07fe6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:00.217317 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483617c2-cb30-4432-87d3-3b555d07fe6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:00.220161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483617c2-cb30-4432-87d3-3b555d07fe6d admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:00.239323 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1292/2548] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:50:00.245968 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e3e8c-c56c-4c2a-81ac-8922952444e3 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:00.258999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e3e8c-c56c-4c2a-81ac-8922952444e3 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:00.265772 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87e0b5-eb78-40f6-b776-da3f5bc89df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:00.266743 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87e0b5-eb78-40f6-b776-da3f5bc89df2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:00.267074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87e0b5-eb78-40f6-b776-da3f5bc89df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:00.267439 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87e0b5-eb78-40f6-b776-da3f5bc89df2 admin admin] PATH_INFO: `/v3/projects/40ea78dfc57c43d68bcadfbda1f47600/users/d3ad60fdfe5745a083eee258d541fc65/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:00.285667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87e0b5-eb78-40f6-b776-da3f5bc89df2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ea78dfc57c43d68bcadfbda1f47600, user_id=d3ad60fdfe5745a083eee258d541fc65, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:00.288724 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87e0b5-eb78-40f6-b776-da3f5bc89df2 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:00.373441 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1257/2549] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:50:00 2022] PUT /identity/v3/projects/40ea78dfc57c43d68bcadfbda1f47600/users/d3ad60fdfe5745a083eee258d541fc65/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:50:00.386455 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c146c90-6a04-40c5-83cb-25b396a0a08f None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:00.387019 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c146c90-6a04-40c5-83cb-25b396a0a08f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:00.387584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c146c90-6a04-40c5-83cb-25b396a0a08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:00.438079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-2c146c90-6a04-40c5-83cb-25b396a0a08f None None] MFA Rules not processed for user `d3ad60fdfe5745a083eee258d541fc65`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:50:00.440281 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-2c146c90-6a04-40c5-83cb-25b396a0a08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:00.533538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1293/2550] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:50:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:50:00.541617 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87e0b5-eb78-40f6-b776-da3f5bc89df2 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:00.665351 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87e0b5-eb78-40f6-b776-da3f5bc89df2 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:00.674749 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b4956-2f84-418b-9c7e-a00c0627bf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:00.675998 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b4956-2f84-418b-9c7e-a00c0627bf51 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:00.676505 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b4956-2f84-418b-9c7e-a00c0627bf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:00.677007 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b4956-2f84-418b-9c7e-a00c0627bf51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:00.678346 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b4956-2f84-418b-9c7e-a00c0627bf51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:00.682378 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b4956-2f84-418b-9c7e-a00c0627bf51 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:00.810930 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1258/2551] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:50:00 2022] POST /identity/v3/projects => generated 365 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:50:00.815778 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c146c90-6a04-40c5-83cb-25b396a0a08f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:00.828163 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c146c90-6a04-40c5-83cb-25b396a0a08f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:00.901403 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ed5be-310d-4bb5-a7f4-96952bb48c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:00.902302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ed5be-310d-4bb5-a7f4-96952bb48c67 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:00.902699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ed5be-310d-4bb5-a7f4-96952bb48c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:00.903079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ed5be-310d-4bb5-a7f4-96952bb48c67 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:00.904199 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ed5be-310d-4bb5-a7f4-96952bb48c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:00.910629 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ed5be-310d-4bb5-a7f4-96952bb48c67 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:01.038349 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1294/2552] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:50:00 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:50:01.040132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b4956-2f84-418b-9c7e-a00c0627bf51 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:01.051448 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b4956-2f84-418b-9c7e-a00c0627bf51 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:01.057547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92d597-8c28-4ae3-9368-9851bf190863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:01.058255 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92d597-8c28-4ae3-9368-9851bf190863 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:01.058547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92d597-8c28-4ae3-9368-9851bf190863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:01.058925 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92d597-8c28-4ae3-9368-9851bf190863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:01.059794 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92d597-8c28-4ae3-9368-9851bf190863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:01.061681 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92d597-8c28-4ae3-9368-9851bf190863 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:01.073887 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1259/2553] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:50:01.078386 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ed5be-310d-4bb5-a7f4-96952bb48c67 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:01.092245 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ed5be-310d-4bb5-a7f4-96952bb48c67 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:01.097698 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9668206-440f-45e2-96ca-0cecba74a472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:01.108807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9668206-440f-45e2-96ca-0cecba74a472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:01.108807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9668206-440f-45e2-96ca-0cecba74a472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:01.108807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9668206-440f-45e2-96ca-0cecba74a472 admin admin] PATH_INFO: `/v3/projects/ab84922a8e3944d5a36ed9bd9a99df3d/users/f3758703e6474ffa9da31c5fe04146c3/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:01.117834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9668206-440f-45e2-96ca-0cecba74a472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab84922a8e3944d5a36ed9bd9a99df3d, user_id=f3758703e6474ffa9da31c5fe04146c3, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:01.120856 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9668206-440f-45e2-96ca-0cecba74a472 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:01.260224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1295/2554] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:50:01 2022] PUT /identity/v3/projects/ab84922a8e3944d5a36ed9bd9a99df3d/users/f3758703e6474ffa9da31c5fe04146c3/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:50:01.264979 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92d597-8c28-4ae3-9368-9851bf190863 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:01.276985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92d597-8c28-4ae3-9368-9851bf190863 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:01.301085 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:01.346804 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3273622-b9c1-4fe9-91e1-fc7a9ab32a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:01.347455 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3273622-b9c1-4fe9-91e1-fc7a9ab32a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:01.347738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3273622-b9c1-4fe9-91e1-fc7a9ab32a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:01.348016 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3273622-b9c1-4fe9-91e1-fc7a9ab32a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:01.348762 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3273622-b9c1-4fe9-91e1-fc7a9ab32a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:01.351807 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3273622-b9c1-4fe9-91e1-fc7a9ab32a9a admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:01.371721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1260/2555] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:50:01.372989 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9668206-440f-45e2-96ca-0cecba74a472 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:01.379188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:01.387864 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9668206-440f-45e2-96ca-0cecba74a472 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:01.391866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b3c3c-28be-4867-8964-4b109fbdcd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:01.392786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b3c3c-28be-4867-8964-4b109fbdcd1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:01.393069 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b3c3c-28be-4867-8964-4b109fbdcd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:01.393346 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b3c3c-28be-4867-8964-4b109fbdcd1e admin admin] PATH_INFO: `/v3/projects/ab84922a8e3944d5a36ed9bd9a99df3d/users/f3758703e6474ffa9da31c5fe04146c3/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:01.396012 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b3c3c-28be-4867-8964-4b109fbdcd1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab84922a8e3944d5a36ed9bd9a99df3d, user_id=f3758703e6474ffa9da31c5fe04146c3, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:01.399546 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b3c3c-28be-4867-8964-4b109fbdcd1e admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:01.411463 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1296/2556] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:50:01 2022] PUT /identity/v3/projects/ab84922a8e3944d5a36ed9bd9a99df3d/users/f3758703e6474ffa9da31c5fe04146c3/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:50:01.422344 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92feae0f-0c78-45ca-8c9b-779035ce87d7 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:01.422631 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92feae0f-0c78-45ca-8c9b-779035ce87d7 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:01.422936 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92feae0f-0c78-45ca-8c9b-779035ce87d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:01.454481 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-92feae0f-0c78-45ca-8c9b-779035ce87d7 None None] MFA Rules not processed for user `f3758703e6474ffa9da31c5fe04146c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:50:01.455749 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-92feae0f-0c78-45ca-8c9b-779035ce87d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:01.549732 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1261/2557] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:50:01 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:50:01.562315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b3c3c-28be-4867-8964-4b109fbdcd1e admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:01.564591 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-c76b3c3c-28be-4867-8964-4b109fbdcd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:01.637118 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b3c3c-28be-4867-8964-4b109fbdcd1e admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:01.641484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff167df-d257-44fb-8c12-028cb47fc83c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:01.642282 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff167df-d257-44fb-8c12-028cb47fc83c service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:01.642640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff167df-d257-44fb-8c12-028cb47fc83c service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:01.642933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff167df-d257-44fb-8c12-028cb47fc83c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:01.654136 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff167df-d257-44fb-8c12-028cb47fc83c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:01.656246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff167df-d257-44fb-8c12-028cb47fc83c service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:01.668180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1297/2558] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:50:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:50:01.911869 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92feae0f-0c78-45ca-8c9b-779035ce87d7 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:01.930525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92feae0f-0c78-45ca-8c9b-779035ce87d7 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:01.936081 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdd1b9-f0c0-4710-a709-e66d6651f174 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:01.937013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdd1b9-f0c0-4710-a709-e66d6651f174 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:01.937522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdd1b9-f0c0-4710-a709-e66d6651f174 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:01.937863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdd1b9-f0c0-4710-a709-e66d6651f174 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:02.010761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfdd1b9-f0c0-4710-a709-e66d6651f174 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:02.012286 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfdd1b9-f0c0-4710-a709-e66d6651f174 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:02.023201 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1262/2559] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:50:01 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:50:05.593698 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff167df-d257-44fb-8c12-028cb47fc83c service cinder] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:05.593698 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-aff167df-d257-44fb-8c12-028cb47fc83c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:05.731025 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff167df-d257-44fb-8c12-028cb47fc83c service cinder] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:05.737984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c4fe2-2ecf-4473-87dd-11a254c3986c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a3704fdba154f13ad3bf8ac00c916c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:05.738910 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c4fe2-2ecf-4473-87dd-11a254c3986c service placement] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:05.739300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c4fe2-2ecf-4473-87dd-11a254c3986c service placement] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:05.739874 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c4fe2-2ecf-4473-87dd-11a254c3986c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:05.744294 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d99c4fe2-2ecf-4473-87dd-11a254c3986c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:05.761386 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c4fe2-2ecf-4473-87dd-11a254c3986c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:05.763514 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c4fe2-2ecf-4473-87dd-11a254c3986c service placement] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:05.781510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1298/2560] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:50:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:50:12.018091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=80 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:12.070332 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb977d-6f29-44a4-a968-37a726813797 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:12.070695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb977d-6f29-44a4-a968-37a726813797 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:12.071046 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb977d-6f29-44a4-a968-37a726813797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:12.091033 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-8ebb977d-6f29-44a4-a968-37a726813797 None None] MFA Rules not processed for user `87fcc3fa1cbe4afeaa0e455f2631411a`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:50:12.092539 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-8ebb977d-6f29-44a4-a968-37a726813797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:12.160045 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1263/2561] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:50:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:50:12.546248 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c4fe2-2ecf-4473-87dd-11a254c3986c service placement] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:12.547991 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-d99c4fe2-2ecf-4473-87dd-11a254c3986c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:12.636844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c4fe2-2ecf-4473-87dd-11a254c3986c service placement] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:12.640671 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079de69-7095-446c-8665-fc125bb63749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:12.641344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079de69-7095-446c-8665-fc125bb63749 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:12.641635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079de69-7095-446c-8665-fc125bb63749 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:12.641915 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079de69-7095-446c-8665-fc125bb63749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:12.644144 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a079de69-7095-446c-8665-fc125bb63749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:12.658698 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079de69-7095-446c-8665-fc125bb63749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:12.658698 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079de69-7095-446c-8665-fc125bb63749 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:12.669963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1299/2562] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:50:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:50:12.879798 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb977d-6f29-44a4-a968-37a726813797 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:13.001896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb977d-6f29-44a4-a968-37a726813797 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:13.008667 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85529b2b-793e-4ba9-acaf-b2357e0d5480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:13.009579 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85529b2b-793e-4ba9-acaf-b2357e0d5480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:13.009868 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85529b2b-793e-4ba9-acaf-b2357e0d5480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:13.010154 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85529b2b-793e-4ba9-acaf-b2357e0d5480 admin admin] PATH_INFO: `/v3/users/d3ad60fdfe5745a083eee258d541fc65` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:13.011520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85529b2b-793e-4ba9-acaf-b2357e0d5480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ad60fdfe5745a083eee258d541fc65)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:13.013521 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85529b2b-793e-4ba9-acaf-b2357e0d5480 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:13.275349 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-85529b2b-793e-4ba9-acaf-b2357e0d5480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ad60fdfe5745a083eee258d541fc65'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:13.290018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-85529b2b-793e-4ba9-acaf-b2357e0d5480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ad60fdfe5745a083eee258d541fc65'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:13.297705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-85529b2b-793e-4ba9-acaf-b2357e0d5480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ad60fdfe5745a083eee258d541fc65'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:13.374552 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-85529b2b-793e-4ba9-acaf-b2357e0d5480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ad60fdfe5745a083eee258d541fc65'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:13.375705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-85529b2b-793e-4ba9-acaf-b2357e0d5480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ad60fdfe5745a083eee258d541fc65'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:13.389703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1264/2563] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:50:12 2022] DELETE /identity/v3/users/d3ad60fdfe5745a083eee258d541fc65 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:50:13.394883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b09226-343c-4fb8-b7de-496dff5f153e None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:13.395397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b09226-343c-4fb8-b7de-496dff5f153e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:13.395887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b09226-343c-4fb8-b7de-496dff5f153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:13.407044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:13.423633 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-c5b09226-343c-4fb8-b7de-496dff5f153e None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:50:13.425080 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-c5b09226-343c-4fb8-b7de-496dff5f153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:13.513751 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1300/2564] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:50:13.526886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85529b2b-793e-4ba9-acaf-b2357e0d5480 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:13.529392 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-85529b2b-793e-4ba9-acaf-b2357e0d5480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:13.571637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:13.619841 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85529b2b-793e-4ba9-acaf-b2357e0d5480 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:13.624722 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b1415-3cdd-4b8c-8e2d-ec2016b10d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:13.625555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b1415-3cdd-4b8c-8e2d-ec2016b10d7f service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:13.625932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b1415-3cdd-4b8c-8e2d-ec2016b10d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:13.626398 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b1415-3cdd-4b8c-8e2d-ec2016b10d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:13.639902 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b1415-3cdd-4b8c-8e2d-ec2016b10d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:13.642201 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b1415-3cdd-4b8c-8e2d-ec2016b10d7f service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:13.656137 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1265/2565] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:50:14.208779 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b09226-343c-4fb8-b7de-496dff5f153e None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:14.211745 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-c5b09226-343c-4fb8-b7de-496dff5f153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:14.234356 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b09226-343c-4fb8-b7de-496dff5f153e None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:14.255762 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb010d-09fc-43aa-b34e-ca898788a026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:14.257220 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb010d-09fc-43aa-b34e-ca898788a026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:14.257641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb010d-09fc-43aa-b34e-ca898788a026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:14.257989 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb010d-09fc-43aa-b34e-ca898788a026 admin admin] PATH_INFO: `/v3/projects/40ea78dfc57c43d68bcadfbda1f47600` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:14.260949 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb010d-09fc-43aa-b34e-ca898788a026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40ea78dfc57c43d68bcadfbda1f47600)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:14.263517 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb010d-09fc-43aa-b34e-ca898788a026 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:14.449078 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-fceb010d-09fc-43aa-b34e-ca898788a026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40ea78dfc57c43d68bcadfbda1f47600', 'request_id': 'req-fceb010d-09fc-43aa-b34e-ca898788a026'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:14.533954 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-fceb010d-09fc-43aa-b34e-ca898788a026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40ea78dfc57c43d68bcadfbda1f47600', 'request_id': 'req-fceb010d-09fc-43aa-b34e-ca898788a026'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:14.541993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-fceb010d-09fc-43aa-b34e-ca898788a026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40ea78dfc57c43d68bcadfbda1f47600', 'request_id': 'req-fceb010d-09fc-43aa-b34e-ca898788a026'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:14.557452 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-fceb010d-09fc-43aa-b34e-ca898788a026 admin admin] The token cache is being invalidate because project 40ea78dfc57c43d68bcadfbda1f47600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:50:14.557806 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-fceb010d-09fc-43aa-b34e-ca898788a026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:14.558545 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-fceb010d-09fc-43aa-b34e-ca898788a026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:14.560427 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1301/2566] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:50:14 2022] DELETE /identity/v3/projects/40ea78dfc57c43d68bcadfbda1f47600 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:50:14.564989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b1415-3cdd-4b8c-8e2d-ec2016b10d7f service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:14.578071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b1415-3cdd-4b8c-8e2d-ec2016b10d7f service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:14.653096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcfc0f-9023-4756-908a-5606a436cf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:14.654227 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcfc0f-9023-4756-908a-5606a436cf59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:14.654508 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcfc0f-9023-4756-908a-5606a436cf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:14.654787 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcfc0f-9023-4756-908a-5606a436cf59 admin admin] PATH_INFO: `/v3/users/f3758703e6474ffa9da31c5fe04146c3` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:14.656144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcfc0f-9023-4756-908a-5606a436cf59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3758703e6474ffa9da31c5fe04146c3)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:14.658272 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcfc0f-9023-4756-908a-5606a436cf59 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:14.871442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-4cfcfc0f-9023-4756-908a-5606a436cf59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3758703e6474ffa9da31c5fe04146c3'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:14.885499 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-4cfcfc0f-9023-4756-908a-5606a436cf59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3758703e6474ffa9da31c5fe04146c3'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:14.892946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-4cfcfc0f-9023-4756-908a-5606a436cf59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3758703e6474ffa9da31c5fe04146c3'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:14.968782 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-4cfcfc0f-9023-4756-908a-5606a436cf59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3758703e6474ffa9da31c5fe04146c3'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:14.969498 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-4cfcfc0f-9023-4756-908a-5606a436cf59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3758703e6474ffa9da31c5fe04146c3'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:14.977819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1266/2567] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:50:14 2022] DELETE /identity/v3/users/f3758703e6474ffa9da31c5fe04146c3 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:50:15.639298 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb010d-09fc-43aa-b34e-ca898788a026 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:15.641913 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-fceb010d-09fc-43aa-b34e-ca898788a026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:15.657817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb010d-09fc-43aa-b34e-ca898788a026 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:15.738715 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b9c1a-ea65-4df1-89f0-7d29ab6bbb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:15.739725 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b9c1a-ea65-4df1-89f0-7d29ab6bbb51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:15.751866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b9c1a-ea65-4df1-89f0-7d29ab6bbb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:15.751866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b9c1a-ea65-4df1-89f0-7d29ab6bbb51 admin admin] PATH_INFO: `/v3/projects/ab84922a8e3944d5a36ed9bd9a99df3d` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:15.751866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b9c1a-ea65-4df1-89f0-7d29ab6bbb51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab84922a8e3944d5a36ed9bd9a99df3d)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:15.751866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b9c1a-ea65-4df1-89f0-7d29ab6bbb51 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:15.906532 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:15.920956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-998b9c1a-ea65-4df1-89f0-7d29ab6bbb51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab84922a8e3944d5a36ed9bd9a99df3d', 'request_id': 'req-998b9c1a-ea65-4df1-89f0-7d29ab6bbb51'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:15.992532 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-998b9c1a-ea65-4df1-89f0-7d29ab6bbb51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab84922a8e3944d5a36ed9bd9a99df3d', 'request_id': 'req-998b9c1a-ea65-4df1-89f0-7d29ab6bbb51'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:16.007261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-998b9c1a-ea65-4df1-89f0-7d29ab6bbb51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab84922a8e3944d5a36ed9bd9a99df3d', 'request_id': 'req-998b9c1a-ea65-4df1-89f0-7d29ab6bbb51'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:16.029571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-998b9c1a-ea65-4df1-89f0-7d29ab6bbb51 admin admin] The token cache is being invalidate because project ab84922a8e3944d5a36ed9bd9a99df3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:50:16.030081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-998b9c1a-ea65-4df1-89f0-7d29ab6bbb51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:16.031361 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-998b9c1a-ea65-4df1-89f0-7d29ab6bbb51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:16.034598 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1302/2568] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:50:15 2022] DELETE /identity/v3/projects/ab84922a8e3944d5a36ed9bd9a99df3d => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:50:16.042431 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc39bce-74db-43b5-9744-1f68521227af None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:16.043428 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc39bce-74db-43b5-9744-1f68521227af None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:16.043428 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc39bce-74db-43b5-9744-1f68521227af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:16.082627 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-dfc39bce-74db-43b5-9744-1f68521227af None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:50:16.083983 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-dfc39bce-74db-43b5-9744-1f68521227af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:16.154602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:16.177046 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1267/2569] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:50:16.186652 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54406f8-7337-4a9e-aa5c-a6406c8fb63c None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:16.187830 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54406f8-7337-4a9e-aa5c-a6406c8fb63c None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:16.188232 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54406f8-7337-4a9e-aa5c-a6406c8fb63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:16.212666 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-f54406f8-7337-4a9e-aa5c-a6406c8fb63c None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:50:16.214183 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f54406f8-7337-4a9e-aa5c-a6406c8fb63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:16.229980 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1303/2570] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:50:16.234532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc39bce-74db-43b5-9744-1f68521227af None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:16.258792 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc39bce-74db-43b5-9744-1f68521227af None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:16.263350 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d50ba6-00ad-4d15-a9d8-b7443eab0de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:16.264542 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d50ba6-00ad-4d15-a9d8-b7443eab0de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:16.265051 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d50ba6-00ad-4d15-a9d8-b7443eab0de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:16.265562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d50ba6-00ad-4d15-a9d8-b7443eab0de3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:16.267054 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d50ba6-00ad-4d15-a9d8-b7443eab0de3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:50:16.267652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d50ba6-00ad-4d15-a9d8-b7443eab0de3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:16.271109 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d50ba6-00ad-4d15-a9d8-b7443eab0de3 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:16.296182 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1268/2571] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:50:16.301644 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54406f8-7337-4a9e-aa5c-a6406c8fb63c None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:16.320999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54406f8-7337-4a9e-aa5c-a6406c8fb63c None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:16.329628 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070535fa-0566-4698-ab8d-3ac29e304bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:16.330799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070535fa-0566-4698-ab8d-3ac29e304bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:16.331340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070535fa-0566-4698-ab8d-3ac29e304bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:16.331849 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070535fa-0566-4698-ab8d-3ac29e304bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:16.333189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070535fa-0566-4698-ab8d-3ac29e304bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:16.337219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070535fa-0566-4698-ab8d-3ac29e304bb5 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:16.437228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1304/2572] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:50:16 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:50:16.443157 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d50ba6-00ad-4d15-a9d8-b7443eab0de3 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:16.457253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d50ba6-00ad-4d15-a9d8-b7443eab0de3 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:16.564075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c7980-14d4-446f-a5f4-4c449d4585d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:16.565330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c7980-14d4-446f-a5f4-4c449d4585d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:16.565829 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c7980-14d4-446f-a5f4-4c449d4585d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:16.566304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c7980-14d4-446f-a5f4-4c449d4585d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:16.567453 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c7980-14d4-446f-a5f4-4c449d4585d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:16.570929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c7980-14d4-446f-a5f4-4c449d4585d8 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:16.678036 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1269/2573] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:50:16 2022] POST /identity/v3/users => generated 290 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:50:16.682419 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070535fa-0566-4698-ab8d-3ac29e304bb5 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:16.694784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070535fa-0566-4698-ab8d-3ac29e304bb5 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:16.700367 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cd99d-208a-4988-9885-2f366f51992c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:16.701068 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cd99d-208a-4988-9885-2f366f51992c admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:16.705077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cd99d-208a-4988-9885-2f366f51992c admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:16.705077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cd99d-208a-4988-9885-2f366f51992c admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:16.705077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cd99d-208a-4988-9885-2f366f51992c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:16.705077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cd99d-208a-4988-9885-2f366f51992c admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:16.719329 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1305/2574] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:50:16.724927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c7980-14d4-446f-a5f4-4c449d4585d8 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:16.743479 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c7980-14d4-446f-a5f4-4c449d4585d8 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:16.751237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f2794-85c4-42e5-9227-9543fbc6d328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:16.752397 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f2794-85c4-42e5-9227-9543fbc6d328 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:16.752866 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f2794-85c4-42e5-9227-9543fbc6d328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:16.753336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f2794-85c4-42e5-9227-9543fbc6d328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:16.754702 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f2794-85c4-42e5-9227-9543fbc6d328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:16.758261 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f2794-85c4-42e5-9227-9543fbc6d328 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:16.776915 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1270/2575] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:50:16.782281 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cd99d-208a-4988-9885-2f366f51992c admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:16.796419 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cd99d-208a-4988-9885-2f366f51992c admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:16.805736 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b26b03-721d-4e89-823c-547a1c290f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:16.812006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b26b03-721d-4e89-823c-547a1c290f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:16.812006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b26b03-721d-4e89-823c-547a1c290f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:16.812006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b26b03-721d-4e89-823c-547a1c290f3e admin admin] PATH_INFO: `/v3/projects/167fbb29bff340dbbb5a04678adb92d6/users/d07a6ff023444ec9910b37ca123b6c5c/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:16.831024 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b26b03-721d-4e89-823c-547a1c290f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=167fbb29bff340dbbb5a04678adb92d6, user_id=d07a6ff023444ec9910b37ca123b6c5c, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:16.842521 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b26b03-721d-4e89-823c-547a1c290f3e admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:16.954002 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1306/2576] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:50:16 2022] PUT /identity/v3/projects/167fbb29bff340dbbb5a04678adb92d6/users/d07a6ff023444ec9910b37ca123b6c5c/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:50:16.966557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dc399-a9b8-415e-9f60-0ca5472c2e08 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:16.966905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dc399-a9b8-415e-9f60-0ca5472c2e08 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:16.967171 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dc399-a9b8-415e-9f60-0ca5472c2e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:17.001587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-7a4dc399-a9b8-415e-9f60-0ca5472c2e08 None None] MFA Rules not processed for user `d07a6ff023444ec9910b37ca123b6c5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:50:17.003551 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-7a4dc399-a9b8-415e-9f60-0ca5472c2e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:17.092264 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1271/2577] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:50:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:50:17.097318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b26b03-721d-4e89-823c-547a1c290f3e admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:17.205475 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b26b03-721d-4e89-823c-547a1c290f3e admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:17.213326 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6168c-e003-4b54-a3df-0efdacba4aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:17.214154 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6168c-e003-4b54-a3df-0efdacba4aea admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:17.214532 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6168c-e003-4b54-a3df-0efdacba4aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:17.214954 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6168c-e003-4b54-a3df-0efdacba4aea admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:17.216131 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6168c-e003-4b54-a3df-0efdacba4aea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:17.218428 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6168c-e003-4b54-a3df-0efdacba4aea admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:17.330779 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1307/2578] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:50:17 2022] POST /identity/v3/projects => generated 377 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:50:17.336904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4dc399-a9b8-415e-9f60-0ca5472c2e08 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:17.354628 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4dc399-a9b8-415e-9f60-0ca5472c2e08 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:17.440161 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:17.471263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c759da-079d-42e3-8ea4-cde7bad6baee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:17.472549 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c759da-079d-42e3-8ea4-cde7bad6baee admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:17.473046 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c759da-079d-42e3-8ea4-cde7bad6baee admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:17.473407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c759da-079d-42e3-8ea4-cde7bad6baee admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:17.474753 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c759da-079d-42e3-8ea4-cde7bad6baee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:17.479895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c759da-079d-42e3-8ea4-cde7bad6baee admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:17.587520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1272/2579] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:50:17 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:50:17.592478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6168c-e003-4b54-a3df-0efdacba4aea admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:17.612050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6168c-e003-4b54-a3df-0efdacba4aea admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:17.621085 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552c5d4-3971-47d8-981e-62cf53617227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:17.622369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552c5d4-3971-47d8-981e-62cf53617227 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:17.622808 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552c5d4-3971-47d8-981e-62cf53617227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:17.623350 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552c5d4-3971-47d8-981e-62cf53617227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:17.624822 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552c5d4-3971-47d8-981e-62cf53617227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:17.628069 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552c5d4-3971-47d8-981e-62cf53617227 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:17.650377 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1308/2580] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:50:17.656120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c759da-079d-42e3-8ea4-cde7bad6baee admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:17.667845 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c759da-079d-42e3-8ea4-cde7bad6baee admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:17.673471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccafd36-6848-4e84-8a01-6ac9be6d2ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:17.685160 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccafd36-6848-4e84-8a01-6ac9be6d2ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:17.685160 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccafd36-6848-4e84-8a01-6ac9be6d2ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:17.685160 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccafd36-6848-4e84-8a01-6ac9be6d2ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:17.685160 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccafd36-6848-4e84-8a01-6ac9be6d2ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:17.685160 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccafd36-6848-4e84-8a01-6ac9be6d2ee0 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:17.690742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1273/2581] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:50:17.695405 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552c5d4-3971-47d8-981e-62cf53617227 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:17.706328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552c5d4-3971-47d8-981e-62cf53617227 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:17.712077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf21efa-c342-409a-a119-0a6e1a4e6d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:17.713017 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf21efa-c342-409a-a119-0a6e1a4e6d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:17.713303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf21efa-c342-409a-a119-0a6e1a4e6d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:17.713581 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf21efa-c342-409a-a119-0a6e1a4e6d86 admin admin] PATH_INFO: `/v3/projects/f1c1ec1025344017817829d49b82e504/users/9ae4ea003741464392fa147b44ba41c0/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:17.740315 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf21efa-c342-409a-a119-0a6e1a4e6d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c1ec1025344017817829d49b82e504, user_id=9ae4ea003741464392fa147b44ba41c0, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:17.745168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf21efa-c342-409a-a119-0a6e1a4e6d86 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:17.834370 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1309/2582] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:50:17 2022] PUT /identity/v3/projects/f1c1ec1025344017817829d49b82e504/users/9ae4ea003741464392fa147b44ba41c0/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:50:17.863768 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafbe86-71b3-487c-888c-0603f2922609 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:17.864533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafbe86-71b3-487c-888c-0603f2922609 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:17.865135 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafbe86-71b3-487c-888c-0603f2922609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:17.930486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-cdafbe86-71b3-487c-888c-0603f2922609 None None] MFA Rules not processed for user `9ae4ea003741464392fa147b44ba41c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:50:17.933612 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-cdafbe86-71b3-487c-888c-0603f2922609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:18.067463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1274/2583] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:50:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:50:18.072587 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf21efa-c342-409a-a119-0a6e1a4e6d86 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:18.079664 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:18.160569 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf21efa-c342-409a-a119-0a6e1a4e6d86 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:18.166443 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e8f59-ab95-42f9-8e29-cf4e62971222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:18.167986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e8f59-ab95-42f9-8e29-cf4e62971222 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:18.167986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e8f59-ab95-42f9-8e29-cf4e62971222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:18.167986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e8f59-ab95-42f9-8e29-cf4e62971222 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:18.168667 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e8f59-ab95-42f9-8e29-cf4e62971222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:18.170777 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e8f59-ab95-42f9-8e29-cf4e62971222 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:18.293115 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1310/2584] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:50:18 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:50:18.293349 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafbe86-71b3-487c-888c-0603f2922609 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:18.313597 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafbe86-71b3-487c-888c-0603f2922609 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:18.394950 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57367e38-57bf-45ea-81f1-e5baf5785c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:18.395720 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57367e38-57bf-45ea-81f1-e5baf5785c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:18.396009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57367e38-57bf-45ea-81f1-e5baf5785c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:18.396318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57367e38-57bf-45ea-81f1-e5baf5785c6e admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:18.397599 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57367e38-57bf-45ea-81f1-e5baf5785c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:18.399972 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57367e38-57bf-45ea-81f1-e5baf5785c6e admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:18.488196 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1275/2585] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:50:18 2022] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:50:18.490909 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e8f59-ab95-42f9-8e29-cf4e62971222 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:18.505358 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e8f59-ab95-42f9-8e29-cf4e62971222 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:18.519835 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebf993-412a-4601-929a-25b2ba031862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:18.519835 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebf993-412a-4601-929a-25b2ba031862 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:18.519835 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebf993-412a-4601-929a-25b2ba031862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:18.519835 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebf993-412a-4601-929a-25b2ba031862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:18.520305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ebf993-412a-4601-929a-25b2ba031862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:18.520305 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ebf993-412a-4601-929a-25b2ba031862 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:18.535539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1311/2586] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:50:18.538717 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57367e38-57bf-45ea-81f1-e5baf5785c6e admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:18.550474 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57367e38-57bf-45ea-81f1-e5baf5785c6e admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:18.556770 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749e9aa-d23b-427a-946c-a189683ad5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:18.557720 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e9aa-d23b-427a-946c-a189683ad5e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:18.558012 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e9aa-d23b-427a-946c-a189683ad5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:18.558294 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e9aa-d23b-427a-946c-a189683ad5e0 admin admin] PATH_INFO: `/v3/projects/0ba0ee3ccdc6425db221d8732aca2335/users/f72aa23298804095b631e68df19ea9cd/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:18.579075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749e9aa-d23b-427a-946c-a189683ad5e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba0ee3ccdc6425db221d8732aca2335, user_id=f72aa23298804095b631e68df19ea9cd, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:18.582120 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749e9aa-d23b-427a-946c-a189683ad5e0 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:18.685515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1276/2587] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:50:18 2022] PUT /identity/v3/projects/0ba0ee3ccdc6425db221d8732aca2335/users/f72aa23298804095b631e68df19ea9cd/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:50:18.690780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebf993-412a-4601-929a-25b2ba031862 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:18.704593 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebf993-412a-4601-929a-25b2ba031862 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:18.816933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b4fde-423e-4b27-8092-d212d0501847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:18.818017 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b4fde-423e-4b27-8092-d212d0501847 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:18.818314 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b4fde-423e-4b27-8092-d212d0501847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:18.818599 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b4fde-423e-4b27-8092-d212d0501847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:18.819506 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b4fde-423e-4b27-8092-d212d0501847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:18.821318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b4fde-423e-4b27-8092-d212d0501847 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:18.833293 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1312/2588] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:50:18.843629 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749e9aa-d23b-427a-946c-a189683ad5e0 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:18.855472 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749e9aa-d23b-427a-946c-a189683ad5e0 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:18.860874 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e8580-beaf-4240-b4da-ce25c4cb6ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:18.861831 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e8580-beaf-4240-b4da-ce25c4cb6ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:18.862140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e8580-beaf-4240-b4da-ce25c4cb6ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:18.862426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e8580-beaf-4240-b4da-ce25c4cb6ce6 admin admin] PATH_INFO: `/v3/projects/0ba0ee3ccdc6425db221d8732aca2335/users/f72aa23298804095b631e68df19ea9cd/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:18.864963 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e8580-beaf-4240-b4da-ce25c4cb6ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba0ee3ccdc6425db221d8732aca2335, user_id=f72aa23298804095b631e68df19ea9cd, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:18.867853 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e8580-beaf-4240-b4da-ce25c4cb6ce6 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:18.880567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1277/2589] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:50:18 2022] PUT /identity/v3/projects/0ba0ee3ccdc6425db221d8732aca2335/users/f72aa23298804095b631e68df19ea9cd/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:50:18.893551 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69564269-17e6-4ae9-a8ae-53b068ae3ce9 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:18.893871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69564269-17e6-4ae9-a8ae-53b068ae3ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:18.894398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69564269-17e6-4ae9-a8ae-53b068ae3ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:18.930810 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-69564269-17e6-4ae9-a8ae-53b068ae3ce9 None None] MFA Rules not processed for user `f72aa23298804095b631e68df19ea9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:50:18.932216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-69564269-17e6-4ae9-a8ae-53b068ae3ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:19.043929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:19.049943 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1313/2590] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:50:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:50:19.066421 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e8580-beaf-4240-b4da-ce25c4cb6ce6 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:19.070351 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-c88e8580-beaf-4240-b4da-ce25c4cb6ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:19.080069 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:19.182370 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e8580-beaf-4240-b4da-ce25c4cb6ce6 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:19.188599 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780faa2b-8a1b-46c3-81ed-aace58d038d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:19.189476 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780faa2b-8a1b-46c3-81ed-aace58d038d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:19.190098 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780faa2b-8a1b-46c3-81ed-aace58d038d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:19.190441 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780faa2b-8a1b-46c3-81ed-aace58d038d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:19.202435 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780faa2b-8a1b-46c3-81ed-aace58d038d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:19.204193 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780faa2b-8a1b-46c3-81ed-aace58d038d9 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:19.217294 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1278/2591] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:50:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:50:19.368589 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69564269-17e6-4ae9-a8ae-53b068ae3ce9 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:19.370693 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-69564269-17e6-4ae9-a8ae-53b068ae3ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:19.389095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69564269-17e6-4ae9-a8ae-53b068ae3ce9 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:19.394753 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8a4d9-afab-4e05-aa5a-e1bd14762f65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:19.395985 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8a4d9-afab-4e05-aa5a-e1bd14762f65 service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:19.396536 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8a4d9-afab-4e05-aa5a-e1bd14762f65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:19.397327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8a4d9-afab-4e05-aa5a-e1bd14762f65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:19.528619 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8a4d9-afab-4e05-aa5a-e1bd14762f65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:19.532339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8a4d9-afab-4e05-aa5a-e1bd14762f65 service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:19.555491 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1314/2592] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:50:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:50:25.379778 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780faa2b-8a1b-46c3-81ed-aace58d038d9 service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:25.517180 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780faa2b-8a1b-46c3-81ed-aace58d038d9 service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:25.528075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aef10c-638d-4b33-b7c2-534218b23a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:25.529235 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aef10c-638d-4b33-b7c2-534218b23a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:25.530096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aef10c-638d-4b33-b7c2-534218b23a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:25.530643 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aef10c-638d-4b33-b7c2-534218b23a76 admin admin] PATH_INFO: `/v3/users/d07a6ff023444ec9910b37ca123b6c5c` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:25.533024 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aef10c-638d-4b33-b7c2-534218b23a76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07a6ff023444ec9910b37ca123b6c5c)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:25.538488 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aef10c-638d-4b33-b7c2-534218b23a76 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:25.902537 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-d8aef10c-638d-4b33-b7c2-534218b23a76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07a6ff023444ec9910b37ca123b6c5c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:25.927047 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-d8aef10c-638d-4b33-b7c2-534218b23a76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07a6ff023444ec9910b37ca123b6c5c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:25.939996 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-d8aef10c-638d-4b33-b7c2-534218b23a76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07a6ff023444ec9910b37ca123b6c5c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:26.297632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-d8aef10c-638d-4b33-b7c2-534218b23a76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07a6ff023444ec9910b37ca123b6c5c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:26.298445 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-d8aef10c-638d-4b33-b7c2-534218b23a76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07a6ff023444ec9910b37ca123b6c5c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:26.307152 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1279/2593] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:50:25 2022] DELETE /identity/v3/users/d07a6ff023444ec9910b37ca123b6c5c => generated 0 bytes in 928 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:50:26.314656 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092fb1d-791d-484d-9a07-9eff57e5feac None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:26.319630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092fb1d-791d-484d-9a07-9eff57e5feac None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:26.319630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092fb1d-791d-484d-9a07-9eff57e5feac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:26.348048 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-e092fb1d-791d-484d-9a07-9eff57e5feac None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:50:26.353240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e092fb1d-791d-484d-9a07-9eff57e5feac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:26.445397 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1315/2594] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:50:26.456577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aef10c-638d-4b33-b7c2-534218b23a76 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:26.458157 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-d8aef10c-638d-4b33-b7c2-534218b23a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:26.496915 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:26.558285 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aef10c-638d-4b33-b7c2-534218b23a76 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:26.565537 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbe942-9584-47b2-907d-37a2dc6574eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:26.566855 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbe942-9584-47b2-907d-37a2dc6574eb service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:26.567313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbe942-9584-47b2-907d-37a2dc6574eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:26.576539 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbe942-9584-47b2-907d-37a2dc6574eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:26.579877 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbe942-9584-47b2-907d-37a2dc6574eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:26.581471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbe942-9584-47b2-907d-37a2dc6574eb service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:26.599506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1280/2595] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:50:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:50:27.201448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092fb1d-791d-484d-9a07-9eff57e5feac None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:27.203156 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e092fb1d-791d-484d-9a07-9eff57e5feac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:27.219067 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092fb1d-791d-484d-9a07-9eff57e5feac None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:27.227198 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3bbed-ab6b-4e57-a8f0-a2be7f99857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:27.229026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3bbed-ab6b-4e57-a8f0-a2be7f99857e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:27.229892 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3bbed-ab6b-4e57-a8f0-a2be7f99857e admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:27.229892 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3bbed-ab6b-4e57-a8f0-a2be7f99857e admin admin] PATH_INFO: `/v3/projects/167fbb29bff340dbbb5a04678adb92d6` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:27.231612 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3bbed-ab6b-4e57-a8f0-a2be7f99857e admin admin] RBAC: Authorizing `identity:delete_project(project_id=167fbb29bff340dbbb5a04678adb92d6)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:27.234091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3bbed-ab6b-4e57-a8f0-a2be7f99857e admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:27.404426 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c8e3bbed-ab6b-4e57-a8f0-a2be7f99857e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167fbb29bff340dbbb5a04678adb92d6', 'request_id': 'req-c8e3bbed-ab6b-4e57-a8f0-a2be7f99857e'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:27.478566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c8e3bbed-ab6b-4e57-a8f0-a2be7f99857e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167fbb29bff340dbbb5a04678adb92d6', 'request_id': 'req-c8e3bbed-ab6b-4e57-a8f0-a2be7f99857e'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:27.492005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c8e3bbed-ab6b-4e57-a8f0-a2be7f99857e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167fbb29bff340dbbb5a04678adb92d6', 'request_id': 'req-c8e3bbed-ab6b-4e57-a8f0-a2be7f99857e'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:27.517573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c8e3bbed-ab6b-4e57-a8f0-a2be7f99857e admin admin] The token cache is being invalidate because project 167fbb29bff340dbbb5a04678adb92d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:50:27.520306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c8e3bbed-ab6b-4e57-a8f0-a2be7f99857e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:27.520306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-c8e3bbed-ab6b-4e57-a8f0-a2be7f99857e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:27.526389 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1316/2596] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:50:27 2022] DELETE /identity/v3/projects/167fbb29bff340dbbb5a04678adb92d6 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:50:27.528645 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbe942-9584-47b2-907d-37a2dc6574eb service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:27.550245 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbe942-9584-47b2-907d-37a2dc6574eb service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:27.646143 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5b6dd-b5e2-4c01-9b23-7ecdb605e849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:27.647973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5b6dd-b5e2-4c01-9b23-7ecdb605e849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:27.648193 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5b6dd-b5e2-4c01-9b23-7ecdb605e849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:27.648433 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5b6dd-b5e2-4c01-9b23-7ecdb605e849 admin admin] PATH_INFO: `/v3/users/9ae4ea003741464392fa147b44ba41c0` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:27.649841 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5b6dd-b5e2-4c01-9b23-7ecdb605e849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae4ea003741464392fa147b44ba41c0)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:27.651861 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5b6dd-b5e2-4c01-9b23-7ecdb605e849 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:27.905290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0cf5b6dd-b5e2-4c01-9b23-7ecdb605e849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae4ea003741464392fa147b44ba41c0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:27.926049 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0cf5b6dd-b5e2-4c01-9b23-7ecdb605e849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae4ea003741464392fa147b44ba41c0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:27.936951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0cf5b6dd-b5e2-4c01-9b23-7ecdb605e849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae4ea003741464392fa147b44ba41c0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:28.009083 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0cf5b6dd-b5e2-4c01-9b23-7ecdb605e849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae4ea003741464392fa147b44ba41c0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:28.009795 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0cf5b6dd-b5e2-4c01-9b23-7ecdb605e849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae4ea003741464392fa147b44ba41c0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:28.017849 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1281/2597] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:50:27 2022] DELETE /identity/v3/users/9ae4ea003741464392fa147b44ba41c0 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:50:28.576887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3bbed-ab6b-4e57-a8f0-a2be7f99857e admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:28.578535 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-c8e3bbed-ab6b-4e57-a8f0-a2be7f99857e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:28.598976 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3bbed-ab6b-4e57-a8f0-a2be7f99857e admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:28.626154 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:28.694716 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb6975-2ac9-4212-806c-9f1485d35e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:28.696224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb6975-2ac9-4212-806c-9f1485d35e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:28.696652 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb6975-2ac9-4212-806c-9f1485d35e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:28.697165 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb6975-2ac9-4212-806c-9f1485d35e56 admin admin] PATH_INFO: `/v3/projects/f1c1ec1025344017817829d49b82e504` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:28.699638 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb6975-2ac9-4212-806c-9f1485d35e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c1ec1025344017817829d49b82e504)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:28.703394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb6975-2ac9-4212-806c-9f1485d35e56 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:28.886222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-82bb6975-2ac9-4212-806c-9f1485d35e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c1ec1025344017817829d49b82e504', 'request_id': 'req-82bb6975-2ac9-4212-806c-9f1485d35e56'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:29.021299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-82bb6975-2ac9-4212-806c-9f1485d35e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c1ec1025344017817829d49b82e504', 'request_id': 'req-82bb6975-2ac9-4212-806c-9f1485d35e56'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:29.041642 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-82bb6975-2ac9-4212-806c-9f1485d35e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c1ec1025344017817829d49b82e504', 'request_id': 'req-82bb6975-2ac9-4212-806c-9f1485d35e56'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:29.066660 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-82bb6975-2ac9-4212-806c-9f1485d35e56 admin admin] The token cache is being invalidate because project f1c1ec1025344017817829d49b82e504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:50:29.067161 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-82bb6975-2ac9-4212-806c-9f1485d35e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:29.068384 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-82bb6975-2ac9-4212-806c-9f1485d35e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:29.071761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1317/2598] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:50:28 2022] DELETE /identity/v3/projects/f1c1ec1025344017817829d49b82e504 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:50:29.077999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5b6dd-b5e2-4c01-9b23-7ecdb605e849 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:29.080301 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0cf5b6dd-b5e2-4c01-9b23-7ecdb605e849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:29.106802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5b6dd-b5e2-4c01-9b23-7ecdb605e849 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:29.193269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:29.211634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d197753-2126-4b3c-a943-bc176fae4389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:29.212927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d197753-2126-4b3c-a943-bc176fae4389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:29.213367 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d197753-2126-4b3c-a943-bc176fae4389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:29.213653 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d197753-2126-4b3c-a943-bc176fae4389 admin admin] PATH_INFO: `/v3/users/f72aa23298804095b631e68df19ea9cd` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:29.215202 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d197753-2126-4b3c-a943-bc176fae4389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f72aa23298804095b631e68df19ea9cd)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:29.217487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d197753-2126-4b3c-a943-bc176fae4389 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:29.499304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0d197753-2126-4b3c-a943-bc176fae4389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f72aa23298804095b631e68df19ea9cd'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:29.545396 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0d197753-2126-4b3c-a943-bc176fae4389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f72aa23298804095b631e68df19ea9cd'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:29.564735 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0d197753-2126-4b3c-a943-bc176fae4389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f72aa23298804095b631e68df19ea9cd'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:29.691224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0d197753-2126-4b3c-a943-bc176fae4389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f72aa23298804095b631e68df19ea9cd'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:29.692217 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0d197753-2126-4b3c-a943-bc176fae4389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f72aa23298804095b631e68df19ea9cd'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:29.701839 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1282/2599] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:50:29 2022] DELETE /identity/v3/users/f72aa23298804095b631e68df19ea9cd => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:50:30.915794 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb6975-2ac9-4212-806c-9f1485d35e56 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:30.920033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-82bb6975-2ac9-4212-806c-9f1485d35e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:30.938250 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb6975-2ac9-4212-806c-9f1485d35e56 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:31.036605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aff41a-b15e-4517-ae2c-3118bf313c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:31.038818 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aff41a-b15e-4517-ae2c-3118bf313c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:31.039437 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aff41a-b15e-4517-ae2c-3118bf313c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:31.039793 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aff41a-b15e-4517-ae2c-3118bf313c8b admin admin] PATH_INFO: `/v3/projects/0ba0ee3ccdc6425db221d8732aca2335` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:31.041306 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aff41a-b15e-4517-ae2c-3118bf313c8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ba0ee3ccdc6425db221d8732aca2335)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:31.043626 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aff41a-b15e-4517-ae2c-3118bf313c8b admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:31.251440 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-45aff41a-b15e-4517-ae2c-3118bf313c8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ba0ee3ccdc6425db221d8732aca2335', 'request_id': 'req-45aff41a-b15e-4517-ae2c-3118bf313c8b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:31.258676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:31.345946 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-45aff41a-b15e-4517-ae2c-3118bf313c8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ba0ee3ccdc6425db221d8732aca2335', 'request_id': 'req-45aff41a-b15e-4517-ae2c-3118bf313c8b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:31.359430 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-45aff41a-b15e-4517-ae2c-3118bf313c8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ba0ee3ccdc6425db221d8732aca2335', 'request_id': 'req-45aff41a-b15e-4517-ae2c-3118bf313c8b'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:31.391331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-45aff41a-b15e-4517-ae2c-3118bf313c8b admin admin] The token cache is being invalidate because project 0ba0ee3ccdc6425db221d8732aca2335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:50:31.393754 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-45aff41a-b15e-4517-ae2c-3118bf313c8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:31.396279 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-45aff41a-b15e-4517-ae2c-3118bf313c8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:31.406555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970d366-3bc6-48ba-9a1b-393440a15547 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:31.408638 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970d366-3bc6-48ba-9a1b-393440a15547 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:31.409165 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970d366-3bc6-48ba-9a1b-393440a15547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:31.437356 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1318/2600] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:50:30 2022] DELETE /identity/v3/projects/0ba0ee3ccdc6425db221d8732aca2335 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:50:31.483151 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-1970d366-3bc6-48ba-9a1b-393440a15547 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:50:31.484723 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-1970d366-3bc6-48ba-9a1b-393440a15547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:31.629163 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1283/2601] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:50:31.639837 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbcc4a-410e-464d-9d55-5ce1ccc9d066 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:31.640359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbcc4a-410e-464d-9d55-5ce1ccc9d066 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:31.640871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbcc4a-410e-464d-9d55-5ce1ccc9d066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:31.679133 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-e1fbcc4a-410e-464d-9d55-5ce1ccc9d066 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:50:31.681807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e1fbcc4a-410e-464d-9d55-5ce1ccc9d066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:31.699646 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1319/2602] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:50:31.716937 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970d366-3bc6-48ba-9a1b-393440a15547 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:31.735821 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970d366-3bc6-48ba-9a1b-393440a15547 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:31.746114 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0db329-2d49-467f-a13f-d4bd89878e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:31.746906 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0db329-2d49-467f-a13f-d4bd89878e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:31.747302 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0db329-2d49-467f-a13f-d4bd89878e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:31.747650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0db329-2d49-467f-a13f-d4bd89878e76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:31.748509 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0db329-2d49-467f-a13f-d4bd89878e76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:50:31.748961 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0db329-2d49-467f-a13f-d4bd89878e76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:31.750836 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0db329-2d49-467f-a13f-d4bd89878e76 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:31.773343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1284/2603] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:50:31.774738 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbcc4a-410e-464d-9d55-5ce1ccc9d066 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:31.785331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbcc4a-410e-464d-9d55-5ce1ccc9d066 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:31.791222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c7c32-703c-47db-818b-74f89547ec34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:31.794100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c7c32-703c-47db-818b-74f89547ec34 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:31.794100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c7c32-703c-47db-818b-74f89547ec34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:31.794100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c7c32-703c-47db-818b-74f89547ec34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:31.794100 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c7c32-703c-47db-818b-74f89547ec34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:31.796541 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c7c32-703c-47db-818b-74f89547ec34 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:31.928701 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1320/2604] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:50:31 2022] POST /identity/v3/projects => generated 369 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:50:31.939983 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0db329-2d49-467f-a13f-d4bd89878e76 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:31.942280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0db329-2d49-467f-a13f-d4bd89878e76 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:32.043630 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:32.058502 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7e714-6e1d-4d8d-8e14-cb1edcb3debb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:32.059618 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e714-6e1d-4d8d-8e14-cb1edcb3debb admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:32.060076 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e714-6e1d-4d8d-8e14-cb1edcb3debb admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:32.060733 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e714-6e1d-4d8d-8e14-cb1edcb3debb admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:32.061813 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7e714-6e1d-4d8d-8e14-cb1edcb3debb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:32.064558 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7e714-6e1d-4d8d-8e14-cb1edcb3debb admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:32.254218 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1285/2605] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:50:31 2022] POST /identity/v3/users => generated 285 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:50:32.267113 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c7c32-703c-47db-818b-74f89547ec34 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:32.281821 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c7c32-703c-47db-818b-74f89547ec34 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:32.287639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d679a4-6aa7-4a83-a315-003455259b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:32.288979 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d679a4-6aa7-4a83-a315-003455259b34 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:32.289437 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d679a4-6aa7-4a83-a315-003455259b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:32.289883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d679a4-6aa7-4a83-a315-003455259b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:32.290977 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d679a4-6aa7-4a83-a315-003455259b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:32.292784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d679a4-6aa7-4a83-a315-003455259b34 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:32.309442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7e714-6e1d-4d8d-8e14-cb1edcb3debb admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:32.310510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1321/2606] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:50:32.321516 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7e714-6e1d-4d8d-8e14-cb1edcb3debb admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:32.327503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc1fc7-dd46-4050-8ec1-534c6f1e6c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:32.328426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc1fc7-dd46-4050-8ec1-534c6f1e6c9c admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:32.328932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc1fc7-dd46-4050-8ec1-534c6f1e6c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:32.329371 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc1fc7-dd46-4050-8ec1-534c6f1e6c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:32.331393 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc1fc7-dd46-4050-8ec1-534c6f1e6c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:32.338626 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc1fc7-dd46-4050-8ec1-534c6f1e6c9c admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:32.358721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1286/2607] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:50:32.366421 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d679a4-6aa7-4a83-a315-003455259b34 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:32.377118 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d679a4-6aa7-4a83-a315-003455259b34 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:32.383372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79424b6f-72c2-447b-bca2-47f1c42cfecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:32.384598 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79424b6f-72c2-447b-bca2-47f1c42cfecb admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:32.385082 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79424b6f-72c2-447b-bca2-47f1c42cfecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:32.385581 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79424b6f-72c2-447b-bca2-47f1c42cfecb admin admin] PATH_INFO: `/v3/projects/c54e230ac795428997374e27ddbde495/users/a3c4d4a543954c38854ca459d7a353a3/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:32.408206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79424b6f-72c2-447b-bca2-47f1c42cfecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54e230ac795428997374e27ddbde495, user_id=a3c4d4a543954c38854ca459d7a353a3, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:32.411335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79424b6f-72c2-447b-bca2-47f1c42cfecb admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:32.516802 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1322/2608] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:50:32 2022] PUT /identity/v3/projects/c54e230ac795428997374e27ddbde495/users/a3c4d4a543954c38854ca459d7a353a3/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:50:32.526778 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3da5a2-7ffd-4cea-ac29-952bc307adc3 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:32.527484 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3da5a2-7ffd-4cea-ac29-952bc307adc3 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:32.527665 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3da5a2-7ffd-4cea-ac29-952bc307adc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:32.580531 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-ef3da5a2-7ffd-4cea-ac29-952bc307adc3 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:50:32.582801 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ef3da5a2-7ffd-4cea-ac29-952bc307adc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:32.714105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1287/2609] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:50:32.756726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79424b6f-72c2-447b-bca2-47f1c42cfecb admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:32.758540 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-79424b6f-72c2-447b-bca2-47f1c42cfecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:32.895026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79424b6f-72c2-447b-bca2-47f1c42cfecb admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:32.900951 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8aaa9-2e6f-44b3-a1f8-9165bd5b1721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:32.901946 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8aaa9-2e6f-44b3-a1f8-9165bd5b1721 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:32.903117 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8aaa9-2e6f-44b3-a1f8-9165bd5b1721 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:32.903668 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8aaa9-2e6f-44b3-a1f8-9165bd5b1721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:32.921430 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8aaa9-2e6f-44b3-a1f8-9165bd5b1721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:32.923128 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8aaa9-2e6f-44b3-a1f8-9165bd5b1721 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:32.940929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1323/2610] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:50:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:50:33.251951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3da5a2-7ffd-4cea-ac29-952bc307adc3 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:33.264039 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3da5a2-7ffd-4cea-ac29-952bc307adc3 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:33.268498 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a83ca3-9772-4e0d-870e-56ff3ede4899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:33.269863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a83ca3-9772-4e0d-870e-56ff3ede4899 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:33.270202 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a83ca3-9772-4e0d-870e-56ff3ede4899 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:33.270602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a83ca3-9772-4e0d-870e-56ff3ede4899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:33.274235 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-50a83ca3-9772-4e0d-870e-56ff3ede4899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:33.289627 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a83ca3-9772-4e0d-870e-56ff3ede4899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:33.291096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a83ca3-9772-4e0d-870e-56ff3ede4899 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:33.307773 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1288/2611] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:50:34.809276 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945f99f-5115-4e00-a810-396f4d5fd64b None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:34.810290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945f99f-5115-4e00-a810-396f4d5fd64b None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:34.810786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945f99f-5115-4e00-a810-396f4d5fd64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:34.844834 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-3945f99f-5115-4e00-a810-396f4d5fd64b None None] MFA Rules not processed for user `a3c4d4a543954c38854ca459d7a353a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:50:34.846412 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-3945f99f-5115-4e00-a810-396f4d5fd64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:34.982530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1324/2612] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:50:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:50:34.988294 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a83ca3-9772-4e0d-870e-56ff3ede4899 service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:35.009720 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a83ca3-9772-4e0d-870e-56ff3ede4899 service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:35.016099 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f1bd5-a143-407c-94f9-523145012a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:35.016801 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f1bd5-a143-407c-94f9-523145012a2c admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:35.017127 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f1bd5-a143-407c-94f9-523145012a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:35.017449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f1bd5-a143-407c-94f9-523145012a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:35.018231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f1bd5-a143-407c-94f9-523145012a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:35.020572 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f1bd5-a143-407c-94f9-523145012a2c admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:35.149453 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1289/2613] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:50:34 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:50:35.153554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945f99f-5115-4e00-a810-396f4d5fd64b None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:35.168168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945f99f-5115-4e00-a810-396f4d5fd64b None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:35.181854 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:35.268256 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efc1a0-5589-44a5-8a2b-8a609ff35bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:35.269178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efc1a0-5589-44a5-8a2b-8a609ff35bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:35.269796 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efc1a0-5589-44a5-8a2b-8a609ff35bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:35.272605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efc1a0-5589-44a5-8a2b-8a609ff35bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:35.272605 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efc1a0-5589-44a5-8a2b-8a609ff35bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:35.274906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efc1a0-5589-44a5-8a2b-8a609ff35bd9 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:35.385849 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1325/2614] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:50:35 2022] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:50:35.387223 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f1bd5-a143-407c-94f9-523145012a2c admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:35.400347 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f1bd5-a143-407c-94f9-523145012a2c admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:35.406011 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b532cd-9546-4b1d-9f59-7aca868a1123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:35.407133 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b532cd-9546-4b1d-9f59-7aca868a1123 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:35.407465 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b532cd-9546-4b1d-9f59-7aca868a1123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:35.407944 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b532cd-9546-4b1d-9f59-7aca868a1123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:35.408896 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b532cd-9546-4b1d-9f59-7aca868a1123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:35.410590 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b532cd-9546-4b1d-9f59-7aca868a1123 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:35.441689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1290/2615] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:50:35.447386 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efc1a0-5589-44a5-8a2b-8a609ff35bd9 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:35.476183 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efc1a0-5589-44a5-8a2b-8a609ff35bd9 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:35.499851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfab18-dad7-423e-85f3-1bd99bdd2388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:35.501083 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfab18-dad7-423e-85f3-1bd99bdd2388 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:35.501612 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfab18-dad7-423e-85f3-1bd99bdd2388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:35.502310 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfab18-dad7-423e-85f3-1bd99bdd2388 admin admin] PATH_INFO: `/v3/projects/1538412a302b432ba24c8a6f6df130a9/users/6dbb19583465411689f6b4d9b5a0d1fe/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:35.529824 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfab18-dad7-423e-85f3-1bd99bdd2388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1538412a302b432ba24c8a6f6df130a9, user_id=6dbb19583465411689f6b4d9b5a0d1fe, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:35.534447 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfab18-dad7-423e-85f3-1bd99bdd2388 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:35.572706 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74daaa-62b8-40e5-acc0-b9a53248975d None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:35.572958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74daaa-62b8-40e5-acc0-b9a53248975d None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:35.573279 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74daaa-62b8-40e5-acc0-b9a53248975d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:35.596713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-8d74daaa-62b8-40e5-acc0-b9a53248975d None None] MFA Rules not processed for user `5ec758ef106b49f4985845b3c106f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:50:35.598224 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-8d74daaa-62b8-40e5-acc0-b9a53248975d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:35.629553 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1326/2616] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:50:35 2022] PUT /identity/v3/projects/1538412a302b432ba24c8a6f6df130a9/users/6dbb19583465411689f6b4d9b5a0d1fe/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:50:35.638562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfab18-dad7-423e-85f3-1bd99bdd2388 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:35.737494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1291/2617] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Jul 12 14:50:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:50:35.778674 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfab18-dad7-423e-85f3-1bd99bdd2388 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:35.788548 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65174745-52f6-4ec3-a970-72b49d3d2349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:35.789743 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65174745-52f6-4ec3-a970-72b49d3d2349 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:35.790245 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65174745-52f6-4ec3-a970-72b49d3d2349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:35.790751 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65174745-52f6-4ec3-a970-72b49d3d2349 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:35.792573 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65174745-52f6-4ec3-a970-72b49d3d2349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:35.795993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65174745-52f6-4ec3-a970-72b49d3d2349 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:35.822143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1327/2618] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:50:35.828453 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74daaa-62b8-40e5-acc0-b9a53248975d None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:35.844150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74daaa-62b8-40e5-acc0-b9a53248975d None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:35.850314 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42830b1e-1535-4049-8226-2dcbf70bb8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:35.852269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42830b1e-1535-4049-8226-2dcbf70bb8c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:35.852681 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42830b1e-1535-4049-8226-2dcbf70bb8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:35.853082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42830b1e-1535-4049-8226-2dcbf70bb8c0 admin admin] PATH_INFO: `/v3/projects/1538412a302b432ba24c8a6f6df130a9/users/6dbb19583465411689f6b4d9b5a0d1fe/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:35.856510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42830b1e-1535-4049-8226-2dcbf70bb8c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1538412a302b432ba24c8a6f6df130a9, user_id=6dbb19583465411689f6b4d9b5a0d1fe, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:35.859072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42830b1e-1535-4049-8226-2dcbf70bb8c0 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:35.880505 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1292/2619] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:50:35 2022] PUT /identity/v3/projects/1538412a302b432ba24c8a6f6df130a9/users/6dbb19583465411689f6b4d9b5a0d1fe/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:50:35.906859 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65174745-52f6-4ec3-a970-72b49d3d2349 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:35.910804 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-65174745-52f6-4ec3-a970-72b49d3d2349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:36.016770 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65174745-52f6-4ec3-a970-72b49d3d2349 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:36.051621 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:36.189331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5cc6e-cfd5-42bd-b7a8-a7ddd857618b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad12085f356a4f0682bb70ad231a10b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:36.190620 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5cc6e-cfd5-42bd-b7a8-a7ddd857618b service swift] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:36.191206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5cc6e-cfd5-42bd-b7a8-a7ddd857618b service swift] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:36.191767 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5cc6e-cfd5-42bd-b7a8-a7ddd857618b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:36.304357 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5cc6e-cfd5-42bd-b7a8-a7ddd857618b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:36.307096 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5cc6e-cfd5-42bd-b7a8-a7ddd857618b service swift] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:36.322695 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1328/2620] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Jul 12 14:50:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 14:50:38.468870 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfcf07-b9a2-4a9d-a961-383ab03cf7e0 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:38.474540 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfcf07-b9a2-4a9d-a961-383ab03cf7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:38.476145 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfcf07-b9a2-4a9d-a961-383ab03cf7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:38.539318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:38.560698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-97dfcf07-b9a2-4a9d-a961-383ab03cf7e0 None None] MFA Rules not processed for user `6dbb19583465411689f6b4d9b5a0d1fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:50:38.562194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-97dfcf07-b9a2-4a9d-a961-383ab03cf7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:38.700969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1293/2621] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:50:38 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:50:38.713809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581f60d-198e-48f8-b890-7647e855696f None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:38.715525 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581f60d-198e-48f8-b890-7647e855696f None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:38.716272 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581f60d-198e-48f8-b890-7647e855696f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:38.780318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-8581f60d-198e-48f8-b890-7647e855696f None None] MFA Rules not processed for user `a3c4d4a543954c38854ca459d7a353a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:50:38.783677 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-8581f60d-198e-48f8-b890-7647e855696f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:38.911340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1329/2622] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:50:38 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:50:38.925854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfcf07-b9a2-4a9d-a961-383ab03cf7e0 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:38.927387 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-97dfcf07-b9a2-4a9d-a961-383ab03cf7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:39.143888 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfcf07-b9a2-4a9d-a961-383ab03cf7e0 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:39.151739 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c5799-0222-477f-a6b2-11834a81c03d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:39.152421 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c5799-0222-477f-a6b2-11834a81c03d service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:39.152702 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c5799-0222-477f-a6b2-11834a81c03d service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:39.152985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c5799-0222-477f-a6b2-11834a81c03d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:39.163880 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c5799-0222-477f-a6b2-11834a81c03d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:39.165635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c5799-0222-477f-a6b2-11834a81c03d service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:39.202052 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1294/2623] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:50:38 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:50:47.453965 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581f60d-198e-48f8-b890-7647e855696f None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:47.456195 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-8581f60d-198e-48f8-b890-7647e855696f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:47.581677 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581f60d-198e-48f8-b890-7647e855696f None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:47.588137 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ea8fa-6631-42c6-998b-3b544215fc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:47.589459 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ea8fa-6631-42c6-998b-3b544215fc60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:47.589969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ea8fa-6631-42c6-998b-3b544215fc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:47.590446 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ea8fa-6631-42c6-998b-3b544215fc60 admin admin] PATH_INFO: `/v3/users/389c703353304654a3d6c3dffac3f423` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:47.592013 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ea8fa-6631-42c6-998b-3b544215fc60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=389c703353304654a3d6c3dffac3f423)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:47.594561 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ea8fa-6631-42c6-998b-3b544215fc60 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:47.597983 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:47.868167 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-288ea8fa-6631-42c6-998b-3b544215fc60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '389c703353304654a3d6c3dffac3f423'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:47.952001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-288ea8fa-6631-42c6-998b-3b544215fc60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '389c703353304654a3d6c3dffac3f423'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:48.088102 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-288ea8fa-6631-42c6-998b-3b544215fc60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '389c703353304654a3d6c3dffac3f423'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:48.089399 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-288ea8fa-6631-42c6-998b-3b544215fc60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '389c703353304654a3d6c3dffac3f423'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:48.115986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-288ea8fa-6631-42c6-998b-3b544215fc60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '389c703353304654a3d6c3dffac3f423'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:48.130599 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1330/2624] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:50:47 2022] DELETE /identity/v3/users/389c703353304654a3d6c3dffac3f423 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:50:48.550249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c5799-0222-477f-a6b2-11834a81c03d service nova] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:48.600698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c5799-0222-477f-a6b2-11834a81c03d service nova] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:48.803596 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748dbf13-a0c2-4e0e-8b27-bac3e98e2ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:48.805399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748dbf13-a0c2-4e0e-8b27-bac3e98e2ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:48.806061 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748dbf13-a0c2-4e0e-8b27-bac3e98e2ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:48.806704 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748dbf13-a0c2-4e0e-8b27-bac3e98e2ae0 admin admin] PATH_INFO: `/v3/projects/d67f3e63e32649f2b9c51ba820df61ed` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:48.809420 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748dbf13-a0c2-4e0e-8b27-bac3e98e2ae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d67f3e63e32649f2b9c51ba820df61ed)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:48.814168 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748dbf13-a0c2-4e0e-8b27-bac3e98e2ae0 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:48.827498 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:49.067944 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-748dbf13-a0c2-4e0e-8b27-bac3e98e2ae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd67f3e63e32649f2b9c51ba820df61ed', 'request_id': 'req-748dbf13-a0c2-4e0e-8b27-bac3e98e2ae0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:49.111044 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-748dbf13-a0c2-4e0e-8b27-bac3e98e2ae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd67f3e63e32649f2b9c51ba820df61ed', 'request_id': 'req-748dbf13-a0c2-4e0e-8b27-bac3e98e2ae0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:49.154188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-748dbf13-a0c2-4e0e-8b27-bac3e98e2ae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd67f3e63e32649f2b9c51ba820df61ed', 'request_id': 'req-748dbf13-a0c2-4e0e-8b27-bac3e98e2ae0'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:49.298164 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-748dbf13-a0c2-4e0e-8b27-bac3e98e2ae0 admin admin] The token cache is being invalidate because project d67f3e63e32649f2b9c51ba820df61ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:50:49.298799 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-748dbf13-a0c2-4e0e-8b27-bac3e98e2ae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:49.300221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-748dbf13-a0c2-4e0e-8b27-bac3e98e2ae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:49.304082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1295/2625] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:50:48 2022] DELETE /identity/v3/projects/d67f3e63e32649f2b9c51ba820df61ed => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:50:49.308709 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ea8fa-6631-42c6-998b-3b544215fc60 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:49.312579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-288ea8fa-6631-42c6-998b-3b544215fc60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:49.347947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ea8fa-6631-42c6-998b-3b544215fc60 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:49.433917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d5f04-47d8-456a-897a-7dbfd1c77a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:49.435409 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d5f04-47d8-456a-897a-7dbfd1c77a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:49.435969 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d5f04-47d8-456a-897a-7dbfd1c77a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:49.436497 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d5f04-47d8-456a-897a-7dbfd1c77a84 admin admin] PATH_INFO: `/v3/users/ee918260b5864fbdbcc6e6a46e86556a` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:49.438708 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d5f04-47d8-456a-897a-7dbfd1c77a84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee918260b5864fbdbcc6e6a46e86556a)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:49.441078 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d5f04-47d8-456a-897a-7dbfd1c77a84 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:49.763910 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-773d5f04-47d8-456a-897a-7dbfd1c77a84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee918260b5864fbdbcc6e6a46e86556a'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:49.791708 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-773d5f04-47d8-456a-897a-7dbfd1c77a84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee918260b5864fbdbcc6e6a46e86556a'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:49.891683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-773d5f04-47d8-456a-897a-7dbfd1c77a84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee918260b5864fbdbcc6e6a46e86556a'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:49.894379 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-773d5f04-47d8-456a-897a-7dbfd1c77a84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee918260b5864fbdbcc6e6a46e86556a'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:49.914172 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-773d5f04-47d8-456a-897a-7dbfd1c77a84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee918260b5864fbdbcc6e6a46e86556a'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:49.919563 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:50:49.926268 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1331/2626] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:50:49 2022] DELETE /identity/v3/users/ee918260b5864fbdbcc6e6a46e86556a => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:50:50.291968 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748dbf13-a0c2-4e0e-8b27-bac3e98e2ae0 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:50:50.293902 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-748dbf13-a0c2-4e0e-8b27-bac3e98e2ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:50:50.340834 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748dbf13-a0c2-4e0e-8b27-bac3e98e2ae0 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:50:50.460520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ca398-0771-4f56-8ccd-d6c9d4759d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:50:50.466135 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ca398-0771-4f56-8ccd-d6c9d4759d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:50:50.466779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ca398-0771-4f56-8ccd-d6c9d4759d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:50:50.467587 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ca398-0771-4f56-8ccd-d6c9d4759d60 admin admin] PATH_INFO: `/v3/projects/c3b654209dac46c4ab9cd4850d3930cf` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:50:50.470481 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ca398-0771-4f56-8ccd-d6c9d4759d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b654209dac46c4ab9cd4850d3930cf)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:50:50.473243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ca398-0771-4f56-8ccd-d6c9d4759d60 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:50:50.748230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-531ca398-0771-4f56-8ccd-d6c9d4759d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b654209dac46c4ab9cd4850d3930cf', 'request_id': 'req-531ca398-0771-4f56-8ccd-d6c9d4759d60'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:50.748230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-531ca398-0771-4f56-8ccd-d6c9d4759d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b654209dac46c4ab9cd4850d3930cf', 'request_id': 'req-531ca398-0771-4f56-8ccd-d6c9d4759d60'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:50.752256 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-531ca398-0771-4f56-8ccd-d6c9d4759d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b654209dac46c4ab9cd4850d3930cf', 'request_id': 'req-531ca398-0771-4f56-8ccd-d6c9d4759d60'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:50.862325 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-531ca398-0771-4f56-8ccd-d6c9d4759d60 admin admin] The token cache is being invalidate because project c3b654209dac46c4ab9cd4850d3930cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:50:50.863491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-531ca398-0771-4f56-8ccd-d6c9d4759d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:50.864933 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-531ca398-0771-4f56-8ccd-d6c9d4759d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:50:50.869131 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1296/2627] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:50:50 2022] DELETE /identity/v3/projects/c3b654209dac46c4ab9cd4850d3930cf => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:51:00.856982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=74,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:01.723450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190127b-5a52-4ea0-8204-d812a2f7ae72 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:01.724203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190127b-5a52-4ea0-8204-d812a2f7ae72 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:01.724203 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190127b-5a52-4ea0-8204-d812a2f7ae72 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:01.726682 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1332/2628] 10.222.0.40 () {54 vars in 921 bytes} [Tue Jul 12 14:51:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:51:01.734094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c809fe3-b4d7-4cb6-861f-35e55d85318c None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:01.734529 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c809fe3-b4d7-4cb6-861f-35e55d85318c None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:01.734917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c809fe3-b4d7-4cb6-861f-35e55d85318c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:01.758558 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-3c809fe3-b4d7-4cb6-861f-35e55d85318c None None] MFA Rules not processed for user `122fc227de9d4f87a66e4a0d86ff0b16`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:51:01.765936 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-3c809fe3-b4d7-4cb6-861f-35e55d85318c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:01.863112 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1297/2629] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Jul 12 14:51:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:51:01.876749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190127b-5a52-4ea0-8204-d812a2f7ae72 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:01.878689 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-c190127b-5a52-4ea0-8204-d812a2f7ae72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:01.956343 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190127b-5a52-4ea0-8204-d812a2f7ae72 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:01.961338 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0455ca-9172-4467-82c7-b7bc6942ec13 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37932500740c4ccb96358bd751d01598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:01.962073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0455ca-9172-4467-82c7-b7bc6942ec13 service glance] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:01.962402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0455ca-9172-4467-82c7-b7bc6942ec13 service glance] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:01.962727 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0455ca-9172-4467-82c7-b7bc6942ec13 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:01.975656 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0455ca-9172-4467-82c7-b7bc6942ec13 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:01.977352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0455ca-9172-4467-82c7-b7bc6942ec13 service glance] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:01.991774 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1333/2630] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:51:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:51:02.304445 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ee02c-0889-421e-9fde-23f825a0892e None None] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:02.304715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ee02c-0889-421e-9fde-23f825a0892e None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:02.304990 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ee02c-0889-421e-9fde-23f825a0892e None None] PATH_INFO: `/` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:02.306666 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1298/2631] 10.222.0.40 () {54 vars in 921 bytes} [Tue Jul 12 14:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:51:02.313107 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d1028-3b31-4c17-ad4d-438709633f68 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:02.313415 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d1028-3b31-4c17-ad4d-438709633f68 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:02.313738 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d1028-3b31-4c17-ad4d-438709633f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:02.336934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-129d1028-3b31-4c17-ad4d-438709633f68 None None] MFA Rules not processed for user `2af2d348fc984ed897fd58196b433b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:51:02.338330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-129d1028-3b31-4c17-ad4d-438709633f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:02.407602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1334/2632] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Jul 12 14:51:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:51:02.420895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ee02c-0889-421e-9fde-23f825a0892e None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:02.422939 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fa4ee02c-0889-421e-9fde-23f825a0892e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:02.439160 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ee02c-0889-421e-9fde-23f825a0892e None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:02.444030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271dcabf-e7fc-4ba0-87c5-dd3bb43216ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:02.444458 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dcabf-e7fc-4ba0-87c5-dd3bb43216ea service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:02.444733 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dcabf-e7fc-4ba0-87c5-dd3bb43216ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:02.445011 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dcabf-e7fc-4ba0-87c5-dd3bb43216ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:02.453678 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271dcabf-e7fc-4ba0-87c5-dd3bb43216ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:02.455163 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271dcabf-e7fc-4ba0-87c5-dd3bb43216ea service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:02.466554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1299/2633] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:51:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:51:02.601330 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f60bab-7b52-43f2-a1ca-240f5ae831f2 None None] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:02.601814 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f60bab-7b52-43f2-a1ca-240f5ae831f2 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:02.602311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f60bab-7b52-43f2-a1ca-240f5ae831f2 None None] PATH_INFO: `/` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:02.604690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1335/2634] 10.222.0.40 () {54 vars in 921 bytes} [Tue Jul 12 14:51:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 14:51:02.612782 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb772eec-c737-480a-aa98-2bf59d018850 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:02.613072 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb772eec-c737-480a-aa98-2bf59d018850 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:02.613356 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb772eec-c737-480a-aa98-2bf59d018850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:02.642608 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-fb772eec-c737-480a-aa98-2bf59d018850 None None] MFA Rules not processed for user `122fc227de9d4f87a66e4a0d86ff0b16`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:51:02.644573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fb772eec-c737-480a-aa98-2bf59d018850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:02.657395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1300/2635] 10.222.0.40 () {58 vars in 1018 bytes} [Tue Jul 12 14:51:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:51:02.675078 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f60bab-7b52-43f2-a1ca-240f5ae831f2 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:02.689866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f60bab-7b52-43f2-a1ca-240f5ae831f2 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:02.695132 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5411e-a2d9-4a16-a76e-5c98aedfb3b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:02.696580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5411e-a2d9-4a16-a76e-5c98aedfb3b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:02.697105 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5411e-a2d9-4a16-a76e-5c98aedfb3b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:02.697502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5411e-a2d9-4a16-a76e-5c98aedfb3b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:02.714999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5411e-a2d9-4a16-a76e-5c98aedfb3b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:02.717798 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5411e-a2d9-4a16-a76e-5c98aedfb3b7 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:02.737946 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1336/2636] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:51:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:51:03.567768 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb772eec-c737-480a-aa98-2bf59d018850 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:03.570435 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-fb772eec-c737-480a-aa98-2bf59d018850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:03.647892 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb772eec-c737-480a-aa98-2bf59d018850 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:03.651944 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e580f-affe-4b2e-829e-d98337f63a2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:03.652626 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e580f-affe-4b2e-829e-d98337f63a2e service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:03.652907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e580f-affe-4b2e-829e-d98337f63a2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:03.653193 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e580f-affe-4b2e-829e-d98337f63a2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:03.655406 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ad8e580f-affe-4b2e-829e-d98337f63a2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:03.740737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e580f-affe-4b2e-829e-d98337f63a2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:03.743883 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e580f-affe-4b2e-829e-d98337f63a2e service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:03.767137 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1301/2637] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:51:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:51:07.227221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750af984-375f-4136-8c1d-85afe8b56980 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:07.227869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750af984-375f-4136-8c1d-85afe8b56980 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:07.227869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750af984-375f-4136-8c1d-85afe8b56980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:07.248127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-750af984-375f-4136-8c1d-85afe8b56980 None None] MFA Rules not processed for user `5ec758ef106b49f4985845b3c106f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:51:07.249696 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-750af984-375f-4136-8c1d-85afe8b56980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:07.331914 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1337/2638] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Jul 12 14:51:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:51:07.347876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e580f-affe-4b2e-829e-d98337f63a2e service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:07.350177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ad8e580f-affe-4b2e-829e-d98337f63a2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:07.381225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:07.460126 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e580f-affe-4b2e-829e-d98337f63a2e service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:07.469337 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2c580-379e-4b07-bc28-3d96d3e6fc86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad12085f356a4f0682bb70ad231a10b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:07.470742 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2c580-379e-4b07-bc28-3d96d3e6fc86 service swift] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:07.471266 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2c580-379e-4b07-bc28-3d96d3e6fc86 service swift] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:07.471809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2c580-379e-4b07-bc28-3d96d3e6fc86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:07.488600 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2c580-379e-4b07-bc28-3d96d3e6fc86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:07.492518 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2c580-379e-4b07-bc28-3d96d3e6fc86 service swift] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:07.508876 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1302/2639] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Jul 12 14:51:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:51:17.324263 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=80 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:17.502716 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=22 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:27.028722 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e44ef-9998-4167-9e85-731aa9670fa9 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:27.029479 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e44ef-9998-4167-9e85-731aa9670fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:27.029479 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e44ef-9998-4167-9e85-731aa9670fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:27.050144 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-4e4e44ef-9998-4167-9e85-731aa9670fa9 None None] MFA Rules not processed for user `5ec758ef106b49f4985845b3c106f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:51:27.051439 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-4e4e44ef-9998-4167-9e85-731aa9670fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:27.061390 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1338/2640] 10.222.0.40 () {58 vars in 967 bytes} [Tue Jul 12 14:51:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:51:27.077964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2c580-379e-4b07-bc28-3d96d3e6fc86 service swift] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:27.086337 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2c580-379e-4b07-bc28-3d96d3e6fc86 service swift] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:27.091943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc2390-9d85-4e7c-9f01-00da67537e97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad12085f356a4f0682bb70ad231a10b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:27.092748 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc2390-9d85-4e7c-9f01-00da67537e97 service swift] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:27.093121 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc2390-9d85-4e7c-9f01-00da67537e97 service swift] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:27.093510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc2390-9d85-4e7c-9f01-00da67537e97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:27.104325 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc2390-9d85-4e7c-9f01-00da67537e97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:27.105959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc2390-9d85-4e7c-9f01-00da67537e97 service swift] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:27.116929 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1303/2641] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Jul 12 14:51:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:51:37.043791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:37.112122 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=6 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:50.186583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e44ef-9998-4167-9e85-731aa9670fa9 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:50.188925 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-4e4e44ef-9998-4167-9e85-731aa9670fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:50.282811 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e44ef-9998-4167-9e85-731aa9670fa9 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:50.288168 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91450585-c96c-4aea-a3dc-5094ed5e9efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:50.289865 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91450585-c96c-4aea-a3dc-5094ed5e9efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:50.290153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91450585-c96c-4aea-a3dc-5094ed5e9efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:50.290434 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91450585-c96c-4aea-a3dc-5094ed5e9efc admin admin] PATH_INFO: `/v3/users/a3c4d4a543954c38854ca459d7a353a3` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:50.291811 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91450585-c96c-4aea-a3dc-5094ed5e9efc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c4d4a543954c38854ca459d7a353a3)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:50.293788 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91450585-c96c-4aea-a3dc-5094ed5e9efc admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:50.505448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-91450585-c96c-4aea-a3dc-5094ed5e9efc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c4d4a543954c38854ca459d7a353a3'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:50.520914 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-91450585-c96c-4aea-a3dc-5094ed5e9efc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c4d4a543954c38854ca459d7a353a3'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:50.625561 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-91450585-c96c-4aea-a3dc-5094ed5e9efc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c4d4a543954c38854ca459d7a353a3'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:50.626321 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-91450585-c96c-4aea-a3dc-5094ed5e9efc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c4d4a543954c38854ca459d7a353a3'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:50.635719 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-91450585-c96c-4aea-a3dc-5094ed5e9efc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c4d4a543954c38854ca459d7a353a3'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:50.642788 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1339/2642] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:51:50 2022] DELETE /identity/v3/users/a3c4d4a543954c38854ca459d7a353a3 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:51:50.954238 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc2390-9d85-4e7c-9f01-00da67537e97 service swift] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:50.973176 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc2390-9d85-4e7c-9f01-00da67537e97 service swift] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:51.046891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6d6fe-9432-48f4-a475-eb7fb40a9cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:51.047723 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6d6fe-9432-48f4-a475-eb7fb40a9cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:51.048016 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6d6fe-9432-48f4-a475-eb7fb40a9cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:51.048316 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6d6fe-9432-48f4-a475-eb7fb40a9cc7 admin admin] PATH_INFO: `/v3/projects/c54e230ac795428997374e27ddbde495` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:51.049565 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6d6fe-9432-48f4-a475-eb7fb40a9cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54e230ac795428997374e27ddbde495)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:51.052228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6d6fe-9432-48f4-a475-eb7fb40a9cc7 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:51.222097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0ae6d6fe-9432-48f4-a475-eb7fb40a9cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54e230ac795428997374e27ddbde495', 'request_id': 'req-0ae6d6fe-9432-48f4-a475-eb7fb40a9cc7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:51.229126 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0ae6d6fe-9432-48f4-a475-eb7fb40a9cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54e230ac795428997374e27ddbde495', 'request_id': 'req-0ae6d6fe-9432-48f4-a475-eb7fb40a9cc7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:51.238501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0ae6d6fe-9432-48f4-a475-eb7fb40a9cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54e230ac795428997374e27ddbde495', 'request_id': 'req-0ae6d6fe-9432-48f4-a475-eb7fb40a9cc7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:51.429430 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0ae6d6fe-9432-48f4-a475-eb7fb40a9cc7 admin admin] The token cache is being invalidate because project c54e230ac795428997374e27ddbde495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:51:51.429727 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0ae6d6fe-9432-48f4-a475-eb7fb40a9cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:51.430407 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0ae6d6fe-9432-48f4-a475-eb7fb40a9cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:51.432082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1304/2643] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:51:50 2022] DELETE /identity/v3/projects/c54e230ac795428997374e27ddbde495 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:51:51.437656 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91450585-c96c-4aea-a3dc-5094ed5e9efc admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:51.439758 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-91450585-c96c-4aea-a3dc-5094ed5e9efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:51.464103 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91450585-c96c-4aea-a3dc-5094ed5e9efc admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:51.555309 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c402d7d-5224-4024-9d89-b044dab87518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:51.556160 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c402d7d-5224-4024-9d89-b044dab87518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:51.556450 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c402d7d-5224-4024-9d89-b044dab87518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:51.556723 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c402d7d-5224-4024-9d89-b044dab87518 admin admin] PATH_INFO: `/v3/users/6dbb19583465411689f6b4d9b5a0d1fe` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:51.558050 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c402d7d-5224-4024-9d89-b044dab87518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dbb19583465411689f6b4d9b5a0d1fe)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:51.560084 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c402d7d-5224-4024-9d89-b044dab87518 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:51.587554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:51.780004 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-2c402d7d-5224-4024-9d89-b044dab87518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dbb19583465411689f6b4d9b5a0d1fe'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:51.798819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-2c402d7d-5224-4024-9d89-b044dab87518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dbb19583465411689f6b4d9b5a0d1fe'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:51.882750 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-2c402d7d-5224-4024-9d89-b044dab87518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dbb19583465411689f6b4d9b5a0d1fe'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:51.883428 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-2c402d7d-5224-4024-9d89-b044dab87518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dbb19583465411689f6b4d9b5a0d1fe'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:51.892415 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-2c402d7d-5224-4024-9d89-b044dab87518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dbb19583465411689f6b4d9b5a0d1fe'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:51.900681 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1340/2644] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:51:51 2022] DELETE /identity/v3/users/6dbb19583465411689f6b4d9b5a0d1fe => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:51:52.297366 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6d6fe-9432-48f4-a475-eb7fb40a9cc7 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:52.303424 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0ae6d6fe-9432-48f4-a475-eb7fb40a9cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:52.320252 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6d6fe-9432-48f4-a475-eb7fb40a9cc7 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:52.403743 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1066fed-1093-43eb-8825-45d35d55fdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:52.405274 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1066fed-1093-43eb-8825-45d35d55fdc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:52.405815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1066fed-1093-43eb-8825-45d35d55fdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:52.406365 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1066fed-1093-43eb-8825-45d35d55fdc9 admin admin] PATH_INFO: `/v3/projects/1538412a302b432ba24c8a6f6df130a9` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:52.408692 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1066fed-1093-43eb-8825-45d35d55fdc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1538412a302b432ba24c8a6f6df130a9)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:52.412574 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1066fed-1093-43eb-8825-45d35d55fdc9 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:52.557263 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:52.573832 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-d1066fed-1093-43eb-8825-45d35d55fdc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1538412a302b432ba24c8a6f6df130a9', 'request_id': 'req-d1066fed-1093-43eb-8825-45d35d55fdc9'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:52.585555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-d1066fed-1093-43eb-8825-45d35d55fdc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1538412a302b432ba24c8a6f6df130a9', 'request_id': 'req-d1066fed-1093-43eb-8825-45d35d55fdc9'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:52.598310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-d1066fed-1093-43eb-8825-45d35d55fdc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1538412a302b432ba24c8a6f6df130a9', 'request_id': 'req-d1066fed-1093-43eb-8825-45d35d55fdc9'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:52.672235 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-d1066fed-1093-43eb-8825-45d35d55fdc9 admin admin] The token cache is being invalidate because project 1538412a302b432ba24c8a6f6df130a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:51:52.672549 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-d1066fed-1093-43eb-8825-45d35d55fdc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:52.673209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-d1066fed-1093-43eb-8825-45d35d55fdc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:51:52.674815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1305/2645] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:51:52 2022] DELETE /identity/v3/projects/1538412a302b432ba24c8a6f6df130a9 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:51:52.680621 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b666c13-9ae2-484e-bf9d-779070c969c6 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:52.681276 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b666c13-9ae2-484e-bf9d-779070c969c6 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:52.681276 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b666c13-9ae2-484e-bf9d-779070c969c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:52.701613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-3b666c13-9ae2-484e-bf9d-779070c969c6 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:51:52.706749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-3b666c13-9ae2-484e-bf9d-779070c969c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:52.791024 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1341/2646] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:51:52.805077 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5f883-e782-4c93-afdd-61079c6b4356 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:52.805409 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5f883-e782-4c93-afdd-61079c6b4356 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:52.805650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5f883-e782-4c93-afdd-61079c6b4356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:52.826606 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-7ff5f883-e782-4c93-afdd-61079c6b4356 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:51:52.827955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-7ff5f883-e782-4c93-afdd-61079c6b4356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:52.837666 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1306/2647] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:51:52.841964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b666c13-9ae2-484e-bf9d-779070c969c6 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:52.853937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b666c13-9ae2-484e-bf9d-779070c969c6 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:52.859454 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ed710-62d0-481c-a2f1-9030e3dd4844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:52.860122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ed710-62d0-481c-a2f1-9030e3dd4844 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:52.860408 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ed710-62d0-481c-a2f1-9030e3dd4844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:52.860688 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ed710-62d0-481c-a2f1-9030e3dd4844 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:52.861451 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ed710-62d0-481c-a2f1-9030e3dd4844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:51:52.861768 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ed710-62d0-481c-a2f1-9030e3dd4844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:52.863480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ed710-62d0-481c-a2f1-9030e3dd4844 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:52.878276 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1342/2648] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:51:52.885515 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5f883-e782-4c93-afdd-61079c6b4356 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:52.896007 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5f883-e782-4c93-afdd-61079c6b4356 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:52.901262 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ce740-ae8e-4daa-8f8b-26264408edf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:52.901947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ce740-ae8e-4daa-8f8b-26264408edf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:52.902231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ce740-ae8e-4daa-8f8b-26264408edf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:52.902505 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ce740-ae8e-4daa-8f8b-26264408edf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:52.903212 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ce740-ae8e-4daa-8f8b-26264408edf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:52.905208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ce740-ae8e-4daa-8f8b-26264408edf1 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:53.050964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1307/2649] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:51:52 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:51:53.056558 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ed710-62d0-481c-a2f1-9030e3dd4844 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:53.068526 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ed710-62d0-481c-a2f1-9030e3dd4844 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:53.139322 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5912f1-2573-4414-81ff-aced5b701633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:53.139954 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5912f1-2573-4414-81ff-aced5b701633 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:53.140242 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5912f1-2573-4414-81ff-aced5b701633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:53.140526 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5912f1-2573-4414-81ff-aced5b701633 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:53.141264 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5912f1-2573-4414-81ff-aced5b701633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:53.143252 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5912f1-2573-4414-81ff-aced5b701633 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:53.246838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1343/2650] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:51:53 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:51:53.258216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ce740-ae8e-4daa-8f8b-26264408edf1 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:53.269839 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ce740-ae8e-4daa-8f8b-26264408edf1 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:53.276021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3d637-3660-4656-9b3f-d8c1b569559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:53.276729 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3d637-3660-4656-9b3f-d8c1b569559b admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:53.277018 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3d637-3660-4656-9b3f-d8c1b569559b admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:53.277303 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3d637-3660-4656-9b3f-d8c1b569559b admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:53.278066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3d637-3660-4656-9b3f-d8c1b569559b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:53.279780 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3d637-3660-4656-9b3f-d8c1b569559b admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:53.292637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1308/2651] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:51:53.297805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5912f1-2573-4414-81ff-aced5b701633 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:53.316357 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5912f1-2573-4414-81ff-aced5b701633 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:53.324792 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733e4d7-e217-4171-a295-9ec6548d3f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:53.325955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733e4d7-e217-4171-a295-9ec6548d3f81 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:53.326472 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733e4d7-e217-4171-a295-9ec6548d3f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:53.326978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733e4d7-e217-4171-a295-9ec6548d3f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:53.328354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733e4d7-e217-4171-a295-9ec6548d3f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:53.331412 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733e4d7-e217-4171-a295-9ec6548d3f81 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:53.352360 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1344/2652] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:51:53.356910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3d637-3660-4656-9b3f-d8c1b569559b admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:53.368753 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3d637-3660-4656-9b3f-d8c1b569559b admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:53.374309 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82daf6-4727-4be4-aa34-86622bbf5e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:53.375304 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82daf6-4727-4be4-aa34-86622bbf5e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:53.375717 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82daf6-4727-4be4-aa34-86622bbf5e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:53.376042 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82daf6-4727-4be4-aa34-86622bbf5e19 admin admin] PATH_INFO: `/v3/projects/14a3c0de388f4a179a921ac0b0e56dbd/users/3e1751faa20e403589c44bdc828be818/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:53.394790 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82daf6-4727-4be4-aa34-86622bbf5e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a3c0de388f4a179a921ac0b0e56dbd, user_id=3e1751faa20e403589c44bdc828be818, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:53.398105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82daf6-4727-4be4-aa34-86622bbf5e19 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:53.480719 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1309/2653] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:51:53 2022] PUT /identity/v3/projects/14a3c0de388f4a179a921ac0b0e56dbd/users/3e1751faa20e403589c44bdc828be818/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:51:53.495613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d6437-017f-4688-8231-bb5528bf4570 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:53.496126 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d6437-017f-4688-8231-bb5528bf4570 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:53.496615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d6437-017f-4688-8231-bb5528bf4570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:53.506763 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:53.532112 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-3c8d6437-017f-4688-8231-bb5528bf4570 None None] MFA Rules not processed for user `3e1751faa20e403589c44bdc828be818`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:51:53.534079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-3c8d6437-017f-4688-8231-bb5528bf4570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:53.615127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1345/2654] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:51:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:51:53.620170 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82daf6-4727-4be4-aa34-86622bbf5e19 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:53.700230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82daf6-4727-4be4-aa34-86622bbf5e19 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:53.705340 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95f86a-09c5-4533-8c94-45ba21aa4701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:53.706142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f86a-09c5-4533-8c94-45ba21aa4701 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:53.706431 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f86a-09c5-4533-8c94-45ba21aa4701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:53.706722 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f86a-09c5-4533-8c94-45ba21aa4701 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:53.707469 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95f86a-09c5-4533-8c94-45ba21aa4701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:53.710083 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95f86a-09c5-4533-8c94-45ba21aa4701 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:53.827771 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1310/2655] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:51:53 2022] POST /identity/v3/projects => generated 381 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:51:53.835012 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d6437-017f-4688-8231-bb5528bf4570 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:53.855764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d6437-017f-4688-8231-bb5528bf4570 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:53.927309 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76750851-ef69-44cf-a477-94fa6382301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:53.928063 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76750851-ef69-44cf-a477-94fa6382301c admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:53.928346 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76750851-ef69-44cf-a477-94fa6382301c admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:53.928620 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76750851-ef69-44cf-a477-94fa6382301c admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:53.929342 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76750851-ef69-44cf-a477-94fa6382301c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:53.931421 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76750851-ef69-44cf-a477-94fa6382301c admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:54.055130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1346/2656] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:51:53 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:51:54.059660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95f86a-09c5-4533-8c94-45ba21aa4701 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:54.072905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95f86a-09c5-4533-8c94-45ba21aa4701 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:54.080722 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e8872-9e1d-47a3-a2c4-40acd39445f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:54.081927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e8872-9e1d-47a3-a2c4-40acd39445f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:54.081927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e8872-9e1d-47a3-a2c4-40acd39445f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:54.082295 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e8872-9e1d-47a3-a2c4-40acd39445f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:54.082765 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e8872-9e1d-47a3-a2c4-40acd39445f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:54.084440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e8872-9e1d-47a3-a2c4-40acd39445f5 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:54.096203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1311/2657] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:51:54.101156 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76750851-ef69-44cf-a477-94fa6382301c admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:54.112442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76750851-ef69-44cf-a477-94fa6382301c admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:54.118225 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e9690-338d-4522-8eac-9a7a05a0a35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:54.119147 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e9690-338d-4522-8eac-9a7a05a0a35f admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:54.119473 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e9690-338d-4522-8eac-9a7a05a0a35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:54.119751 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e9690-338d-4522-8eac-9a7a05a0a35f admin admin] PATH_INFO: `/v3/projects/0fb7a28029d24ec6bd79b2c5f5e8a8ca/users/325e1def12c3418ca388d27f7210d9e1/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:54.138153 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e9690-338d-4522-8eac-9a7a05a0a35f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb7a28029d24ec6bd79b2c5f5e8a8ca, user_id=325e1def12c3418ca388d27f7210d9e1, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:54.141010 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e9690-338d-4522-8eac-9a7a05a0a35f admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:54.222056 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1347/2658] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:51:54 2022] PUT /identity/v3/projects/0fb7a28029d24ec6bd79b2c5f5e8a8ca/users/325e1def12c3418ca388d27f7210d9e1/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:51:54.227554 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e8872-9e1d-47a3-a2c4-40acd39445f5 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:54.239927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e8872-9e1d-47a3-a2c4-40acd39445f5 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:54.277054 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:54.310320 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab12992-f1f5-4b12-9753-41f8e7909410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:54.311255 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab12992-f1f5-4b12-9753-41f8e7909410 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:54.311897 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab12992-f1f5-4b12-9753-41f8e7909410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:54.312284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab12992-f1f5-4b12-9753-41f8e7909410 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:54.313414 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab12992-f1f5-4b12-9753-41f8e7909410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:54.317076 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab12992-f1f5-4b12-9753-41f8e7909410 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:54.338418 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1312/2659] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:51:54.344910 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e9690-338d-4522-8eac-9a7a05a0a35f admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:54.363503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e9690-338d-4522-8eac-9a7a05a0a35f admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:54.372099 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266a842-dfe5-401b-983b-405d6e21a3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:54.373717 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266a842-dfe5-401b-983b-405d6e21a3d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:54.374212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266a842-dfe5-401b-983b-405d6e21a3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:54.374698 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266a842-dfe5-401b-983b-405d6e21a3d2 admin admin] PATH_INFO: `/v3/projects/0fb7a28029d24ec6bd79b2c5f5e8a8ca/users/325e1def12c3418ca388d27f7210d9e1/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:54.378387 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266a842-dfe5-401b-983b-405d6e21a3d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb7a28029d24ec6bd79b2c5f5e8a8ca, user_id=325e1def12c3418ca388d27f7210d9e1, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:54.384329 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266a842-dfe5-401b-983b-405d6e21a3d2 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:54.404687 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1348/2660] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:51:54 2022] PUT /identity/v3/projects/0fb7a28029d24ec6bd79b2c5f5e8a8ca/users/325e1def12c3418ca388d27f7210d9e1/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:51:54.423050 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc609c8-3a6c-49d6-8655-f1743260a2b1 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:54.423703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc609c8-3a6c-49d6-8655-f1743260a2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:54.423703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc609c8-3a6c-49d6-8655-f1743260a2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:54.454288 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-dfc609c8-3a6c-49d6-8655-f1743260a2b1 None None] MFA Rules not processed for user `325e1def12c3418ca388d27f7210d9e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:51:54.455579 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-dfc609c8-3a6c-49d6-8655-f1743260a2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:54.572545 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1313/2661] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:51:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:51:54.590020 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266a842-dfe5-401b-983b-405d6e21a3d2 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:54.592804 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e266a842-dfe5-401b-983b-405d6e21a3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:54.681570 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:51:54.687651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266a842-dfe5-401b-983b-405d6e21a3d2 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:54.691944 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219782ea-d4cd-4e7d-b542-c829be31c144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:54.693331 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219782ea-d4cd-4e7d-b542-c829be31c144 service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:54.693683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219782ea-d4cd-4e7d-b542-c829be31c144 service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:54.693966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219782ea-d4cd-4e7d-b542-c829be31c144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:54.762484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219782ea-d4cd-4e7d-b542-c829be31c144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:54.764568 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219782ea-d4cd-4e7d-b542-c829be31c144 service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:54.776355 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1349/2662] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:51:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:51:58.126119 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc609c8-3a6c-49d6-8655-f1743260a2b1 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:51:58.127757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-dfc609c8-3a6c-49d6-8655-f1743260a2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:58.142122 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc609c8-3a6c-49d6-8655-f1743260a2b1 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:51:58.146901 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9840e-d151-4745-9b12-d367ffca04f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:51:58.147634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9840e-d151-4745-9b12-d367ffca04f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:51:58.147927 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9840e-d151-4745-9b12-d367ffca04f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:51:58.148209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9840e-d151-4745-9b12-d367ffca04f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:51:58.150797 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-13c9840e-d151-4745-9b12-d367ffca04f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:51:58.256233 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9840e-d151-4745-9b12-d367ffca04f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:51:58.256233 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9840e-d151-4745-9b12-d367ffca04f2 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:51:58.269159 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1314/2663] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:51:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:52:02.783053 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219782ea-d4cd-4e7d-b542-c829be31c144 service cinder] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:02.795768 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219782ea-d4cd-4e7d-b542-c829be31c144 service cinder] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:02.801222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588124ea-53bf-46df-9414-53192ecf0f25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:02.802409 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588124ea-53bf-46df-9414-53192ecf0f25 service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:02.804329 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588124ea-53bf-46df-9414-53192ecf0f25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:02.804329 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588124ea-53bf-46df-9414-53192ecf0f25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:02.805814 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-588124ea-53bf-46df-9414-53192ecf0f25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:02.830264 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588124ea-53bf-46df-9414-53192ecf0f25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:02.832952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588124ea-53bf-46df-9414-53192ecf0f25 service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:02.862476 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1350/2664] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:52:02.937024 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9840e-d151-4745-9b12-d367ffca04f2 service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:02.948137 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9840e-d151-4745-9b12-d367ffca04f2 service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:02.952763 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb580646-b2d3-4d80-a831-b905dda5da7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:02.953576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb580646-b2d3-4d80-a831-b905dda5da7d service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:02.953964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb580646-b2d3-4d80-a831-b905dda5da7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:02.954387 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb580646-b2d3-4d80-a831-b905dda5da7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:02.966423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb580646-b2d3-4d80-a831-b905dda5da7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:02.968095 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb580646-b2d3-4d80-a831-b905dda5da7d service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:02.980516 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1315/2665] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:52:10.484777 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588124ea-53bf-46df-9414-53192ecf0f25 service cinder] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:10.584358 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588124ea-53bf-46df-9414-53192ecf0f25 service cinder] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:10.589732 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e831e-715e-4824-86e1-25cddbb6662a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:10.590646 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e831e-715e-4824-86e1-25cddbb6662a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:10.590932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e831e-715e-4824-86e1-25cddbb6662a admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:10.591217 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e831e-715e-4824-86e1-25cddbb6662a admin admin] PATH_INFO: `/v3/users/3e1751faa20e403589c44bdc828be818` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:10.592638 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e831e-715e-4824-86e1-25cddbb6662a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1751faa20e403589c44bdc828be818)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:10.594659 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e831e-715e-4824-86e1-25cddbb6662a admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:10.819668 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-800e831e-715e-4824-86e1-25cddbb6662a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1751faa20e403589c44bdc828be818'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:10.844792 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-800e831e-715e-4824-86e1-25cddbb6662a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1751faa20e403589c44bdc828be818'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:10.953848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-800e831e-715e-4824-86e1-25cddbb6662a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1751faa20e403589c44bdc828be818'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:10.954674 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-800e831e-715e-4824-86e1-25cddbb6662a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1751faa20e403589c44bdc828be818'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:10.965051 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-800e831e-715e-4824-86e1-25cddbb6662a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1751faa20e403589c44bdc828be818'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:10.971929 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1351/2666] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:52:10 2022] DELETE /identity/v3/users/3e1751faa20e403589c44bdc828be818 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:52:10.977856 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b6b29-16ed-4e85-ba17-6445b6c8e1ec None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:10.978458 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b6b29-16ed-4e85-ba17-6445b6c8e1ec None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:10.978458 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b6b29-16ed-4e85-ba17-6445b6c8e1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:10.999031 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-3b2b6b29-16ed-4e85-ba17-6445b6c8e1ec None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:11.000691 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-3b2b6b29-16ed-4e85-ba17-6445b6c8e1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:11.025257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:11.073041 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1316/2667] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:52:11.084347 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e831e-715e-4824-86e1-25cddbb6662a admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:11.085980 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-800e831e-715e-4824-86e1-25cddbb6662a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:11.096960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:11.156299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e831e-715e-4824-86e1-25cddbb6662a admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:11.160357 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528b295-58e4-4021-a180-150d5a404de5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:11.162339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528b295-58e4-4021-a180-150d5a404de5 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:11.162879 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528b295-58e4-4021-a180-150d5a404de5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:11.163665 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528b295-58e4-4021-a180-150d5a404de5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:11.174149 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528b295-58e4-4021-a180-150d5a404de5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:11.175684 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528b295-58e4-4021-a180-150d5a404de5 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:11.187596 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1352/2668] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:52:11.651884 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b6b29-16ed-4e85-ba17-6445b6c8e1ec None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:11.653547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-3b2b6b29-16ed-4e85-ba17-6445b6c8e1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:11.669826 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b6b29-16ed-4e85-ba17-6445b6c8e1ec None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:11.675083 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be492be8-6616-485c-8f8d-2be8d99927a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:11.676048 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be492be8-6616-485c-8f8d-2be8d99927a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:11.676942 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be492be8-6616-485c-8f8d-2be8d99927a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:11.677343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be492be8-6616-485c-8f8d-2be8d99927a7 admin admin] PATH_INFO: `/v3/projects/14a3c0de388f4a179a921ac0b0e56dbd` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:11.678916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be492be8-6616-485c-8f8d-2be8d99927a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14a3c0de388f4a179a921ac0b0e56dbd)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:11.680949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be492be8-6616-485c-8f8d-2be8d99927a7 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:11.809126 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-be492be8-6616-485c-8f8d-2be8d99927a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14a3c0de388f4a179a921ac0b0e56dbd', 'request_id': 'req-be492be8-6616-485c-8f8d-2be8d99927a7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:11.815628 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-be492be8-6616-485c-8f8d-2be8d99927a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14a3c0de388f4a179a921ac0b0e56dbd', 'request_id': 'req-be492be8-6616-485c-8f8d-2be8d99927a7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:11.824226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-be492be8-6616-485c-8f8d-2be8d99927a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14a3c0de388f4a179a921ac0b0e56dbd', 'request_id': 'req-be492be8-6616-485c-8f8d-2be8d99927a7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:11.913078 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-be492be8-6616-485c-8f8d-2be8d99927a7 admin admin] The token cache is being invalidate because project 14a3c0de388f4a179a921ac0b0e56dbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:52:11.913349 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-be492be8-6616-485c-8f8d-2be8d99927a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:11.913999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-be492be8-6616-485c-8f8d-2be8d99927a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:11.915805 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1317/2669] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:52:11 2022] DELETE /identity/v3/projects/14a3c0de388f4a179a921ac0b0e56dbd => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:11.920669 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528b295-58e4-4021-a180-150d5a404de5 service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:11.944718 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528b295-58e4-4021-a180-150d5a404de5 service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:12.018519 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95562f-8288-4d0b-87d4-838844bf62f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:12.019449 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95562f-8288-4d0b-87d4-838844bf62f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:12.019729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95562f-8288-4d0b-87d4-838844bf62f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:12.020361 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95562f-8288-4d0b-87d4-838844bf62f0 admin admin] PATH_INFO: `/v3/users/325e1def12c3418ca388d27f7210d9e1` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:12.022015 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95562f-8288-4d0b-87d4-838844bf62f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=325e1def12c3418ca388d27f7210d9e1)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:12.024182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95562f-8288-4d0b-87d4-838844bf62f0 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:12.329407 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-eb95562f-8288-4d0b-87d4-838844bf62f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325e1def12c3418ca388d27f7210d9e1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:12.350189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-eb95562f-8288-4d0b-87d4-838844bf62f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325e1def12c3418ca388d27f7210d9e1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:12.464848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-eb95562f-8288-4d0b-87d4-838844bf62f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325e1def12c3418ca388d27f7210d9e1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:12.465478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-eb95562f-8288-4d0b-87d4-838844bf62f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325e1def12c3418ca388d27f7210d9e1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:12.474348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-eb95562f-8288-4d0b-87d4-838844bf62f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325e1def12c3418ca388d27f7210d9e1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:12.481540 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1353/2670] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:52:11 2022] DELETE /identity/v3/users/325e1def12c3418ca388d27f7210d9e1 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:13.151552 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be492be8-6616-485c-8f8d-2be8d99927a7 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:13.153537 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-be492be8-6616-485c-8f8d-2be8d99927a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:13.171203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be492be8-6616-485c-8f8d-2be8d99927a7 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:13.248361 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a8dc6-0009-4841-9e5d-ca5db22e13f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:13.249253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a8dc6-0009-4841-9e5d-ca5db22e13f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:13.249535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a8dc6-0009-4841-9e5d-ca5db22e13f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:13.250012 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a8dc6-0009-4841-9e5d-ca5db22e13f9 admin admin] PATH_INFO: `/v3/projects/0fb7a28029d24ec6bd79b2c5f5e8a8ca` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:13.251391 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a8dc6-0009-4841-9e5d-ca5db22e13f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fb7a28029d24ec6bd79b2c5f5e8a8ca)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:13.253490 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a8dc6-0009-4841-9e5d-ca5db22e13f9 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:13.403008 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0c7a8dc6-0009-4841-9e5d-ca5db22e13f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fb7a28029d24ec6bd79b2c5f5e8a8ca', 'request_id': 'req-0c7a8dc6-0009-4841-9e5d-ca5db22e13f9'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:13.404735 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:13.411462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0c7a8dc6-0009-4841-9e5d-ca5db22e13f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fb7a28029d24ec6bd79b2c5f5e8a8ca', 'request_id': 'req-0c7a8dc6-0009-4841-9e5d-ca5db22e13f9'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:13.421520 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0c7a8dc6-0009-4841-9e5d-ca5db22e13f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fb7a28029d24ec6bd79b2c5f5e8a8ca', 'request_id': 'req-0c7a8dc6-0009-4841-9e5d-ca5db22e13f9'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:13.518499 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0c7a8dc6-0009-4841-9e5d-ca5db22e13f9 admin admin] The token cache is being invalidate because project 0fb7a28029d24ec6bd79b2c5f5e8a8ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:52:13.518836 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0c7a8dc6-0009-4841-9e5d-ca5db22e13f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:13.519607 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-0c7a8dc6-0009-4841-9e5d-ca5db22e13f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:13.522680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1318/2671] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:52:13 2022] DELETE /identity/v3/projects/0fb7a28029d24ec6bd79b2c5f5e8a8ca => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:52:13.531861 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac260471-ef38-4afd-8f68-4ea91314370b None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:13.536271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac260471-ef38-4afd-8f68-4ea91314370b None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:13.536271 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac260471-ef38-4afd-8f68-4ea91314370b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:13.555057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-ac260471-ef38-4afd-8f68-4ea91314370b None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:13.556296 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ac260471-ef38-4afd-8f68-4ea91314370b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:13.590482 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:13.643421 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1354/2672] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:52:13.659006 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf4ef1-fd3c-41e1-b3d5-5430e1a06710 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:13.659582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf4ef1-fd3c-41e1-b3d5-5430e1a06710 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:13.660105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf4ef1-fd3c-41e1-b3d5-5430e1a06710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:13.694335 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-73cf4ef1-fd3c-41e1-b3d5-5430e1a06710 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:13.696526 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-73cf4ef1-fd3c-41e1-b3d5-5430e1a06710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:13.711883 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1319/2673] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:13.716304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac260471-ef38-4afd-8f68-4ea91314370b None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:13.728250 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac260471-ef38-4afd-8f68-4ea91314370b None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:13.734112 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7a928-7ef6-4123-ab3d-0bf69f4119e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:13.735037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7a928-7ef6-4123-ab3d-0bf69f4119e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:13.756094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7a928-7ef6-4123-ab3d-0bf69f4119e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:13.756094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7a928-7ef6-4123-ab3d-0bf69f4119e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:13.756094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7a928-7ef6-4123-ab3d-0bf69f4119e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:52:13.756094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7a928-7ef6-4123-ab3d-0bf69f4119e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:13.756094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7a928-7ef6-4123-ab3d-0bf69f4119e5 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:13.756094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1355/2674] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:52:13.759611 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf4ef1-fd3c-41e1-b3d5-5430e1a06710 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:13.770773 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf4ef1-fd3c-41e1-b3d5-5430e1a06710 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:13.776177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4d922-4ab3-4dcc-a846-2142d8858b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:13.776988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4d922-4ab3-4dcc-a846-2142d8858b4a admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:13.777339 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4d922-4ab3-4dcc-a846-2142d8858b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:13.777697 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4d922-4ab3-4dcc-a846-2142d8858b4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:13.778454 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4d922-4ab3-4dcc-a846-2142d8858b4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:13.780489 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4d922-4ab3-4dcc-a846-2142d8858b4a admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:13.891907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1320/2675] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:52:13 2022] POST /identity/v3/projects => generated 391 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:52:13.896722 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7a928-7ef6-4123-ab3d-0bf69f4119e5 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:13.907735 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7a928-7ef6-4123-ab3d-0bf69f4119e5 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:13.975484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bf952-4072-4cfb-9500-6551fe4e4003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:13.976176 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bf952-4072-4cfb-9500-6551fe4e4003 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:13.976471 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bf952-4072-4cfb-9500-6551fe4e4003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:13.976731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bf952-4072-4cfb-9500-6551fe4e4003 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:13.977454 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bf952-4072-4cfb-9500-6551fe4e4003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:13.979715 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bf952-4072-4cfb-9500-6551fe4e4003 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:14.118501 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1356/2676] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:52:13 2022] POST /identity/v3/users => generated 296 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:52:14.124625 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4d922-4ab3-4dcc-a846-2142d8858b4a admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:14.136779 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4d922-4ab3-4dcc-a846-2142d8858b4a admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:14.142724 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadd931-01df-421a-b7a2-950fdab13a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:14.143536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadd931-01df-421a-b7a2-950fdab13a44 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:14.143931 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadd931-01df-421a-b7a2-950fdab13a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:14.144393 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadd931-01df-421a-b7a2-950fdab13a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:14.146290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadd931-01df-421a-b7a2-950fdab13a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:14.148000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadd931-01df-421a-b7a2-950fdab13a44 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:14.160892 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1321/2677] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:52:14.165698 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bf952-4072-4cfb-9500-6551fe4e4003 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:14.177407 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bf952-4072-4cfb-9500-6551fe4e4003 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:14.182445 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3555750-364d-4ffd-b115-563669460e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:14.183224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3555750-364d-4ffd-b115-563669460e59 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:14.183648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3555750-364d-4ffd-b115-563669460e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:14.184035 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3555750-364d-4ffd-b115-563669460e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:14.184906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3555750-364d-4ffd-b115-563669460e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:14.186868 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3555750-364d-4ffd-b115-563669460e59 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:14.199511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1357/2678] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:52:14.206451 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadd931-01df-421a-b7a2-950fdab13a44 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:14.226231 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadd931-01df-421a-b7a2-950fdab13a44 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:14.233396 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20adc87-ff3f-4eae-b8c5-25e2f53e1637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:14.234389 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20adc87-ff3f-4eae-b8c5-25e2f53e1637 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:14.234712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20adc87-ff3f-4eae-b8c5-25e2f53e1637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:14.235051 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20adc87-ff3f-4eae-b8c5-25e2f53e1637 admin admin] PATH_INFO: `/v3/projects/94815200c40a4f75a16345605ddf6f0a/users/56674ecdcf994c869f0118474c4f0981/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:14.256938 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20adc87-ff3f-4eae-b8c5-25e2f53e1637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94815200c40a4f75a16345605ddf6f0a, user_id=56674ecdcf994c869f0118474c4f0981, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:14.260588 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20adc87-ff3f-4eae-b8c5-25e2f53e1637 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:14.317924 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1322/2679] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:52:14 2022] PUT /identity/v3/projects/94815200c40a4f75a16345605ddf6f0a/users/56674ecdcf994c869f0118474c4f0981/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:14.331436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8176e-adc2-4f0c-9311-634af48d89e8 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:14.331800 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8176e-adc2-4f0c-9311-634af48d89e8 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:14.331972 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8176e-adc2-4f0c-9311-634af48d89e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:14.366924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-11f8176e-adc2-4f0c-9311-634af48d89e8 None None] MFA Rules not processed for user `56674ecdcf994c869f0118474c4f0981`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:14.368268 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-11f8176e-adc2-4f0c-9311-634af48d89e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:14.470253 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1358/2680] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:14.482838 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20adc87-ff3f-4eae-b8c5-25e2f53e1637 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:14.485203 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-e20adc87-ff3f-4eae-b8c5-25e2f53e1637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:14.581400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20adc87-ff3f-4eae-b8c5-25e2f53e1637 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:14.586272 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2771e-214f-41b4-b9ac-9039b3a256fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:14.587004 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2771e-214f-41b4-b9ac-9039b3a256fb service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:14.587452 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2771e-214f-41b4-b9ac-9039b3a256fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:14.587994 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2771e-214f-41b4-b9ac-9039b3a256fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:14.598288 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2771e-214f-41b4-b9ac-9039b3a256fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:14.600061 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2771e-214f-41b4-b9ac-9039b3a256fb service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:14.611493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1323/2681] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:52:17.379662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8176e-adc2-4f0c-9311-634af48d89e8 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:17.382570 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-11f8176e-adc2-4f0c-9311-634af48d89e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:17.424658 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:17.461519 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8176e-adc2-4f0c-9311-634af48d89e8 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:17.465664 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987787cf-f6d2-4943-8a32-ada585c01554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:17.466417 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987787cf-f6d2-4943-8a32-ada585c01554 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:17.466741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987787cf-f6d2-4943-8a32-ada585c01554 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:17.467057 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987787cf-f6d2-4943-8a32-ada585c01554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:17.469295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-987787cf-f6d2-4943-8a32-ada585c01554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:17.555316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987787cf-f6d2-4943-8a32-ada585c01554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:17.557541 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987787cf-f6d2-4943-8a32-ada585c01554 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:17.570073 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1359/2682] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:52:22.640383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2771e-214f-41b4-b9ac-9039b3a256fb service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:22.643099 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-24e2771e-214f-41b4-b9ac-9039b3a256fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:22.670820 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2771e-214f-41b4-b9ac-9039b3a256fb service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:22.672980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eeddff-2bda-462b-b577-b53206f1f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:22.673973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eeddff-2bda-462b-b577-b53206f1f529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:22.674300 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eeddff-2bda-462b-b577-b53206f1f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:22.674614 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eeddff-2bda-462b-b577-b53206f1f529 admin admin] PATH_INFO: `/v3/users/87fcc3fa1cbe4afeaa0e455f2631411a` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:22.696074 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eeddff-2bda-462b-b577-b53206f1f529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87fcc3fa1cbe4afeaa0e455f2631411a)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:22.699253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eeddff-2bda-462b-b577-b53206f1f529 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:23.071963 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e5eeddff-2bda-462b-b577-b53206f1f529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87fcc3fa1cbe4afeaa0e455f2631411a'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:23.084926 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:23.088648 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e5eeddff-2bda-462b-b577-b53206f1f529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87fcc3fa1cbe4afeaa0e455f2631411a'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:23.097377 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e5eeddff-2bda-462b-b577-b53206f1f529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87fcc3fa1cbe4afeaa0e455f2631411a'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:23.195591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e5eeddff-2bda-462b-b577-b53206f1f529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87fcc3fa1cbe4afeaa0e455f2631411a'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:23.196353 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-e5eeddff-2bda-462b-b577-b53206f1f529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87fcc3fa1cbe4afeaa0e455f2631411a'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:23.204571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1324/2683] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:52:22 2022] DELETE /identity/v3/users/87fcc3fa1cbe4afeaa0e455f2631411a => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:23.575757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987787cf-f6d2-4943-8a32-ada585c01554 service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:23.602702 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987787cf-f6d2-4943-8a32-ada585c01554 service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:23.701660 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0035f-35f4-4ce9-b50b-800e7a0137d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:23.703234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0035f-35f4-4ce9-b50b-800e7a0137d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:23.703740 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0035f-35f4-4ce9-b50b-800e7a0137d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:23.704396 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0035f-35f4-4ce9-b50b-800e7a0137d2 admin admin] PATH_INFO: `/v3/projects/c19e0b34089e4d939521683a57f5730c` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:23.725884 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0035f-35f4-4ce9-b50b-800e7a0137d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c19e0b34089e4d939521683a57f5730c)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:23.728118 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0035f-35f4-4ce9-b50b-800e7a0137d2 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:23.901572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f2a0035f-35f4-4ce9-b50b-800e7a0137d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c19e0b34089e4d939521683a57f5730c', 'request_id': 'req-f2a0035f-35f4-4ce9-b50b-800e7a0137d2'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:23.985732 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f2a0035f-35f4-4ce9-b50b-800e7a0137d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c19e0b34089e4d939521683a57f5730c', 'request_id': 'req-f2a0035f-35f4-4ce9-b50b-800e7a0137d2'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:23.994258 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f2a0035f-35f4-4ce9-b50b-800e7a0137d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c19e0b34089e4d939521683a57f5730c', 'request_id': 'req-f2a0035f-35f4-4ce9-b50b-800e7a0137d2'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:23.996563 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:24.010506 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f2a0035f-35f4-4ce9-b50b-800e7a0137d2 admin admin] The token cache is being invalidate because project c19e0b34089e4d939521683a57f5730c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:52:24.017298 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f2a0035f-35f4-4ce9-b50b-800e7a0137d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:24.017298 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-f2a0035f-35f4-4ce9-b50b-800e7a0137d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:24.017298 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1360/2684] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:52:23 2022] DELETE /identity/v3/projects/c19e0b34089e4d939521683a57f5730c => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:24.018916 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b4526-fbea-4a36-bddf-f08a002b92d1 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:24.019582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b4526-fbea-4a36-bddf-f08a002b92d1 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:24.019582 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b4526-fbea-4a36-bddf-f08a002b92d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:24.047791 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-970b4526-fbea-4a36-bddf-f08a002b92d1 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:24.049053 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-970b4526-fbea-4a36-bddf-f08a002b92d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:24.124855 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1325/2685] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:24.134728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c8369-258a-4aa0-9654-498751955529 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:24.136078 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c8369-258a-4aa0-9654-498751955529 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:24.136078 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c8369-258a-4aa0-9654-498751955529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:24.156811 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-c81c8369-258a-4aa0-9654-498751955529 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:24.158008 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-c81c8369-258a-4aa0-9654-498751955529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:24.167398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1361/2686] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:24.173845 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b4526-fbea-4a36-bddf-f08a002b92d1 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:24.185522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b4526-fbea-4a36-bddf-f08a002b92d1 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:24.193071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0f36e-6a7d-45f2-bfc2-c9e36c6e42f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:24.194216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0f36e-6a7d-45f2-bfc2-c9e36c6e42f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:24.194712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0f36e-6a7d-45f2-bfc2-c9e36c6e42f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:24.195207 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0f36e-6a7d-45f2-bfc2-c9e36c6e42f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:24.196661 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0f36e-6a7d-45f2-bfc2-c9e36c6e42f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:52:24.197225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0f36e-6a7d-45f2-bfc2-c9e36c6e42f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:24.200334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0f36e-6a7d-45f2-bfc2-c9e36c6e42f3 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:24.223622 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1326/2687] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:52:24.230394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c8369-258a-4aa0-9654-498751955529 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:24.241946 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c8369-258a-4aa0-9654-498751955529 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:24.247772 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b2995-4e57-468f-a2fe-c9aaa225693d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:24.248584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b2995-4e57-468f-a2fe-c9aaa225693d admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:24.248980 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b2995-4e57-468f-a2fe-c9aaa225693d admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:24.249372 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b2995-4e57-468f-a2fe-c9aaa225693d admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:24.250207 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b2995-4e57-468f-a2fe-c9aaa225693d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:24.252687 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b2995-4e57-468f-a2fe-c9aaa225693d admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:24.378860 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1362/2688] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:52:24 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:52:24.383595 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0f36e-6a7d-45f2-bfc2-c9e36c6e42f3 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:24.396006 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0f36e-6a7d-45f2-bfc2-c9e36c6e42f3 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:24.469395 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76885484-6b7d-44d2-931b-a81974069ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:24.470136 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76885484-6b7d-44d2-931b-a81974069ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:24.470426 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76885484-6b7d-44d2-931b-a81974069ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:24.470710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76885484-6b7d-44d2-931b-a81974069ba1 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:24.471487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76885484-6b7d-44d2-931b-a81974069ba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:24.474158 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76885484-6b7d-44d2-931b-a81974069ba1 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:24.586063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1327/2689] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:52:24 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:52:24.592033 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b2995-4e57-468f-a2fe-c9aaa225693d admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:24.604978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b2995-4e57-468f-a2fe-c9aaa225693d admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:24.610189 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abfd68-b386-4da7-b371-ee696a8e02e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:24.610901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abfd68-b386-4da7-b371-ee696a8e02e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:24.611436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abfd68-b386-4da7-b371-ee696a8e02e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:24.611691 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abfd68-b386-4da7-b371-ee696a8e02e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:24.612501 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abfd68-b386-4da7-b371-ee696a8e02e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:24.615578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abfd68-b386-4da7-b371-ee696a8e02e6 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:24.630514 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1363/2690] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:52:24.634714 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76885484-6b7d-44d2-931b-a81974069ba1 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:24.647511 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76885484-6b7d-44d2-931b-a81974069ba1 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:24.652820 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85ea15-4304-4ddf-a09a-ee2cb0b57140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:24.653680 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85ea15-4304-4ddf-a09a-ee2cb0b57140 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:24.654033 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85ea15-4304-4ddf-a09a-ee2cb0b57140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:24.654349 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85ea15-4304-4ddf-a09a-ee2cb0b57140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:24.655177 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85ea15-4304-4ddf-a09a-ee2cb0b57140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:24.657028 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85ea15-4304-4ddf-a09a-ee2cb0b57140 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:24.669088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1328/2691] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:52:24.674228 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abfd68-b386-4da7-b371-ee696a8e02e6 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:24.688065 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abfd68-b386-4da7-b371-ee696a8e02e6 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:24.693891 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f5914-d441-4a9a-a54e-38d1df7b0680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:24.696125 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f5914-d441-4a9a-a54e-38d1df7b0680 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:24.696125 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f5914-d441-4a9a-a54e-38d1df7b0680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:24.696125 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f5914-d441-4a9a-a54e-38d1df7b0680 admin admin] PATH_INFO: `/v3/projects/a633efd0e55a4c318bf298c567d23cae/users/4b44ee846bd048da888f38a50c96455b/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:24.714914 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f5914-d441-4a9a-a54e-38d1df7b0680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a633efd0e55a4c318bf298c567d23cae, user_id=4b44ee846bd048da888f38a50c96455b, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:24.717703 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f5914-d441-4a9a-a54e-38d1df7b0680 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:24.849794 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1364/2692] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:52:24 2022] PUT /identity/v3/projects/a633efd0e55a4c318bf298c567d23cae/users/4b44ee846bd048da888f38a50c96455b/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:24.861775 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91e3ff-306e-4910-8ccc-394a0b9d51b4 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:24.862379 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91e3ff-306e-4910-8ccc-394a0b9d51b4 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:24.862904 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91e3ff-306e-4910-8ccc-394a0b9d51b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:24.901691 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-5f91e3ff-306e-4910-8ccc-394a0b9d51b4 None None] MFA Rules not processed for user `4b44ee846bd048da888f38a50c96455b`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:24.903054 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5f91e3ff-306e-4910-8ccc-394a0b9d51b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:24.943795 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:24.999318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1329/2693] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:25.019903 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f5914-d441-4a9a-a54e-38d1df7b0680 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:25.022399 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-635f5914-d441-4a9a-a54e-38d1df7b0680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:25.119549 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f5914-d441-4a9a-a54e-38d1df7b0680 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:25.126001 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901014d3-42f2-40a6-a40d-31664e0c8fa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:25.127511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901014d3-42f2-40a6-a40d-31664e0c8fa1 service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:25.127928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901014d3-42f2-40a6-a40d-31664e0c8fa1 service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:25.128259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901014d3-42f2-40a6-a40d-31664e0c8fa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:25.143216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901014d3-42f2-40a6-a40d-31664e0c8fa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:25.149316 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901014d3-42f2-40a6-a40d-31664e0c8fa1 service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:25.165385 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1365/2694] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:52:25.436433 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91e3ff-306e-4910-8ccc-394a0b9d51b4 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:25.516933 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91e3ff-306e-4910-8ccc-394a0b9d51b4 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:25.523437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809765d3-712e-471e-ad1f-5a9be7b50f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:25.524705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809765d3-712e-471e-ad1f-5a9be7b50f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:25.525091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809765d3-712e-471e-ad1f-5a9be7b50f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:25.525460 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809765d3-712e-471e-ad1f-5a9be7b50f51 admin admin] PATH_INFO: `/v3/users/4b44ee846bd048da888f38a50c96455b` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:25.526914 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809765d3-712e-471e-ad1f-5a9be7b50f51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b44ee846bd048da888f38a50c96455b)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:25.528977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809765d3-712e-471e-ad1f-5a9be7b50f51 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:25.721408 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-809765d3-712e-471e-ad1f-5a9be7b50f51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b44ee846bd048da888f38a50c96455b'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:25.736881 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-809765d3-712e-471e-ad1f-5a9be7b50f51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b44ee846bd048da888f38a50c96455b'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:25.746452 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-809765d3-712e-471e-ad1f-5a9be7b50f51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b44ee846bd048da888f38a50c96455b'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:25.872032 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-809765d3-712e-471e-ad1f-5a9be7b50f51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b44ee846bd048da888f38a50c96455b'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:25.872746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-809765d3-712e-471e-ad1f-5a9be7b50f51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b44ee846bd048da888f38a50c96455b'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:25.882985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1330/2695] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:52:25 2022] DELETE /identity/v3/users/4b44ee846bd048da888f38a50c96455b => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:52:25.888453 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c0496-c1df-44dd-b0b4-82ed21b6b61b None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:25.889037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c0496-c1df-44dd-b0b4-82ed21b6b61b None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:25.889037 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c0496-c1df-44dd-b0b4-82ed21b6b61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:25.916233 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-158c0496-c1df-44dd-b0b4-82ed21b6b61b None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:25.918435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-158c0496-c1df-44dd-b0b4-82ed21b6b61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:25.994310 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1366/2696] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:26.005632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809765d3-712e-471e-ad1f-5a9be7b50f51 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:26.012416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-809765d3-712e-471e-ad1f-5a9be7b50f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:26.084529 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809765d3-712e-471e-ad1f-5a9be7b50f51 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:26.091097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60fb25-cb0b-427c-939b-0f31c8a5a1c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:26.092277 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60fb25-cb0b-427c-939b-0f31c8a5a1c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:26.092768 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60fb25-cb0b-427c-939b-0f31c8a5a1c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:26.093288 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60fb25-cb0b-427c-939b-0f31c8a5a1c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:26.107059 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:26.111503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60fb25-cb0b-427c-939b-0f31c8a5a1c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:26.115138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60fb25-cb0b-427c-939b-0f31c8a5a1c4 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:26.134258 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1331/2697] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:52:26.685114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c0496-c1df-44dd-b0b4-82ed21b6b61b None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:26.690536 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-158c0496-c1df-44dd-b0b4-82ed21b6b61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:26.706693 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c0496-c1df-44dd-b0b4-82ed21b6b61b None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:26.714420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbede74-a0ba-4f60-8de7-e6ac04adc0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:26.715184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbede74-a0ba-4f60-8de7-e6ac04adc0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:26.715725 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbede74-a0ba-4f60-8de7-e6ac04adc0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:26.716222 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbede74-a0ba-4f60-8de7-e6ac04adc0c1 admin admin] PATH_INFO: `/v3/projects/a633efd0e55a4c318bf298c567d23cae` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:26.719061 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbede74-a0ba-4f60-8de7-e6ac04adc0c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a633efd0e55a4c318bf298c567d23cae)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:26.724776 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbede74-a0ba-4f60-8de7-e6ac04adc0c1 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:26.739795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:26.920333 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-6fbede74-a0ba-4f60-8de7-e6ac04adc0c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a633efd0e55a4c318bf298c567d23cae', 'request_id': 'req-6fbede74-a0ba-4f60-8de7-e6ac04adc0c1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:27.009649 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-6fbede74-a0ba-4f60-8de7-e6ac04adc0c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a633efd0e55a4c318bf298c567d23cae', 'request_id': 'req-6fbede74-a0ba-4f60-8de7-e6ac04adc0c1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:27.017156 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-6fbede74-a0ba-4f60-8de7-e6ac04adc0c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a633efd0e55a4c318bf298c567d23cae', 'request_id': 'req-6fbede74-a0ba-4f60-8de7-e6ac04adc0c1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:27.033626 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-6fbede74-a0ba-4f60-8de7-e6ac04adc0c1 admin admin] The token cache is being invalidate because project a633efd0e55a4c318bf298c567d23cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:52:27.033994 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-6fbede74-a0ba-4f60-8de7-e6ac04adc0c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:27.034672 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-6fbede74-a0ba-4f60-8de7-e6ac04adc0c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:27.037453 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1367/2698] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:52:26 2022] DELETE /identity/v3/projects/a633efd0e55a4c318bf298c567d23cae => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:27.044915 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd040f-0026-4d20-8a97-24b5cb2af6a4 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:27.045510 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd040f-0026-4d20-8a97-24b5cb2af6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:27.045638 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd040f-0026-4d20-8a97-24b5cb2af6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:27.066486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-11bd040f-0026-4d20-8a97-24b5cb2af6a4 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:27.067884 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-11bd040f-0026-4d20-8a97-24b5cb2af6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:27.172911 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1332/2699] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:27.183731 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cad96-e182-4f0a-af85-9e108a4c9df2 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:27.189495 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cad96-e182-4f0a-af85-9e108a4c9df2 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:27.189495 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cad96-e182-4f0a-af85-9e108a4c9df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:27.207914 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-976cad96-e182-4f0a-af85-9e108a4c9df2 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:27.209198 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-976cad96-e182-4f0a-af85-9e108a4c9df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:27.217978 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1368/2700] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:27.224293 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd040f-0026-4d20-8a97-24b5cb2af6a4 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:27.240696 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd040f-0026-4d20-8a97-24b5cb2af6a4 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:27.247754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410ac3a-453d-425c-8c5d-672212382b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:27.248457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410ac3a-453d-425c-8c5d-672212382b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:27.248857 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410ac3a-453d-425c-8c5d-672212382b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:27.249119 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410ac3a-453d-425c-8c5d-672212382b63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:27.250494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410ac3a-453d-425c-8c5d-672212382b63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:52:27.250892 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410ac3a-453d-425c-8c5d-672212382b63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:27.252998 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410ac3a-453d-425c-8c5d-672212382b63 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:27.271644 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1333/2701] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:52:27.276800 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cad96-e182-4f0a-af85-9e108a4c9df2 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:27.287942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cad96-e182-4f0a-af85-9e108a4c9df2 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:27.293167 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01550e5-9b72-428c-a5fe-8b453d8c193b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:27.294539 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01550e5-9b72-428c-a5fe-8b453d8c193b admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:27.294933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01550e5-9b72-428c-a5fe-8b453d8c193b admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:27.295109 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01550e5-9b72-428c-a5fe-8b453d8c193b admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:27.295858 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01550e5-9b72-428c-a5fe-8b453d8c193b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:27.297845 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01550e5-9b72-428c-a5fe-8b453d8c193b admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:27.423608 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1369/2702] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:52:27 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:52:27.430591 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410ac3a-453d-425c-8c5d-672212382b63 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:27.442567 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410ac3a-453d-425c-8c5d-672212382b63 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:27.544968 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4fe97-8643-40d7-b50b-c7f79f6218fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:27.545761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4fe97-8643-40d7-b50b-c7f79f6218fb admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:27.546086 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4fe97-8643-40d7-b50b-c7f79f6218fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:27.546405 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4fe97-8643-40d7-b50b-c7f79f6218fb admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:27.547220 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4fe97-8643-40d7-b50b-c7f79f6218fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:27.550129 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4fe97-8643-40d7-b50b-c7f79f6218fb admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:27.616995 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01550e5-9b72-428c-a5fe-8b453d8c193b admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:27.618985 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-b01550e5-9b72-428c-a5fe-8b453d8c193b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:27.633554 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01550e5-9b72-428c-a5fe-8b453d8c193b admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:27.638443 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb541248-551f-4d24-b942-b5ca7ed3c89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:27.639444 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb541248-551f-4d24-b942-b5ca7ed3c89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:27.639739 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb541248-551f-4d24-b942-b5ca7ed3c89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:27.640016 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb541248-551f-4d24-b942-b5ca7ed3c89e admin admin] PATH_INFO: `/v3/users/56674ecdcf994c869f0118474c4f0981` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:27.641433 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb541248-551f-4d24-b942-b5ca7ed3c89e admin admin] RBAC: Authorizing `identity:delete_user(user_id=56674ecdcf994c869f0118474c4f0981)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:27.643425 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb541248-551f-4d24-b942-b5ca7ed3c89e admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:27.694301 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1334/2703] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:52:27 2022] POST /identity/v3/users => generated 287 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:52:27.698674 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4fe97-8643-40d7-b50b-c7f79f6218fb admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:27.710104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4fe97-8643-40d7-b50b-c7f79f6218fb admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:27.715573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd284f77-b1dd-4c81-89b8-5737d8331d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:27.716274 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd284f77-b1dd-4c81-89b8-5737d8331d36 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:27.716564 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd284f77-b1dd-4c81-89b8-5737d8331d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:27.716844 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd284f77-b1dd-4c81-89b8-5737d8331d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:27.717598 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd284f77-b1dd-4c81-89b8-5737d8331d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:27.719265 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd284f77-b1dd-4c81-89b8-5737d8331d36 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:27.732180 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1335/2704] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:52:27.736681 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd284f77-b1dd-4c81-89b8-5737d8331d36 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:27.749725 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd284f77-b1dd-4c81-89b8-5737d8331d36 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:27.755785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b925ca5-ff9d-4f27-9473-0ae996b9c9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:27.756499 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b925ca5-ff9d-4f27-9473-0ae996b9c9fe admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:27.756819 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b925ca5-ff9d-4f27-9473-0ae996b9c9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:27.757106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b925ca5-ff9d-4f27-9473-0ae996b9c9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:27.757865 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b925ca5-ff9d-4f27-9473-0ae996b9c9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:27.759559 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b925ca5-ff9d-4f27-9473-0ae996b9c9fe admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:27.772958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1336/2705] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:52:27.779327 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b925ca5-ff9d-4f27-9473-0ae996b9c9fe admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:27.791616 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b925ca5-ff9d-4f27-9473-0ae996b9c9fe admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:27.796690 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2f39f-dfe6-4a04-8b0f-9e0e77c910ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:27.797620 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2f39f-dfe6-4a04-8b0f-9e0e77c910ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:27.797907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2f39f-dfe6-4a04-8b0f-9e0e77c910ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:27.798266 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2f39f-dfe6-4a04-8b0f-9e0e77c910ec admin admin] PATH_INFO: `/v3/projects/0a4daf36fe3349c2863ad81248a22531/users/99ca1c423b0044c98d72497d6d0492b2/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:27.817130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2f39f-dfe6-4a04-8b0f-9e0e77c910ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a4daf36fe3349c2863ad81248a22531, user_id=99ca1c423b0044c98d72497d6d0492b2, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:27.820379 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2f39f-dfe6-4a04-8b0f-9e0e77c910ec admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:27.852124 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-eb541248-551f-4d24-b942-b5ca7ed3c89e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56674ecdcf994c869f0118474c4f0981'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:27.874047 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-eb541248-551f-4d24-b942-b5ca7ed3c89e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56674ecdcf994c869f0118474c4f0981'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:27.892337 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1337/2706] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:52:27 2022] PUT /identity/v3/projects/0a4daf36fe3349c2863ad81248a22531/users/99ca1c423b0044c98d72497d6d0492b2/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:52:27.905888 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe13a8-2739-46e5-b376-cde1c1fa413a None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:27.906222 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe13a8-2739-46e5-b376-cde1c1fa413a None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:27.906493 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe13a8-2739-46e5-b376-cde1c1fa413a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:27.939390 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-a7fe13a8-2739-46e5-b376-cde1c1fa413a None None] MFA Rules not processed for user `99ca1c423b0044c98d72497d6d0492b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:27.940659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-a7fe13a8-2739-46e5-b376-cde1c1fa413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:27.962641 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:27.974164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-eb541248-551f-4d24-b942-b5ca7ed3c89e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56674ecdcf994c869f0118474c4f0981'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:27.975201 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-eb541248-551f-4d24-b942-b5ca7ed3c89e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56674ecdcf994c869f0118474c4f0981'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:27.986591 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-eb541248-551f-4d24-b942-b5ca7ed3c89e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56674ecdcf994c869f0118474c4f0981'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:28.001026 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1370/2707] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:52:27 2022] DELETE /identity/v3/users/56674ecdcf994c869f0118474c4f0981 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:52:28.003766 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4cbbd-788b-4080-b372-4b8c0ae9240a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:28.006236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4cbbd-788b-4080-b372-4b8c0ae9240a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:28.006619 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4cbbd-788b-4080-b372-4b8c0ae9240a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:28.028264 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-56e4cbbd-788b-4080-b372-4b8c0ae9240a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:28.029558 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-56e4cbbd-788b-4080-b372-4b8c0ae9240a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:28.065068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1338/2708] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:28.071253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe13a8-2739-46e5-b376-cde1c1fa413a None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:28.073184 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-a7fe13a8-2739-46e5-b376-cde1c1fa413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:28.095344 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:28.117385 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1371/2709] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:28.133014 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4cbbd-788b-4080-b372-4b8c0ae9240a None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:28.136230 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-56e4cbbd-788b-4080-b372-4b8c0ae9240a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:28.194135 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe13a8-2739-46e5-b376-cde1c1fa413a None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:28.202584 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a34f31-fe98-43f7-82ac-9a6f11ab1bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:28.203749 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a34f31-fe98-43f7-82ac-9a6f11ab1bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:28.204238 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a34f31-fe98-43f7-82ac-9a6f11ab1bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:28.204811 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a34f31-fe98-43f7-82ac-9a6f11ab1bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:28.206097 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a34f31-fe98-43f7-82ac-9a6f11ab1bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:28.209843 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a34f31-fe98-43f7-82ac-9a6f11ab1bb3 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:28.230739 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4cbbd-788b-4080-b372-4b8c0ae9240a None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:28.236867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd53b8-2d4a-43e6-a16b-2d6df6a8d905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:28.237546 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd53b8-2d4a-43e6-a16b-2d6df6a8d905 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:28.237828 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd53b8-2d4a-43e6-a16b-2d6df6a8d905 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:28.238102 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd53b8-2d4a-43e6-a16b-2d6df6a8d905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:28.255770 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd53b8-2d4a-43e6-a16b-2d6df6a8d905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:28.255770 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd53b8-2d4a-43e6-a16b-2d6df6a8d905 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:28.264327 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1372/2710] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:52:28.326109 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1339/2711] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:52:28 2022] POST /identity/v3/projects => generated 373 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:52:28.332009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd53b8-2d4a-43e6-a16b-2d6df6a8d905 service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:28.350127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd53b8-2d4a-43e6-a16b-2d6df6a8d905 service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:28.448793 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bc66d-b45b-498d-81fc-91c101febeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:28.449486 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bc66d-b45b-498d-81fc-91c101febeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:28.449773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bc66d-b45b-498d-81fc-91c101febeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:28.450049 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bc66d-b45b-498d-81fc-91c101febeb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:28.450766 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bc66d-b45b-498d-81fc-91c101febeb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:28.452960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bc66d-b45b-498d-81fc-91c101febeb8 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:28.545894 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1373/2712] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:52:28 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:52:28.550388 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a34f31-fe98-43f7-82ac-9a6f11ab1bb3 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:28.563011 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a34f31-fe98-43f7-82ac-9a6f11ab1bb3 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:28.570556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c174f-da0e-4cad-a99d-80bb39a51e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:28.572230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c174f-da0e-4cad-a99d-80bb39a51e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:28.572705 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c174f-da0e-4cad-a99d-80bb39a51e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:28.574237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c174f-da0e-4cad-a99d-80bb39a51e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:28.575176 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c174f-da0e-4cad-a99d-80bb39a51e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:28.577747 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c174f-da0e-4cad-a99d-80bb39a51e12 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:28.593562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1340/2713] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:52:28.598844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bc66d-b45b-498d-81fc-91c101febeb8 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:28.610891 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bc66d-b45b-498d-81fc-91c101febeb8 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:28.618664 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896ca53-88f8-42ae-ab97-d159424d8353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:28.620763 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896ca53-88f8-42ae-ab97-d159424d8353 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:28.621264 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896ca53-88f8-42ae-ab97-d159424d8353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:28.621772 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896ca53-88f8-42ae-ab97-d159424d8353 admin admin] PATH_INFO: `/v3/projects/c3857cffe4614958924aeee2c71f3d7b/users/731288f78bf14f58a23acd140f1f2f31/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:28.653773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896ca53-88f8-42ae-ab97-d159424d8353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3857cffe4614958924aeee2c71f3d7b, user_id=731288f78bf14f58a23acd140f1f2f31, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:28.659582 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896ca53-88f8-42ae-ab97-d159424d8353 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:28.748626 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1374/2714] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:52:28 2022] PUT /identity/v3/projects/c3857cffe4614958924aeee2c71f3d7b/users/731288f78bf14f58a23acd140f1f2f31/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:28.753169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c174f-da0e-4cad-a99d-80bb39a51e12 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:28.765898 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c174f-da0e-4cad-a99d-80bb39a51e12 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:28.849191 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896ca53-88f8-42ae-ab97-d159424d8353 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:28.852171 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-f896ca53-88f8-42ae-ab97-d159424d8353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:28.870271 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45e254-7d8f-4bf0-868b-35501c336a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:28.871041 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45e254-7d8f-4bf0-868b-35501c336a06 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:28.871440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45e254-7d8f-4bf0-868b-35501c336a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:28.871737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45e254-7d8f-4bf0-868b-35501c336a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:28.872550 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45e254-7d8f-4bf0-868b-35501c336a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:28.874344 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45e254-7d8f-4bf0-868b-35501c336a06 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:28.889690 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1341/2715] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:52:28.895542 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45e254-7d8f-4bf0-868b-35501c336a06 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:28.908500 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45e254-7d8f-4bf0-868b-35501c336a06 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:28.914470 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773db560-c073-4ba6-aa56-c91cc4cf6faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:28.915462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773db560-c073-4ba6-aa56-c91cc4cf6faf admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:28.915761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773db560-c073-4ba6-aa56-c91cc4cf6faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:28.916116 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773db560-c073-4ba6-aa56-c91cc4cf6faf admin admin] PATH_INFO: `/v3/projects/c3857cffe4614958924aeee2c71f3d7b/users/731288f78bf14f58a23acd140f1f2f31/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:28.918464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773db560-c073-4ba6-aa56-c91cc4cf6faf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3857cffe4614958924aeee2c71f3d7b, user_id=731288f78bf14f58a23acd140f1f2f31, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:28.921790 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773db560-c073-4ba6-aa56-c91cc4cf6faf admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:28.936132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1342/2716] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:52:28 2022] PUT /identity/v3/projects/c3857cffe4614958924aeee2c71f3d7b/users/731288f78bf14f58a23acd140f1f2f31/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:52:28.955963 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83a75b-dacc-4a9b-80c2-55f00206f18d None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:28.956351 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83a75b-dacc-4a9b-80c2-55f00206f18d None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:28.956766 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83a75b-dacc-4a9b-80c2-55f00206f18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:28.975689 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:28.987114 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:28.992092 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-2d83a75b-dacc-4a9b-80c2-55f00206f18d None None] MFA Rules not processed for user `731288f78bf14f58a23acd140f1f2f31`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:28.993334 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896ca53-88f8-42ae-ab97-d159424d8353 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:28.993733 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2d83a75b-dacc-4a9b-80c2-55f00206f18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:29.073904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec36484-ab3f-47c3-86fa-2e50972c2954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:29.075109 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec36484-ab3f-47c3-86fa-2e50972c2954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:29.075607 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec36484-ab3f-47c3-86fa-2e50972c2954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:29.076064 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec36484-ab3f-47c3-86fa-2e50972c2954 admin admin] PATH_INFO: `/v3/projects/94815200c40a4f75a16345605ddf6f0a` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:29.077639 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec36484-ab3f-47c3-86fa-2e50972c2954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94815200c40a4f75a16345605ddf6f0a)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:29.079971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec36484-ab3f-47c3-86fa-2e50972c2954 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:29.087025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1343/2717] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:29.099958 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83a75b-dacc-4a9b-80c2-55f00206f18d None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:29.114434 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2d83a75b-dacc-4a9b-80c2-55f00206f18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:29.173171 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83a75b-dacc-4a9b-80c2-55f00206f18d None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:29.181183 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747683b-493b-44f7-a528-7aece4d0531f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:29.198338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747683b-493b-44f7-a528-7aece4d0531f service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:29.198338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747683b-493b-44f7-a528-7aece4d0531f service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:29.198338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747683b-493b-44f7-a528-7aece4d0531f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:29.199268 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747683b-493b-44f7-a528-7aece4d0531f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:29.201737 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747683b-493b-44f7-a528-7aece4d0531f service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:29.220665 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1344/2718] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:52:29.329447 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dec36484-ab3f-47c3-86fa-2e50972c2954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94815200c40a4f75a16345605ddf6f0a', 'request_id': 'req-dec36484-ab3f-47c3-86fa-2e50972c2954'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:29.487508 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dec36484-ab3f-47c3-86fa-2e50972c2954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94815200c40a4f75a16345605ddf6f0a', 'request_id': 'req-dec36484-ab3f-47c3-86fa-2e50972c2954'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:29.500094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dec36484-ab3f-47c3-86fa-2e50972c2954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94815200c40a4f75a16345605ddf6f0a', 'request_id': 'req-dec36484-ab3f-47c3-86fa-2e50972c2954'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:29.519430 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dec36484-ab3f-47c3-86fa-2e50972c2954 admin admin] The token cache is being invalidate because project 94815200c40a4f75a16345605ddf6f0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:52:29.520082 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dec36484-ab3f-47c3-86fa-2e50972c2954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:29.521479 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dec36484-ab3f-47c3-86fa-2e50972c2954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:29.524346 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1375/2719] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:52:28 2022] DELETE /identity/v3/projects/94815200c40a4f75a16345605ddf6f0a => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:30.371045 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747683b-493b-44f7-a528-7aece4d0531f service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:30.383845 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747683b-493b-44f7-a528-7aece4d0531f service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:30.449961 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2adca-2174-401e-9be5-45e98e84044c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:30.450947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2adca-2174-401e-9be5-45e98e84044c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:30.451230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2adca-2174-401e-9be5-45e98e84044c admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:30.451548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2adca-2174-401e-9be5-45e98e84044c admin admin] PATH_INFO: `/v3/users/99ca1c423b0044c98d72497d6d0492b2` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:30.453883 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2adca-2174-401e-9be5-45e98e84044c admin admin] RBAC: Authorizing `identity:delete_user(user_id=99ca1c423b0044c98d72497d6d0492b2)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:30.456019 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2adca-2174-401e-9be5-45e98e84044c admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:30.688334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:30.691522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-09e2adca-2174-401e-9be5-45e98e84044c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99ca1c423b0044c98d72497d6d0492b2'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:30.707863 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-09e2adca-2174-401e-9be5-45e98e84044c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99ca1c423b0044c98d72497d6d0492b2'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:30.716280 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-09e2adca-2174-401e-9be5-45e98e84044c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99ca1c423b0044c98d72497d6d0492b2'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:30.826286 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-09e2adca-2174-401e-9be5-45e98e84044c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99ca1c423b0044c98d72497d6d0492b2'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:30.827099 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-09e2adca-2174-401e-9be5-45e98e84044c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99ca1c423b0044c98d72497d6d0492b2'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:30.834949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1345/2720] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:52:30 2022] DELETE /identity/v3/users/99ca1c423b0044c98d72497d6d0492b2 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:30.840934 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be333eac-6519-4cd6-a3c7-f3e7a94da198 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:30.841987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be333eac-6519-4cd6-a3c7-f3e7a94da198 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:30.841987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be333eac-6519-4cd6-a3c7-f3e7a94da198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:30.862516 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-be333eac-6519-4cd6-a3c7-f3e7a94da198 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:30.864770 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-be333eac-6519-4cd6-a3c7-f3e7a94da198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:30.937580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1376/2721] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:52:30.949527 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2adca-2174-401e-9be5-45e98e84044c admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:30.954399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-09e2adca-2174-401e-9be5-45e98e84044c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:31.019024 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2adca-2174-401e-9be5-45e98e84044c admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:31.024019 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3effc2-2a63-4046-8113-150888815df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:31.024695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3effc2-2a63-4046-8113-150888815df3 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:31.024977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3effc2-2a63-4046-8113-150888815df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:31.025253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3effc2-2a63-4046-8113-150888815df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:31.036665 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3effc2-2a63-4046-8113-150888815df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:31.038135 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3effc2-2a63-4046-8113-150888815df3 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:31.048979 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1346/2722] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:52:31.510218 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be333eac-6519-4cd6-a3c7-f3e7a94da198 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:31.512070 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-be333eac-6519-4cd6-a3c7-f3e7a94da198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:31.529775 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be333eac-6519-4cd6-a3c7-f3e7a94da198 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:31.538602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea5733-9437-41d0-8045-4077b1a696bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:31.540201 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea5733-9437-41d0-8045-4077b1a696bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:31.540838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea5733-9437-41d0-8045-4077b1a696bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:31.541237 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea5733-9437-41d0-8045-4077b1a696bd admin admin] PATH_INFO: `/v3/projects/0a4daf36fe3349c2863ad81248a22531` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:31.543646 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea5733-9437-41d0-8045-4077b1a696bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a4daf36fe3349c2863ad81248a22531)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:31.547179 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea5733-9437-41d0-8045-4077b1a696bd admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:31.668575 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:31.689341 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-64ea5733-9437-41d0-8045-4077b1a696bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a4daf36fe3349c2863ad81248a22531', 'request_id': 'req-64ea5733-9437-41d0-8045-4077b1a696bd'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:31.774526 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-64ea5733-9437-41d0-8045-4077b1a696bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a4daf36fe3349c2863ad81248a22531', 'request_id': 'req-64ea5733-9437-41d0-8045-4077b1a696bd'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:31.781924 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-64ea5733-9437-41d0-8045-4077b1a696bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a4daf36fe3349c2863ad81248a22531', 'request_id': 'req-64ea5733-9437-41d0-8045-4077b1a696bd'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:31.796216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-64ea5733-9437-41d0-8045-4077b1a696bd admin admin] The token cache is being invalidate because project 0a4daf36fe3349c2863ad81248a22531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:52:31.796510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-64ea5733-9437-41d0-8045-4077b1a696bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:31.797195 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-64ea5733-9437-41d0-8045-4077b1a696bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:31.798896 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1377/2723] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:52:31 2022] DELETE /identity/v3/projects/0a4daf36fe3349c2863ad81248a22531 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:31.804069 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3effc2-2a63-4046-8113-150888815df3 service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:31.815200 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3effc2-2a63-4046-8113-150888815df3 service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:31.886269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c8f8b-dbe3-4fe1-b15e-dd2052f95218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:31.887333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c8f8b-dbe3-4fe1-b15e-dd2052f95218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:31.887624 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c8f8b-dbe3-4fe1-b15e-dd2052f95218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:31.887900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c8f8b-dbe3-4fe1-b15e-dd2052f95218 admin admin] PATH_INFO: `/v3/users/731288f78bf14f58a23acd140f1f2f31` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:31.889220 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c8f8b-dbe3-4fe1-b15e-dd2052f95218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=731288f78bf14f58a23acd140f1f2f31)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:31.891188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c8f8b-dbe3-4fe1-b15e-dd2052f95218 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:32.087721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-cd5c8f8b-dbe3-4fe1-b15e-dd2052f95218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '731288f78bf14f58a23acd140f1f2f31'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:32.104230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-cd5c8f8b-dbe3-4fe1-b15e-dd2052f95218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '731288f78bf14f58a23acd140f1f2f31'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:32.105808 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:32.113374 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-cd5c8f8b-dbe3-4fe1-b15e-dd2052f95218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '731288f78bf14f58a23acd140f1f2f31'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:32.198416 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-cd5c8f8b-dbe3-4fe1-b15e-dd2052f95218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '731288f78bf14f58a23acd140f1f2f31'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:32.199220 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-cd5c8f8b-dbe3-4fe1-b15e-dd2052f95218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '731288f78bf14f58a23acd140f1f2f31'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:32.207653 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1347/2724] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:52:31 2022] DELETE /identity/v3/users/731288f78bf14f58a23acd140f1f2f31 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:32.788718 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea5733-9437-41d0-8045-4077b1a696bd admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:32.790756 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-64ea5733-9437-41d0-8045-4077b1a696bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:32.808533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea5733-9437-41d0-8045-4077b1a696bd admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:32.887913 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39fa46-b0e5-488d-ac4a-720ff21d568f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:32.888795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39fa46-b0e5-488d-ac4a-720ff21d568f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:32.889079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39fa46-b0e5-488d-ac4a-720ff21d568f admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:32.889362 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39fa46-b0e5-488d-ac4a-720ff21d568f admin admin] PATH_INFO: `/v3/projects/c3857cffe4614958924aeee2c71f3d7b` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:32.890637 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39fa46-b0e5-488d-ac4a-720ff21d568f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3857cffe4614958924aeee2c71f3d7b)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:32.892651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39fa46-b0e5-488d-ac4a-720ff21d568f admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:33.026337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1d39fa46-b0e5-488d-ac4a-720ff21d568f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3857cffe4614958924aeee2c71f3d7b', 'request_id': 'req-1d39fa46-b0e5-488d-ac4a-720ff21d568f'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:33.111594 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1d39fa46-b0e5-488d-ac4a-720ff21d568f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3857cffe4614958924aeee2c71f3d7b', 'request_id': 'req-1d39fa46-b0e5-488d-ac4a-720ff21d568f'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:33.120612 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1d39fa46-b0e5-488d-ac4a-720ff21d568f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3857cffe4614958924aeee2c71f3d7b', 'request_id': 'req-1d39fa46-b0e5-488d-ac4a-720ff21d568f'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:33.134800 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1d39fa46-b0e5-488d-ac4a-720ff21d568f admin admin] The token cache is being invalidate because project c3857cffe4614958924aeee2c71f3d7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:52:33.135096 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1d39fa46-b0e5-488d-ac4a-720ff21d568f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:33.135844 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1d39fa46-b0e5-488d-ac4a-720ff21d568f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:33.137493 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1378/2725] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:52:32 2022] DELETE /identity/v3/projects/c3857cffe4614958924aeee2c71f3d7b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:52:33.143915 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281596a-c0e5-4b87-ad74-cf90ec9bd30e None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:33.144556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281596a-c0e5-4b87-ad74-cf90ec9bd30e None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:33.144556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281596a-c0e5-4b87-ad74-cf90ec9bd30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:33.166225 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-1281596a-c0e5-4b87-ad74-cf90ec9bd30e None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:33.167512 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-1281596a-c0e5-4b87-ad74-cf90ec9bd30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:33.242791 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1348/2726] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:52:33.252790 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0eb5d-6d8a-418c-a2c2-0cf27587801d None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:33.253254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0eb5d-6d8a-418c-a2c2-0cf27587801d None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:33.253669 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0eb5d-6d8a-418c-a2c2-0cf27587801d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:33.277204 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-91a0eb5d-6d8a-418c-a2c2-0cf27587801d None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:33.278489 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-91a0eb5d-6d8a-418c-a2c2-0cf27587801d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:33.288676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1379/2727] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:33.293556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281596a-c0e5-4b87-ad74-cf90ec9bd30e None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:33.307963 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281596a-c0e5-4b87-ad74-cf90ec9bd30e None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:33.316082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d243e0-bdfa-4a52-b788-b63d070d2598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:33.317816 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d243e0-bdfa-4a52-b788-b63d070d2598 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:33.318307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d243e0-bdfa-4a52-b788-b63d070d2598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:33.318794 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d243e0-bdfa-4a52-b788-b63d070d2598 admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:33.320216 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d243e0-bdfa-4a52-b788-b63d070d2598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:52:33.320791 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d243e0-bdfa-4a52-b788-b63d070d2598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:33.323981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d243e0-bdfa-4a52-b788-b63d070d2598 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:33.348134 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1349/2728] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:52:33.353601 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0eb5d-6d8a-418c-a2c2-0cf27587801d None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:33.365146 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0eb5d-6d8a-418c-a2c2-0cf27587801d None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:33.370391 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e9ba6-5e6f-4322-bd17-7357ae780447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:33.371074 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e9ba6-5e6f-4322-bd17-7357ae780447 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:33.371406 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e9ba6-5e6f-4322-bd17-7357ae780447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:33.371694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e9ba6-5e6f-4322-bd17-7357ae780447 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:33.372420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e9ba6-5e6f-4322-bd17-7357ae780447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:33.374391 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e9ba6-5e6f-4322-bd17-7357ae780447 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:33.463674 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1380/2729] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:52:33 2022] POST /identity/v3/projects => generated 399 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:52:33.468433 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d243e0-bdfa-4a52-b788-b63d070d2598 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:33.482043 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d243e0-bdfa-4a52-b788-b63d070d2598 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:33.559291 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56ceb1-9d89-4f3e-8aa4-f22fbbb8073a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:33.560088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56ceb1-9d89-4f3e-8aa4-f22fbbb8073a admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:33.560348 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56ceb1-9d89-4f3e-8aa4-f22fbbb8073a admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:33.560626 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56ceb1-9d89-4f3e-8aa4-f22fbbb8073a admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:33.561364 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56ceb1-9d89-4f3e-8aa4-f22fbbb8073a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:33.563524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56ceb1-9d89-4f3e-8aa4-f22fbbb8073a admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:33.654777 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1350/2730] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:52:33 2022] POST /identity/v3/users => generated 300 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:52:33.661321 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e9ba6-5e6f-4322-bd17-7357ae780447 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:33.673613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e9ba6-5e6f-4322-bd17-7357ae780447 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:33.679200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ad68a-6655-4bf6-ba48-2495ca04c711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:33.680005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ad68a-6655-4bf6-ba48-2495ca04c711 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:33.680294 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ad68a-6655-4bf6-ba48-2495ca04c711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:33.680579 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ad68a-6655-4bf6-ba48-2495ca04c711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:33.681337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ad68a-6655-4bf6-ba48-2495ca04c711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:33.683097 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ad68a-6655-4bf6-ba48-2495ca04c711 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:33.696782 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1381/2731] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:52:33.703016 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56ceb1-9d89-4f3e-8aa4-f22fbbb8073a admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:33.715537 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56ceb1-9d89-4f3e-8aa4-f22fbbb8073a admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:33.720732 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41dc1c-4a72-4776-ac9f-4312e3a0d279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:33.721548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41dc1c-4a72-4776-ac9f-4312e3a0d279 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:33.721842 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41dc1c-4a72-4776-ac9f-4312e3a0d279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:33.722127 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41dc1c-4a72-4776-ac9f-4312e3a0d279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:33.722998 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41dc1c-4a72-4776-ac9f-4312e3a0d279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:33.724949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41dc1c-4a72-4776-ac9f-4312e3a0d279 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:33.737118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1351/2732] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:52:33.743475 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ad68a-6655-4bf6-ba48-2495ca04c711 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:33.750349 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:33.756213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ad68a-6655-4bf6-ba48-2495ca04c711 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:33.763119 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a912fa-0e88-4b71-b025-62de9d06eb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:33.765635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a912fa-0e88-4b71-b025-62de9d06eb7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:33.765635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a912fa-0e88-4b71-b025-62de9d06eb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:33.766178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a912fa-0e88-4b71-b025-62de9d06eb7d admin admin] PATH_INFO: `/v3/projects/7fed8e9a089e4acb820b6a81c3c06cde/users/693c12a9df304fc7a1e812755b9f52f2/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:33.789801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a912fa-0e88-4b71-b025-62de9d06eb7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fed8e9a089e4acb820b6a81c3c06cde, user_id=693c12a9df304fc7a1e812755b9f52f2, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:33.793385 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a912fa-0e88-4b71-b025-62de9d06eb7d admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:33.897029 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1382/2733] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:52:33 2022] PUT /identity/v3/projects/7fed8e9a089e4acb820b6a81c3c06cde/users/693c12a9df304fc7a1e812755b9f52f2/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:33.911644 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02bc2a-beb0-45cb-aab2-715f770f7893 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:33.912002 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02bc2a-beb0-45cb-aab2-715f770f7893 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:33.912505 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02bc2a-beb0-45cb-aab2-715f770f7893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:33.963545 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-0c02bc2a-beb0-45cb-aab2-715f770f7893 None None] MFA Rules not processed for user `693c12a9df304fc7a1e812755b9f52f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:33.965678 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-0c02bc2a-beb0-45cb-aab2-715f770f7893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:34.033446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:34.064256 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1352/2734] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:34.069932 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a912fa-0e88-4b71-b025-62de9d06eb7d admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:34.147887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a912fa-0e88-4b71-b025-62de9d06eb7d admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:34.153381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8600923-1a67-45e2-82f6-69986a155d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:34.154068 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8600923-1a67-45e2-82f6-69986a155d5f admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:34.154358 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8600923-1a67-45e2-82f6-69986a155d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:34.154637 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8600923-1a67-45e2-82f6-69986a155d5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:34.155396 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8600923-1a67-45e2-82f6-69986a155d5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:34.157771 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8600923-1a67-45e2-82f6-69986a155d5f admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:34.252964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1383/2735] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:52:34 2022] POST /identity/v3/projects => generated 401 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:52:34.258687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02bc2a-beb0-45cb-aab2-715f770f7893 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:34.273404 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02bc2a-beb0-45cb-aab2-715f770f7893 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:34.362899 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9258f90-472f-46c7-b92f-2d41bdc9dab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:34.363726 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9258f90-472f-46c7-b92f-2d41bdc9dab8 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:34.364056 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9258f90-472f-46c7-b92f-2d41bdc9dab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:34.364432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9258f90-472f-46c7-b92f-2d41bdc9dab8 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:34.365191 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9258f90-472f-46c7-b92f-2d41bdc9dab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:34.368060 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9258f90-472f-46c7-b92f-2d41bdc9dab8 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:34.488910 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1353/2736] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:52:34 2022] POST /identity/v3/users => generated 307 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:52:34.496907 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8600923-1a67-45e2-82f6-69986a155d5f admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:34.510011 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8600923-1a67-45e2-82f6-69986a155d5f admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:34.518289 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524269e8-58bf-4930-b00f-b62a86494744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:34.519486 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524269e8-58bf-4930-b00f-b62a86494744 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:34.520942 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524269e8-58bf-4930-b00f-b62a86494744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:34.521827 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524269e8-58bf-4930-b00f-b62a86494744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:34.523229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524269e8-58bf-4930-b00f-b62a86494744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:34.526336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524269e8-58bf-4930-b00f-b62a86494744 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:34.546981 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1384/2737] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:52:34.551812 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9258f90-472f-46c7-b92f-2d41bdc9dab8 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:34.563028 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9258f90-472f-46c7-b92f-2d41bdc9dab8 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:34.568914 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b906a-2136-4470-b144-cf5d89546a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:34.569837 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b906a-2136-4470-b144-cf5d89546a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:34.570130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b906a-2136-4470-b144-cf5d89546a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:34.570413 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b906a-2136-4470-b144-cf5d89546a44 admin admin] PATH_INFO: `/v3/projects/abd6d778593246fe846533a1eeb47d86/users/541ba2f584cc470aaf3d87770b2487e7/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:34.590683 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b906a-2136-4470-b144-cf5d89546a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd6d778593246fe846533a1eeb47d86, user_id=541ba2f584cc470aaf3d87770b2487e7, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:34.596538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b906a-2136-4470-b144-cf5d89546a44 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:34.685442 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1354/2738] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:52:34 2022] PUT /identity/v3/projects/abd6d778593246fe846533a1eeb47d86/users/541ba2f584cc470aaf3d87770b2487e7/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:52:34.691590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524269e8-58bf-4930-b00f-b62a86494744 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:34.702734 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524269e8-58bf-4930-b00f-b62a86494744 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:34.783148 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e09eec-2f0f-414f-a109-6daa2a6ea9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:34.784662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e09eec-2f0f-414f-a109-6daa2a6ea9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:34.785511 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e09eec-2f0f-414f-a109-6daa2a6ea9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:34.785740 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e09eec-2f0f-414f-a109-6daa2a6ea9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:34.787506 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e09eec-2f0f-414f-a109-6daa2a6ea9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:34.790441 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e09eec-2f0f-414f-a109-6daa2a6ea9d7 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:34.811387 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1385/2739] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:52:34.814000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b906a-2136-4470-b144-cf5d89546a44 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:34.835194 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b906a-2136-4470-b144-cf5d89546a44 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:34.843573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f540d6-1042-4f0f-a1fb-c12ff112c906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:34.845106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f540d6-1042-4f0f-a1fb-c12ff112c906 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:34.845652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f540d6-1042-4f0f-a1fb-c12ff112c906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:34.846100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f540d6-1042-4f0f-a1fb-c12ff112c906 admin admin] PATH_INFO: `/v3/projects/abd6d778593246fe846533a1eeb47d86/users/541ba2f584cc470aaf3d87770b2487e7/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:34.851252 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f540d6-1042-4f0f-a1fb-c12ff112c906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd6d778593246fe846533a1eeb47d86, user_id=541ba2f584cc470aaf3d87770b2487e7, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:34.855989 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f540d6-1042-4f0f-a1fb-c12ff112c906 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:34.872813 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1355/2740] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:52:34 2022] PUT /identity/v3/projects/abd6d778593246fe846533a1eeb47d86/users/541ba2f584cc470aaf3d87770b2487e7/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:34.885979 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38badb74-d5f9-48f2-b95f-c231f289c402 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:34.886794 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38badb74-d5f9-48f2-b95f-c231f289c402 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:34.887267 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38badb74-d5f9-48f2-b95f-c231f289c402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:34.938034 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-38badb74-d5f9-48f2-b95f-c231f289c402 None None] MFA Rules not processed for user `541ba2f584cc470aaf3d87770b2487e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:34.940169 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-38badb74-d5f9-48f2-b95f-c231f289c402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:35.007543 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:35.042673 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1386/2741] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:34 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:52:35.055173 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f540d6-1042-4f0f-a1fb-c12ff112c906 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:35.057717 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-26f540d6-1042-4f0f-a1fb-c12ff112c906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:35.143163 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f540d6-1042-4f0f-a1fb-c12ff112c906 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:35.149433 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905f0aa-8182-4cb6-bd2f-ce28239e4f47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:35.150330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905f0aa-8182-4cb6-bd2f-ce28239e4f47 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:35.150710 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905f0aa-8182-4cb6-bd2f-ce28239e4f47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:35.151102 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905f0aa-8182-4cb6-bd2f-ce28239e4f47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:35.161974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905f0aa-8182-4cb6-bd2f-ce28239e4f47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:35.163497 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905f0aa-8182-4cb6-bd2f-ce28239e4f47 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:35.174585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1356/2742] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:35 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:52:35.476835 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38badb74-d5f9-48f2-b95f-c231f289c402 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:35.494678 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38badb74-d5f9-48f2-b95f-c231f289c402 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:35.509726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea007ac1-3d03-4b8b-91dd-8fdd18c42e50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:35.509726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea007ac1-3d03-4b8b-91dd-8fdd18c42e50 service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:35.509726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea007ac1-3d03-4b8b-91dd-8fdd18c42e50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:35.509726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea007ac1-3d03-4b8b-91dd-8fdd18c42e50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:35.594646 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea007ac1-3d03-4b8b-91dd-8fdd18c42e50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:35.597444 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea007ac1-3d03-4b8b-91dd-8fdd18c42e50 service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:35.616005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1387/2743] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:52:38.234965 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905f0aa-8182-4cb6-bd2f-ce28239e4f47 service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:38.240336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-1905f0aa-8182-4cb6-bd2f-ce28239e4f47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:38.289318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:38.358322 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905f0aa-8182-4cb6-bd2f-ce28239e4f47 service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:38.367315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8071f6-0394-4da4-9a7b-3d310bc477d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:38.367743 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8071f6-0394-4da4-9a7b-3d310bc477d2 service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:38.367998 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8071f6-0394-4da4-9a7b-3d310bc477d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:38.368298 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8071f6-0394-4da4-9a7b-3d310bc477d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:38.370501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-6d8071f6-0394-4da4-9a7b-3d310bc477d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:38.390154 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8071f6-0394-4da4-9a7b-3d310bc477d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:38.392000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8071f6-0394-4da4-9a7b-3d310bc477d2 service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:38.414721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1357/2744] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:52:41.444593 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea007ac1-3d03-4b8b-91dd-8fdd18c42e50 service cinder] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:41.570891 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea007ac1-3d03-4b8b-91dd-8fdd18c42e50 service cinder] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:41.576348 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce07fdc-902b-4579-9e49-efdac28fab82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:41.577302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce07fdc-902b-4579-9e49-efdac28fab82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:41.577618 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce07fdc-902b-4579-9e49-efdac28fab82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:41.578094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce07fdc-902b-4579-9e49-efdac28fab82 admin admin] PATH_INFO: `/v3/users/693c12a9df304fc7a1e812755b9f52f2` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:41.579405 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce07fdc-902b-4579-9e49-efdac28fab82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=693c12a9df304fc7a1e812755b9f52f2)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:41.582863 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce07fdc-902b-4579-9e49-efdac28fab82 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:41.954463 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dce07fdc-902b-4579-9e49-efdac28fab82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693c12a9df304fc7a1e812755b9f52f2'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:41.968165 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dce07fdc-902b-4579-9e49-efdac28fab82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693c12a9df304fc7a1e812755b9f52f2'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:42.065736 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dce07fdc-902b-4579-9e49-efdac28fab82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693c12a9df304fc7a1e812755b9f52f2'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:42.067030 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dce07fdc-902b-4579-9e49-efdac28fab82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693c12a9df304fc7a1e812755b9f52f2'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:42.073123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:42.077099 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-dce07fdc-902b-4579-9e49-efdac28fab82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693c12a9df304fc7a1e812755b9f52f2'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:42.084802 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1388/2745] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:52:41 2022] DELETE /identity/v3/users/693c12a9df304fc7a1e812755b9f52f2 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:42.090467 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af109f2-a698-4824-a90e-9abf7328fc64 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:42.090984 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af109f2-a698-4824-a90e-9abf7328fc64 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:42.091397 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af109f2-a698-4824-a90e-9abf7328fc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:42.113378 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-7af109f2-a698-4824-a90e-9abf7328fc64 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:42.114800 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-7af109f2-a698-4824-a90e-9abf7328fc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:42.195264 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1358/2746] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:42.214648 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce07fdc-902b-4579-9e49-efdac28fab82 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:42.217119 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-dce07fdc-902b-4579-9e49-efdac28fab82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:42.298870 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce07fdc-902b-4579-9e49-efdac28fab82 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:42.305369 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06584c97-1a78-4052-aebd-14effd9d27b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:42.306487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06584c97-1a78-4052-aebd-14effd9d27b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:42.306985 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06584c97-1a78-4052-aebd-14effd9d27b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:42.307500 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06584c97-1a78-4052-aebd-14effd9d27b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:42.324465 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06584c97-1a78-4052-aebd-14effd9d27b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:42.327407 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06584c97-1a78-4052-aebd-14effd9d27b9 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:42.346718 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1389/2747] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:52:42.892282 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af109f2-a698-4824-a90e-9abf7328fc64 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:42.894091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-7af109f2-a698-4824-a90e-9abf7328fc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:42.913731 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af109f2-a698-4824-a90e-9abf7328fc64 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:42.920522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20b483-3bcf-4d31-b456-ab35ffd1d5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:42.922753 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20b483-3bcf-4d31-b456-ab35ffd1d5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:42.923310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20b483-3bcf-4d31-b456-ab35ffd1d5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:42.923892 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20b483-3bcf-4d31-b456-ab35ffd1d5c1 admin admin] PATH_INFO: `/v3/projects/7fed8e9a089e4acb820b6a81c3c06cde` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:42.927644 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20b483-3bcf-4d31-b456-ab35ffd1d5c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fed8e9a089e4acb820b6a81c3c06cde)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:42.930715 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20b483-3bcf-4d31-b456-ab35ffd1d5c1 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:43.072401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8b20b483-3bcf-4d31-b456-ab35ffd1d5c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fed8e9a089e4acb820b6a81c3c06cde', 'request_id': 'req-8b20b483-3bcf-4d31-b456-ab35ffd1d5c1'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:43.079519 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8b20b483-3bcf-4d31-b456-ab35ffd1d5c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fed8e9a089e4acb820b6a81c3c06cde', 'request_id': 'req-8b20b483-3bcf-4d31-b456-ab35ffd1d5c1'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:43.087464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8b20b483-3bcf-4d31-b456-ab35ffd1d5c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fed8e9a089e4acb820b6a81c3c06cde', 'request_id': 'req-8b20b483-3bcf-4d31-b456-ab35ffd1d5c1'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:43.197542 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8b20b483-3bcf-4d31-b456-ab35ffd1d5c1 admin admin] The token cache is being invalidate because project 7fed8e9a089e4acb820b6a81c3c06cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:52:43.198383 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8b20b483-3bcf-4d31-b456-ab35ffd1d5c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:43.198647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-8b20b483-3bcf-4d31-b456-ab35ffd1d5c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:43.200307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1359/2748] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:52:42 2022] DELETE /identity/v3/projects/7fed8e9a089e4acb820b6a81c3c06cde => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:43.205975 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06584c97-1a78-4052-aebd-14effd9d27b9 service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:43.218056 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06584c97-1a78-4052-aebd-14effd9d27b9 service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:43.291979 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1ea70-120d-4291-8f0c-118cca9b1020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:43.293051 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1ea70-120d-4291-8f0c-118cca9b1020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:43.293339 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1ea70-120d-4291-8f0c-118cca9b1020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:43.293614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1ea70-120d-4291-8f0c-118cca9b1020 admin admin] PATH_INFO: `/v3/users/541ba2f584cc470aaf3d87770b2487e7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:43.295079 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1ea70-120d-4291-8f0c-118cca9b1020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=541ba2f584cc470aaf3d87770b2487e7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:43.297090 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1ea70-120d-4291-8f0c-118cca9b1020 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:43.579743 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-07e1ea70-120d-4291-8f0c-118cca9b1020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '541ba2f584cc470aaf3d87770b2487e7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:43.592793 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-07e1ea70-120d-4291-8f0c-118cca9b1020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '541ba2f584cc470aaf3d87770b2487e7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:43.705868 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-07e1ea70-120d-4291-8f0c-118cca9b1020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '541ba2f584cc470aaf3d87770b2487e7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:43.706512 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-07e1ea70-120d-4291-8f0c-118cca9b1020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '541ba2f584cc470aaf3d87770b2487e7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:43.715691 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-07e1ea70-120d-4291-8f0c-118cca9b1020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '541ba2f584cc470aaf3d87770b2487e7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:43.721923 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1390/2749] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:52:43 2022] DELETE /identity/v3/users/541ba2f584cc470aaf3d87770b2487e7 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:44.160982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20b483-3bcf-4d31-b456-ab35ffd1d5c1 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:44.162499 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-8b20b483-3bcf-4d31-b456-ab35ffd1d5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:44.222328 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1ea70-120d-4291-8f0c-118cca9b1020 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:44.224881 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-07e1ea70-120d-4291-8f0c-118cca9b1020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:44.242850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:44.261885 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20b483-3bcf-4d31-b456-ab35ffd1d5c1 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:44.279087 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:44.340147 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a5c38-e670-499b-8125-f2bb198bad3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:44.341096 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a5c38-e670-499b-8125-f2bb198bad3c service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:44.341666 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a5c38-e670-499b-8125-f2bb198bad3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:44.342127 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a5c38-e670-499b-8125-f2bb198bad3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:44.345102 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-f37a5c38-e670-499b-8125-f2bb198bad3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:44.357714 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1ea70-120d-4291-8f0c-118cca9b1020 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:44.361738 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a5c38-e670-499b-8125-f2bb198bad3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:44.364791 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a5c38-e670-499b-8125-f2bb198bad3c service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:44.365055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0fc8e-afe4-4f82-a47e-756be650c872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:44.365944 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0fc8e-afe4-4f82-a47e-756be650c872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:44.366287 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0fc8e-afe4-4f82-a47e-756be650c872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:44.366761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0fc8e-afe4-4f82-a47e-756be650c872 admin admin] PATH_INFO: `/v3/projects/abd6d778593246fe846533a1eeb47d86` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:44.368341 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0fc8e-afe4-4f82-a47e-756be650c872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd6d778593246fe846533a1eeb47d86)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:44.370629 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0fc8e-afe4-4f82-a47e-756be650c872 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:44.380101 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1360/2750] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:52:44.561668 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-cee0fc8e-afe4-4f82-a47e-756be650c872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd6d778593246fe846533a1eeb47d86', 'request_id': 'req-cee0fc8e-afe4-4f82-a47e-756be650c872'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:44.659126 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-cee0fc8e-afe4-4f82-a47e-756be650c872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd6d778593246fe846533a1eeb47d86', 'request_id': 'req-cee0fc8e-afe4-4f82-a47e-756be650c872'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:44.669310 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-cee0fc8e-afe4-4f82-a47e-756be650c872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd6d778593246fe846533a1eeb47d86', 'request_id': 'req-cee0fc8e-afe4-4f82-a47e-756be650c872'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:44.685547 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-cee0fc8e-afe4-4f82-a47e-756be650c872 admin admin] The token cache is being invalidate because project abd6d778593246fe846533a1eeb47d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:52:44.685933 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-cee0fc8e-afe4-4f82-a47e-756be650c872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:44.686534 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-cee0fc8e-afe4-4f82-a47e-756be650c872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:44.692220 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1391/2751] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:52:44 2022] DELETE /identity/v3/projects/abd6d778593246fe846533a1eeb47d86 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:52:44.695188 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2e6e6-c985-4b08-9987-f582b595a474 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:44.695524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2e6e6-c985-4b08-9987-f582b595a474 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:44.695808 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2e6e6-c985-4b08-9987-f582b595a474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:44.715963 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-bbc2e6e6-c985-4b08-9987-f582b595a474 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:44.718053 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-bbc2e6e6-c985-4b08-9987-f582b595a474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:44.797825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1361/2752] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:44.805712 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce055d19-ee70-460c-a15d-785b1ff070df None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:44.806006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce055d19-ee70-460c-a15d-785b1ff070df None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:44.806373 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce055d19-ee70-460c-a15d-785b1ff070df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:44.826625 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-ce055d19-ee70-460c-a15d-785b1ff070df None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:44.828010 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ce055d19-ee70-460c-a15d-785b1ff070df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:44.837606 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1392/2753] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:44.842402 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2e6e6-c985-4b08-9987-f582b595a474 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:44.854380 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2e6e6-c985-4b08-9987-f582b595a474 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:44.859862 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b145d8-e551-40ba-afbf-3118b34b48fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:44.860971 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b145d8-e551-40ba-afbf-3118b34b48fe admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:44.861257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b145d8-e551-40ba-afbf-3118b34b48fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:44.861536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b145d8-e551-40ba-afbf-3118b34b48fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:44.862427 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b145d8-e551-40ba-afbf-3118b34b48fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:52:44.862839 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b145d8-e551-40ba-afbf-3118b34b48fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:44.864909 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b145d8-e551-40ba-afbf-3118b34b48fe admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:44.881168 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1362/2754] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:52:44.884436 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce055d19-ee70-460c-a15d-785b1ff070df None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:44.901523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce055d19-ee70-460c-a15d-785b1ff070df None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:44.906591 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe238c-8ddb-4c5f-92d8-6b9caec1d8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:44.907317 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe238c-8ddb-4c5f-92d8-6b9caec1d8ff admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:44.907634 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe238c-8ddb-4c5f-92d8-6b9caec1d8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:44.908632 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe238c-8ddb-4c5f-92d8-6b9caec1d8ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:44.909633 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe238c-8ddb-4c5f-92d8-6b9caec1d8ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:44.912808 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe238c-8ddb-4c5f-92d8-6b9caec1d8ff admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:45.282396 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1393/2755] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:52:44 2022] POST /identity/v3/projects => generated 373 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:52:45.283576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b145d8-e551-40ba-afbf-3118b34b48fe admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:45.295475 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b145d8-e551-40ba-afbf-3118b34b48fe admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:45.370468 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2c7bd-c7dd-4b1d-b7e7-b813c810bc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:45.371253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2c7bd-c7dd-4b1d-b7e7-b813c810bc31 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:45.371590 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2c7bd-c7dd-4b1d-b7e7-b813c810bc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:45.371865 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2c7bd-c7dd-4b1d-b7e7-b813c810bc31 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:45.372588 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2c7bd-c7dd-4b1d-b7e7-b813c810bc31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:45.374556 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2c7bd-c7dd-4b1d-b7e7-b813c810bc31 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:45.483516 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1363/2756] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:52:45 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:52:45.487800 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe238c-8ddb-4c5f-92d8-6b9caec1d8ff admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:45.500319 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe238c-8ddb-4c5f-92d8-6b9caec1d8ff admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:45.506740 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a278f07-83c0-421d-bfd3-0ebe1e464f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:45.507560 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a278f07-83c0-421d-bfd3-0ebe1e464f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:45.507756 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a278f07-83c0-421d-bfd3-0ebe1e464f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:45.508041 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a278f07-83c0-421d-bfd3-0ebe1e464f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:45.514764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a278f07-83c0-421d-bfd3-0ebe1e464f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:45.514764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a278f07-83c0-421d-bfd3-0ebe1e464f1b admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:45.524515 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1394/2757] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:52:45.529985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2c7bd-c7dd-4b1d-b7e7-b813c810bc31 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:45.542917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2c7bd-c7dd-4b1d-b7e7-b813c810bc31 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:45.548791 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578abb56-cfac-4803-9902-d875b4aeb509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:45.549640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578abb56-cfac-4803-9902-d875b4aeb509 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:45.549993 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578abb56-cfac-4803-9902-d875b4aeb509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:45.550341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578abb56-cfac-4803-9902-d875b4aeb509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:45.551425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578abb56-cfac-4803-9902-d875b4aeb509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:45.553415 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578abb56-cfac-4803-9902-d875b4aeb509 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:45.567499 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1364/2758] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:52:45.572371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a278f07-83c0-421d-bfd3-0ebe1e464f1b admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:45.587476 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a278f07-83c0-421d-bfd3-0ebe1e464f1b admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:45.592966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face0e0a-1ec6-4036-91de-4da35fbab110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:45.593893 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face0e0a-1ec6-4036-91de-4da35fbab110 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:45.594176 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face0e0a-1ec6-4036-91de-4da35fbab110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:45.594454 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face0e0a-1ec6-4036-91de-4da35fbab110 admin admin] PATH_INFO: `/v3/projects/d5560451a5cc491f960a0e0ec2571dfd/users/e7f564a1285d42c8a898ae493c9c53df/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:45.611514 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face0e0a-1ec6-4036-91de-4da35fbab110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5560451a5cc491f960a0e0ec2571dfd, user_id=e7f564a1285d42c8a898ae493c9c53df, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:45.614314 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face0e0a-1ec6-4036-91de-4da35fbab110 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:45.720414 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1395/2759] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:52:45 2022] PUT /identity/v3/projects/d5560451a5cc491f960a0e0ec2571dfd/users/e7f564a1285d42c8a898ae493c9c53df/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:45.722770 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8732c2-f2b9-47ab-b7f3-bb30e75ab713 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:45.723064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8732c2-f2b9-47ab-b7f3-bb30e75ab713 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:45.723312 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8732c2-f2b9-47ab-b7f3-bb30e75ab713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:45.740745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:45.774630 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-4c8732c2-f2b9-47ab-b7f3-bb30e75ab713 None None] MFA Rules not processed for user `e7f564a1285d42c8a898ae493c9c53df`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:45.777146 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-4c8732c2-f2b9-47ab-b7f3-bb30e75ab713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:45.918747 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1365/2760] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:52:45.934072 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face0e0a-1ec6-4036-91de-4da35fbab110 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:45.936492 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-face0e0a-1ec6-4036-91de-4da35fbab110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:45.993587 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:46.006371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face0e0a-1ec6-4036-91de-4da35fbab110 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:46.010352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231b881-c9c1-4952-948a-ba6d5674adb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:46.011014 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231b881-c9c1-4952-948a-ba6d5674adb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:46.011318 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231b881-c9c1-4952-948a-ba6d5674adb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:46.011598 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231b881-c9c1-4952-948a-ba6d5674adb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:46.023167 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231b881-c9c1-4952-948a-ba6d5674adb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:46.025081 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231b881-c9c1-4952-948a-ba6d5674adb1 service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:46.036502 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1396/2761] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:52:46.065525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8732c2-f2b9-47ab-b7f3-bb30e75ab713 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:46.157661 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8732c2-f2b9-47ab-b7f3-bb30e75ab713 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:46.165691 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac3c8a-2b6d-4464-9021-35095072647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:46.166796 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac3c8a-2b6d-4464-9021-35095072647c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:46.167228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac3c8a-2b6d-4464-9021-35095072647c admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:46.167588 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac3c8a-2b6d-4464-9021-35095072647c admin admin] PATH_INFO: `/v3/users/e7f564a1285d42c8a898ae493c9c53df` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:46.169461 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac3c8a-2b6d-4464-9021-35095072647c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7f564a1285d42c8a898ae493c9c53df)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:46.171622 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac3c8a-2b6d-4464-9021-35095072647c admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:46.395398 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-63ac3c8a-2b6d-4464-9021-35095072647c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7f564a1285d42c8a898ae493c9c53df'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:46.414445 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-63ac3c8a-2b6d-4464-9021-35095072647c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7f564a1285d42c8a898ae493c9c53df'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:46.422930 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-63ac3c8a-2b6d-4464-9021-35095072647c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7f564a1285d42c8a898ae493c9c53df'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:46.500909 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-63ac3c8a-2b6d-4464-9021-35095072647c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7f564a1285d42c8a898ae493c9c53df'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:46.502446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-63ac3c8a-2b6d-4464-9021-35095072647c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7f564a1285d42c8a898ae493c9c53df'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:46.518336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1366/2762] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:52:46 2022] DELETE /identity/v3/users/e7f564a1285d42c8a898ae493c9c53df => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:52:46.525360 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c201850-6c94-46e8-937b-91055399a081 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:46.526268 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c201850-6c94-46e8-937b-91055399a081 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:46.526420 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c201850-6c94-46e8-937b-91055399a081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:46.555824 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-1c201850-6c94-46e8-937b-91055399a081 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:46.557661 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1c201850-6c94-46e8-937b-91055399a081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:46.633892 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1397/2763] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:46.644272 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac3c8a-2b6d-4464-9021-35095072647c admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:46.646012 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-63ac3c8a-2b6d-4464-9021-35095072647c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:46.680362 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:46.734855 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac3c8a-2b6d-4464-9021-35095072647c admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:46.739020 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab41bc-f138-4b54-ac0d-f4b9591efd47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:46.739847 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab41bc-f138-4b54-ac0d-f4b9591efd47 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:46.740257 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab41bc-f138-4b54-ac0d-f4b9591efd47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:46.740601 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab41bc-f138-4b54-ac0d-f4b9591efd47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:46.756943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab41bc-f138-4b54-ac0d-f4b9591efd47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:46.759058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab41bc-f138-4b54-ac0d-f4b9591efd47 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:46.779338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1367/2764] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:52:47.587422 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c201850-6c94-46e8-937b-91055399a081 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:47.590360 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1c201850-6c94-46e8-937b-91055399a081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:47.639070 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c201850-6c94-46e8-937b-91055399a081 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:47.649630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d956ca1-88da-4896-bc66-ff19555afc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:47.651267 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d956ca1-88da-4896-bc66-ff19555afc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:47.651997 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d956ca1-88da-4896-bc66-ff19555afc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:47.655849 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d956ca1-88da-4896-bc66-ff19555afc62 admin admin] PATH_INFO: `/v3/projects/d5560451a5cc491f960a0e0ec2571dfd` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:47.657802 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d956ca1-88da-4896-bc66-ff19555afc62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5560451a5cc491f960a0e0ec2571dfd)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:47.663263 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d956ca1-88da-4896-bc66-ff19555afc62 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:47.841029 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7d956ca1-88da-4896-bc66-ff19555afc62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5560451a5cc491f960a0e0ec2571dfd', 'request_id': 'req-7d956ca1-88da-4896-bc66-ff19555afc62'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:47.940503 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7d956ca1-88da-4896-bc66-ff19555afc62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5560451a5cc491f960a0e0ec2571dfd', 'request_id': 'req-7d956ca1-88da-4896-bc66-ff19555afc62'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:47.948919 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7d956ca1-88da-4896-bc66-ff19555afc62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5560451a5cc491f960a0e0ec2571dfd', 'request_id': 'req-7d956ca1-88da-4896-bc66-ff19555afc62'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:47.969803 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7d956ca1-88da-4896-bc66-ff19555afc62 admin admin] The token cache is being invalidate because project d5560451a5cc491f960a0e0ec2571dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:52:47.970403 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7d956ca1-88da-4896-bc66-ff19555afc62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:47.973970 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7d956ca1-88da-4896-bc66-ff19555afc62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:47.977116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1398/2765] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:52:47 2022] DELETE /identity/v3/projects/d5560451a5cc491f960a0e0ec2571dfd => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:47.984695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd5721-1d43-4247-ae4e-4fa0ba6c75bc None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:47.985242 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd5721-1d43-4247-ae4e-4fa0ba6c75bc None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:47.985499 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd5721-1d43-4247-ae4e-4fa0ba6c75bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:48.010075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-68fd5721-1d43-4247-ae4e-4fa0ba6c75bc None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:48.011712 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-68fd5721-1d43-4247-ae4e-4fa0ba6c75bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:48.100051 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1368/2766] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:48.108120 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd603a-688e-4560-97a2-eb28a0275a9e None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:48.108829 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd603a-688e-4560-97a2-eb28a0275a9e None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:48.109122 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd603a-688e-4560-97a2-eb28a0275a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:48.137957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-04dd603a-688e-4560-97a2-eb28a0275a9e None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:48.137957 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-04dd603a-688e-4560-97a2-eb28a0275a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:48.149204 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1399/2767] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:48.153230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd5721-1d43-4247-ae4e-4fa0ba6c75bc None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:48.181672 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd5721-1d43-4247-ae4e-4fa0ba6c75bc None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:48.189780 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6363b-f6bf-4c53-a0d7-a3e78b637e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:48.192012 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6363b-f6bf-4c53-a0d7-a3e78b637e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:48.192588 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6363b-f6bf-4c53-a0d7-a3e78b637e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:48.193531 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6363b-f6bf-4c53-a0d7-a3e78b637e22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:48.195092 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6363b-f6bf-4c53-a0d7-a3e78b637e22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:52:48.195866 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6363b-f6bf-4c53-a0d7-a3e78b637e22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:48.199130 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6363b-f6bf-4c53-a0d7-a3e78b637e22 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:48.228572 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1369/2768] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:52:48.232896 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd603a-688e-4560-97a2-eb28a0275a9e None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:48.244175 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd603a-688e-4560-97a2-eb28a0275a9e None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:48.261364 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6689b37-5276-48d1-a5a5-2b10b6b9ef9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:48.262853 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6689b37-5276-48d1-a5a5-2b10b6b9ef9c admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:48.263542 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6689b37-5276-48d1-a5a5-2b10b6b9ef9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:48.264184 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6689b37-5276-48d1-a5a5-2b10b6b9ef9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:48.265850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6689b37-5276-48d1-a5a5-2b10b6b9ef9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:48.270308 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6689b37-5276-48d1-a5a5-2b10b6b9ef9c admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:48.437290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1400/2769] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:52:48 2022] POST /identity/v3/projects => generated 371 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:52:48.438333 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6363b-f6bf-4c53-a0d7-a3e78b637e22 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:48.451480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6363b-f6bf-4c53-a0d7-a3e78b637e22 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:48.545700 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc96ff-e91c-46fb-8900-abf163f72333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:48.546977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc96ff-e91c-46fb-8900-abf163f72333 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:48.546977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc96ff-e91c-46fb-8900-abf163f72333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:48.546977 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc96ff-e91c-46fb-8900-abf163f72333 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:48.547769 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc96ff-e91c-46fb-8900-abf163f72333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:48.549755 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc96ff-e91c-46fb-8900-abf163f72333 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:48.668064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1370/2770] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:52:48 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:52:48.674544 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6689b37-5276-48d1-a5a5-2b10b6b9ef9c admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:48.696746 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6689b37-5276-48d1-a5a5-2b10b6b9ef9c admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:48.701024 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c739a-c76f-43c7-bab9-a8e57a7e4980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:48.701839 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c739a-c76f-43c7-bab9-a8e57a7e4980 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:48.702302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c739a-c76f-43c7-bab9-a8e57a7e4980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:48.702779 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c739a-c76f-43c7-bab9-a8e57a7e4980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:48.703757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c739a-c76f-43c7-bab9-a8e57a7e4980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:48.705412 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c739a-c76f-43c7-bab9-a8e57a7e4980 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:48.720653 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1401/2771] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:52:48.728286 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc96ff-e91c-46fb-8900-abf163f72333 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:48.747415 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc96ff-e91c-46fb-8900-abf163f72333 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:48.755800 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91212210-00a2-42f7-8554-4e6bb44d250c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:48.760990 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212210-00a2-42f7-8554-4e6bb44d250c admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:48.760990 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212210-00a2-42f7-8554-4e6bb44d250c admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:48.760990 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212210-00a2-42f7-8554-4e6bb44d250c admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:48.760990 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91212210-00a2-42f7-8554-4e6bb44d250c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:48.762243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91212210-00a2-42f7-8554-4e6bb44d250c admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:48.774494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1371/2772] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:52:48.779640 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c739a-c76f-43c7-bab9-a8e57a7e4980 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:48.792540 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c739a-c76f-43c7-bab9-a8e57a7e4980 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:48.801352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbaff8-2445-4204-93d8-92e8e5c4e4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:48.803130 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbaff8-2445-4204-93d8-92e8e5c4e4fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:48.803744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbaff8-2445-4204-93d8-92e8e5c4e4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:48.804257 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbaff8-2445-4204-93d8-92e8e5c4e4fc admin admin] PATH_INFO: `/v3/projects/d9bd0c187b0b44c0a77251e60e3b6c20/users/18e8f88c8fbe40fb9d19ea1675c37430/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:48.823478 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbaff8-2445-4204-93d8-92e8e5c4e4fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9bd0c187b0b44c0a77251e60e3b6c20, user_id=18e8f88c8fbe40fb9d19ea1675c37430, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:48.829112 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbaff8-2445-4204-93d8-92e8e5c4e4fc admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:48.841409 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91212210-00a2-42f7-8554-4e6bb44d250c admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:48.844405 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-91212210-00a2-42f7-8554-4e6bb44d250c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:48.862450 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91212210-00a2-42f7-8554-4e6bb44d250c admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:48.868870 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ef406-2c11-4a0a-8324-51d56cbfefa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:48.869908 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ef406-2c11-4a0a-8324-51d56cbfefa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:48.870193 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ef406-2c11-4a0a-8324-51d56cbfefa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:48.870463 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ef406-2c11-4a0a-8324-51d56cbfefa0 admin admin] PATH_INFO: `/v3/users/61f2fb5928004be4bc85b9aa1d12eef7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:48.889142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ef406-2c11-4a0a-8324-51d56cbfefa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61f2fb5928004be4bc85b9aa1d12eef7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:48.891589 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ef406-2c11-4a0a-8324-51d56cbfefa0 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:48.900232 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:48.921475 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1402/2773] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:52:48 2022] PUT /identity/v3/projects/d9bd0c187b0b44c0a77251e60e3b6c20/users/18e8f88c8fbe40fb9d19ea1675c37430/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:48.928333 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e768b-4209-4a79-95dc-26aaef145e61 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:48.928789 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e768b-4209-4a79-95dc-26aaef145e61 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:48.929259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e768b-4209-4a79-95dc-26aaef145e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:48.937366 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:48.950303 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-7b7e768b-4209-4a79-95dc-26aaef145e61 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:48.951464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7b7e768b-4209-4a79-95dc-26aaef145e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:49.015235 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1403/2774] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:52:49.031479 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e768b-4209-4a79-95dc-26aaef145e61 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:49.031479 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-7b7e768b-4209-4a79-95dc-26aaef145e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:49.092961 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e768b-4209-4a79-95dc-26aaef145e61 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:49.096921 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bec3a-2335-4bca-ae0c-befa1f5e17a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:49.097723 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bec3a-2335-4bca-ae0c-befa1f5e17a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:49.098194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bec3a-2335-4bca-ae0c-befa1f5e17a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:49.098481 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bec3a-2335-4bca-ae0c-befa1f5e17a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:49.109082 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169bec3a-2335-4bca-ae0c-befa1f5e17a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:49.110597 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169bec3a-2335-4bca-ae0c-befa1f5e17a5 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:49.122300 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1404/2775] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:52:49.210327 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-266ef406-2c11-4a0a-8324-51d56cbfefa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61f2fb5928004be4bc85b9aa1d12eef7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:49.224328 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-266ef406-2c11-4a0a-8324-51d56cbfefa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61f2fb5928004be4bc85b9aa1d12eef7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:49.236853 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-266ef406-2c11-4a0a-8324-51d56cbfefa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61f2fb5928004be4bc85b9aa1d12eef7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:49.368491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-266ef406-2c11-4a0a-8324-51d56cbfefa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61f2fb5928004be4bc85b9aa1d12eef7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:49.369531 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-266ef406-2c11-4a0a-8324-51d56cbfefa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61f2fb5928004be4bc85b9aa1d12eef7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:49.377890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1372/2776] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:52:48 2022] DELETE /identity/v3/users/61f2fb5928004be4bc85b9aa1d12eef7 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:49.698533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bec3a-2335-4bca-ae0c-befa1f5e17a5 service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:49.716915 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bec3a-2335-4bca-ae0c-befa1f5e17a5 service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:49.794633 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63c4ce-17b7-4ecd-bee5-963a4f430268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:49.795928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63c4ce-17b7-4ecd-bee5-963a4f430268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:49.795928 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63c4ce-17b7-4ecd-bee5-963a4f430268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:49.796210 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63c4ce-17b7-4ecd-bee5-963a4f430268 admin admin] PATH_INFO: `/v3/projects/e88d46f58105478cba435e3cb6cdac8a` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:49.809626 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63c4ce-17b7-4ecd-bee5-963a4f430268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e88d46f58105478cba435e3cb6cdac8a)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:49.811630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63c4ce-17b7-4ecd-bee5-963a4f430268 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:49.937298 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:49.945302 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7b63c4ce-17b7-4ecd-bee5-963a4f430268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e88d46f58105478cba435e3cb6cdac8a', 'request_id': 'req-7b63c4ce-17b7-4ecd-bee5-963a4f430268'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:50.048769 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7b63c4ce-17b7-4ecd-bee5-963a4f430268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e88d46f58105478cba435e3cb6cdac8a', 'request_id': 'req-7b63c4ce-17b7-4ecd-bee5-963a4f430268'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:50.057187 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7b63c4ce-17b7-4ecd-bee5-963a4f430268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e88d46f58105478cba435e3cb6cdac8a', 'request_id': 'req-7b63c4ce-17b7-4ecd-bee5-963a4f430268'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:50.074815 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7b63c4ce-17b7-4ecd-bee5-963a4f430268 admin admin] The token cache is being invalidate because project e88d46f58105478cba435e3cb6cdac8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:52:50.075439 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7b63c4ce-17b7-4ecd-bee5-963a4f430268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:50.076238 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-7b63c4ce-17b7-4ecd-bee5-963a4f430268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:52:50.077952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1405/2777] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:52:49 2022] DELETE /identity/v3/projects/e88d46f58105478cba435e3cb6cdac8a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:52:50.084289 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c23ab-4271-4c00-9699-97f26abe8fed None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:50.084865 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c23ab-4271-4c00-9699-97f26abe8fed None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:50.085315 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c23ab-4271-4c00-9699-97f26abe8fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:50.107980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-310c23ab-4271-4c00-9699-97f26abe8fed None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:50.109251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-310c23ab-4271-4c00-9699-97f26abe8fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:50.210334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1373/2778] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:50.218538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730354f-5176-402c-b791-cff9d8606338 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:50.218828 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730354f-5176-402c-b791-cff9d8606338 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:50.219109 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730354f-5176-402c-b791-cff9d8606338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:50.239523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-1730354f-5176-402c-b791-cff9d8606338 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:50.240893 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1730354f-5176-402c-b791-cff9d8606338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:50.254873 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1406/2779] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:52:50.261118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c23ab-4271-4c00-9699-97f26abe8fed None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:50.280658 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c23ab-4271-4c00-9699-97f26abe8fed None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:50.289228 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b35aa2-702c-4606-a6d6-cde394a3cf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:50.290378 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b35aa2-702c-4606-a6d6-cde394a3cf37 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:50.290902 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b35aa2-702c-4606-a6d6-cde394a3cf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:50.291494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b35aa2-702c-4606-a6d6-cde394a3cf37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:50.292935 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b35aa2-702c-4606-a6d6-cde394a3cf37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:52:50.294999 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b35aa2-702c-4606-a6d6-cde394a3cf37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:50.296618 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b35aa2-702c-4606-a6d6-cde394a3cf37 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:50.318722 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1374/2780] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 14:52:50.323850 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730354f-5176-402c-b791-cff9d8606338 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:50.334989 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730354f-5176-402c-b791-cff9d8606338 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:50.339999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b528955-6e3c-44f9-b9c5-54140c5235d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:50.340680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b528955-6e3c-44f9-b9c5-54140c5235d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:50.340985 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b528955-6e3c-44f9-b9c5-54140c5235d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:50.341289 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b528955-6e3c-44f9-b9c5-54140c5235d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:50.341999 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b528955-6e3c-44f9-b9c5-54140c5235d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:50.343996 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b528955-6e3c-44f9-b9c5-54140c5235d8 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:50.452499 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1407/2781] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:52:50 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:52:50.459144 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b35aa2-702c-4606-a6d6-cde394a3cf37 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:50.478075 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b35aa2-702c-4606-a6d6-cde394a3cf37 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:50.577847 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90ee5c-949e-4d77-93dc-2f18fbc63b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:50.578501 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90ee5c-949e-4d77-93dc-2f18fbc63b92 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:50.578785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90ee5c-949e-4d77-93dc-2f18fbc63b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:50.579063 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90ee5c-949e-4d77-93dc-2f18fbc63b92 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:50.579825 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90ee5c-949e-4d77-93dc-2f18fbc63b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:50.582412 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90ee5c-949e-4d77-93dc-2f18fbc63b92 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:50.711539 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1375/2782] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:52:50 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:52:50.716310 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b528955-6e3c-44f9-b9c5-54140c5235d8 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:50.729548 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b528955-6e3c-44f9-b9c5-54140c5235d8 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:50.735855 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99fafd-9e4b-49b8-bcba-e4b8ce3607df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:50.736802 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99fafd-9e4b-49b8-bcba-e4b8ce3607df admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:50.737254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99fafd-9e4b-49b8-bcba-e4b8ce3607df admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:50.738588 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99fafd-9e4b-49b8-bcba-e4b8ce3607df admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:50.740213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99fafd-9e4b-49b8-bcba-e4b8ce3607df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:50.742817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99fafd-9e4b-49b8-bcba-e4b8ce3607df admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:50.776961 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8398ed-5080-4021-91ed-cf9301eb72cd None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:50.777486 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8398ed-5080-4021-91ed-cf9301eb72cd None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:50.778002 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8398ed-5080-4021-91ed-cf9301eb72cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:50.780989 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1408/2783] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:52:50.786038 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99fafd-9e4b-49b8-bcba-e4b8ce3607df admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:50.789772 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:50.810078 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99fafd-9e4b-49b8-bcba-e4b8ce3607df admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:50.818911 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e3dc7-e5b4-492b-aa74-cbbf2bb06218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:50.819769 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e3dc7-e5b4-492b-aa74-cbbf2bb06218 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:50.820329 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e3dc7-e5b4-492b-aa74-cbbf2bb06218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:50.820776 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e3dc7-e5b4-492b-aa74-cbbf2bb06218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:50.821794 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e3dc7-e5b4-492b-aa74-cbbf2bb06218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:50.824182 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e3dc7-e5b4-492b-aa74-cbbf2bb06218 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:50.834399 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-ab8398ed-5080-4021-91ed-cf9301eb72cd None None] MFA Rules not processed for user `18e8f88c8fbe40fb9d19ea1675c37430`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:50.836522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ab8398ed-5080-4021-91ed-cf9301eb72cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:50.847191 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1409/2784] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:52:50.850784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e3dc7-e5b4-492b-aa74-cbbf2bb06218 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:50.870438 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e3dc7-e5b4-492b-aa74-cbbf2bb06218 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:50.879846 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3de76-e6a0-460c-ae98-0c0d6a4be1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:50.881487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3de76-e6a0-460c-ae98-0c0d6a4be1ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:50.881966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3de76-e6a0-460c-ae98-0c0d6a4be1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:50.882470 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3de76-e6a0-460c-ae98-0c0d6a4be1ec admin admin] PATH_INFO: `/v3/projects/4407782945db444fa28f0af8f2f0a714/users/7d08e122fd77449c9a8c03ecc8e3d3ec/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:50.914438 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3de76-e6a0-460c-ae98-0c0d6a4be1ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4407782945db444fa28f0af8f2f0a714, user_id=7d08e122fd77449c9a8c03ecc8e3d3ec, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:50.920410 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3de76-e6a0-460c-ae98-0c0d6a4be1ec admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:50.953314 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1376/2785] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:52:50.966162 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8398ed-5080-4021-91ed-cf9301eb72cd None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:50.967862 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ab8398ed-5080-4021-91ed-cf9301eb72cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:51.038418 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8398ed-5080-4021-91ed-cf9301eb72cd None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:51.042512 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c28e8b-4d17-4fc9-b2b5-3adcdee99f11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:51.043226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c28e8b-4d17-4fc9-b2b5-3adcdee99f11 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:51.043624 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c28e8b-4d17-4fc9-b2b5-3adcdee99f11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:51.043907 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c28e8b-4d17-4fc9-b2b5-3adcdee99f11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:51.053841 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c28e8b-4d17-4fc9-b2b5-3adcdee99f11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:51.055480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c28e8b-4d17-4fc9-b2b5-3adcdee99f11 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:51.066683 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1377/2786] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:52:51.073415 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1410/2787] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:52:50 2022] PUT /identity/v3/projects/4407782945db444fa28f0af8f2f0a714/users/7d08e122fd77449c9a8c03ecc8e3d3ec/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:52:51.081321 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fb801-b48d-4e69-bf1d-c1fffc0f4cc6 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:51.081849 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fb801-b48d-4e69-bf1d-c1fffc0f4cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:51.082291 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fb801-b48d-4e69-bf1d-c1fffc0f4cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:51.103054 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-2d3fb801-b48d-4e69-bf1d-c1fffc0f4cc6 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:51.104403 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2d3fb801-b48d-4e69-bf1d-c1fffc0f4cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:51.202735 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1378/2788] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:52:51.217778 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3de76-e6a0-460c-ae98-0c0d6a4be1ec admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:52:51.219757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-aec3de76-e6a0-460c-ae98-0c0d6a4be1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:51.289763 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3de76-e6a0-460c-ae98-0c0d6a4be1ec admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:52:51.293490 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5f36c-c3f5-4bfb-b469-697b7c659e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:52:51.298067 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5f36c-c3f5-4bfb-b469-697b7c659e4a service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:51.298067 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5f36c-c3f5-4bfb-b469-697b7c659e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:51.298067 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5f36c-c3f5-4bfb-b469-697b7c659e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:51.303979 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5f36c-c3f5-4bfb-b469-697b7c659e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:52:51.305410 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5f36c-c3f5-4bfb-b469-697b7c659e4a service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:52:51.314840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1411/2789] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:52:53.057721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16b65f-a5fb-4572-9b4c-741574cf3789 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:52:53.058562 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16b65f-a5fb-4572-9b4c-741574cf3789 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:52:53.058897 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16b65f-a5fb-4572-9b4c-741574cf3789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:52:53.083451 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-cc16b65f-a5fb-4572-9b4c-741574cf3789 None None] MFA Rules not processed for user `18e8f88c8fbe40fb9d19ea1675c37430`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:52:53.085446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-cc16b65f-a5fb-4572-9b4c-741574cf3789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:52:53.141482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=100 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:52:53.180565 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1379/2790] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:52:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:53:00.066876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164308b-3528-4f78-a0f1-c5e2f6042f6c None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:53:00.067747 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164308b-3528-4f78-a0f1-c5e2f6042f6c None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:53:00.067953 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164308b-3528-4f78-a0f1-c5e2f6042f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:53:00.106219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16b65f-a5fb-4572-9b4c-741574cf3789 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:53:00.107181 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-5164308b-3528-4f78-a0f1-c5e2f6042f6c None None] MFA Rules not processed for user `7d08e122fd77449c9a8c03ecc8e3d3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:53:00.108266 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-5164308b-3528-4f78-a0f1-c5e2f6042f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:53:00.108469 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-cc16b65f-a5fb-4572-9b4c-741574cf3789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:53:00.122766 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16b65f-a5fb-4572-9b4c-741574cf3789 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:53:00.126636 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b9cf3-01be-4a0e-8c5c-0bd571fdf454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:53:00.127763 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b9cf3-01be-4a0e-8c5c-0bd571fdf454 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:53:00.127983 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b9cf3-01be-4a0e-8c5c-0bd571fdf454 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:53:00.128180 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b9cf3-01be-4a0e-8c5c-0bd571fdf454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:53:00.130384 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-033b9cf3-01be-4a0e-8c5c-0bd571fdf454 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:53:00.141590 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b9cf3-01be-4a0e-8c5c-0bd571fdf454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:53:00.143066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b9cf3-01be-4a0e-8c5c-0bd571fdf454 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:53:00.154457 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1380/2791] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:53:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:53:00.200534 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:53:00.246966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1412/2792] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:53:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:53:00.276447 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b9cf3-01be-4a0e-8c5c-0bd571fdf454 service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:53:00.278570 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-033b9cf3-01be-4a0e-8c5c-0bd571fdf454 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:53:00.390957 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b9cf3-01be-4a0e-8c5c-0bd571fdf454 service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:53:00.399947 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeac2ae-9531-4d56-951b-3dcf2f877439 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:53:00.400647 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeac2ae-9531-4d56-951b-3dcf2f877439 service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:53:00.400943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeac2ae-9531-4d56-951b-3dcf2f877439 service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:53:00.401226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeac2ae-9531-4d56-951b-3dcf2f877439 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:53:00.412000 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeac2ae-9531-4d56-951b-3dcf2f877439 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:53:00.414038 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeac2ae-9531-4d56-951b-3dcf2f877439 service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:53:00.424968 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1381/2793] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:53:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:53:03.993893 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ac7b5-88de-4312-aca9-9c21239255d8 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:53:03.994526 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ac7b5-88de-4312-aca9-9c21239255d8 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:53:03.994526 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ac7b5-88de-4312-aca9-9c21239255d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:53:04.014427 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-a45ac7b5-88de-4312-aca9-9c21239255d8 None None] MFA Rules not processed for user `7d08e122fd77449c9a8c03ecc8e3d3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:53:04.015905 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a45ac7b5-88de-4312-aca9-9c21239255d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:53:04.024917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1413/2794] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:53:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:53:04.473732 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeac2ae-9531-4d56-951b-3dcf2f877439 service nova] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:53:04.493439 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeac2ae-9531-4d56-951b-3dcf2f877439 service nova] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:53:04.500384 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b97e29-87d3-4a7c-b01b-b8ea334e0a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:53:04.501561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b97e29-87d3-4a7c-b01b-b8ea334e0a32 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:53:04.502054 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b97e29-87d3-4a7c-b01b-b8ea334e0a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:53:04.503044 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b97e29-87d3-4a7c-b01b-b8ea334e0a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:53:04.506099 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-08b97e29-87d3-4a7c-b01b-b8ea334e0a32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:53:04.527959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b97e29-87d3-4a7c-b01b-b8ea334e0a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:53:04.530832 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b97e29-87d3-4a7c-b01b-b8ea334e0a32 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:53:04.549643 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1382/2795] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:53:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:53:07.210015 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ac7b5-88de-4312-aca9-9c21239255d8 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:53:07.211851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a45ac7b5-88de-4312-aca9-9c21239255d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:53:07.326650 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ac7b5-88de-4312-aca9-9c21239255d8 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:53:07.333795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcaaac3-7861-463a-8c6f-186884bcd46c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a3704fdba154f13ad3bf8ac00c916c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:53:07.334569 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcaaac3-7861-463a-8c6f-186884bcd46c service placement] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:53:07.335022 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcaaac3-7861-463a-8c6f-186884bcd46c service placement] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:53:07.335408 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcaaac3-7861-463a-8c6f-186884bcd46c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:53:07.338309 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1dcaaac3-7861-463a-8c6f-186884bcd46c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:53:07.357260 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcaaac3-7861-463a-8c6f-186884bcd46c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:53:07.360317 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcaaac3-7861-463a-8c6f-186884bcd46c service placement] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:53:07.382256 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1414/2796] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:53:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:53:14.541012 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=55 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:53:17.273298 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269258f-2ce8-4d75-9ad3-4e44f9ac129b None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:53:17.274460 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269258f-2ce8-4d75-9ad3-4e44f9ac129b None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:53:17.275878 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269258f-2ce8-4d75-9ad3-4e44f9ac129b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:53:17.312437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-f269258f-2ce8-4d75-9ad3-4e44f9ac129b None None] MFA Rules not processed for user `18e8f88c8fbe40fb9d19ea1675c37430`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:53:17.313576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-f269258f-2ce8-4d75-9ad3-4e44f9ac129b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:53:17.324997 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1383/2797] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:53:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:53:17.371835 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=41 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:53:23.681542 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcaaac3-7861-463a-8c6f-186884bcd46c service placement] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:53:23.683206 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1dcaaac3-7861-463a-8c6f-186884bcd46c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:53:23.700447 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcaaac3-7861-463a-8c6f-186884bcd46c service placement] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:53:23.712966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a998ea-9e1d-440c-9827-02e160bf97bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:53:23.713749 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a998ea-9e1d-440c-9827-02e160bf97bb service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:53:23.714231 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a998ea-9e1d-440c-9827-02e160bf97bb service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:53:23.714702 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a998ea-9e1d-440c-9827-02e160bf97bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:53:23.716780 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-38a998ea-9e1d-440c-9827-02e160bf97bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:53:23.731647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a998ea-9e1d-440c-9827-02e160bf97bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:53:23.733238 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a998ea-9e1d-440c-9827-02e160bf97bb service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:53:23.747817 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1415/2798] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:53:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:53:27.302313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:53:27.570746 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269258f-2ce8-4d75-9ad3-4e44f9ac129b None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:53:27.585675 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269258f-2ce8-4d75-9ad3-4e44f9ac129b None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:53:27.591736 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd3f51-1435-46aa-966c-d3c20b83aacd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:53:27.592424 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd3f51-1435-46aa-966c-d3c20b83aacd service nova] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:53:27.592713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd3f51-1435-46aa-966c-d3c20b83aacd service nova] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:53:27.592991 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd3f51-1435-46aa-966c-d3c20b83aacd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:53:27.595186 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-86cd3f51-1435-46aa-966c-d3c20b83aacd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:53:27.609959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd3f51-1435-46aa-966c-d3c20b83aacd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:53:27.611674 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd3f51-1435-46aa-966c-d3c20b83aacd service nova] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:53:27.624050 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1384/2799] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:53:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:53:33.741105 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=6 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:53:37.618905 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=6 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:53:42.977336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee66ea1-0221-40aa-92cd-293e49b46562 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:53:42.977948 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee66ea1-0221-40aa-92cd-293e49b46562 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:53:42.977948 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee66ea1-0221-40aa-92cd-293e49b46562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:53:43.040862 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-5ee66ea1-0221-40aa-92cd-293e49b46562 None None] MFA Rules not processed for user `5ec758ef106b49f4985845b3c106f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:53:43.042178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-5ee66ea1-0221-40aa-92cd-293e49b46562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:53:43.119471 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1416/2800] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Jul 12 14:53:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:53:43.520276 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd3f51-1435-46aa-966c-d3c20b83aacd service nova] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:53:43.522854 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-86cd3f51-1435-46aa-966c-d3c20b83aacd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:53:43.667521 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd3f51-1435-46aa-966c-d3c20b83aacd service nova] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:53:43.676743 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812531bf-eb4b-4734-966b-86d0913e05f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad12085f356a4f0682bb70ad231a10b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:53:43.677828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812531bf-eb4b-4734-966b-86d0913e05f3 service swift] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:53:43.678318 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812531bf-eb4b-4734-966b-86d0913e05f3 service swift] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:53:43.678802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812531bf-eb4b-4734-966b-86d0913e05f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:53:43.694566 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812531bf-eb4b-4734-966b-86d0913e05f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:53:43.697688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812531bf-eb4b-4734-966b-86d0913e05f3 service swift] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:53:43.713857 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1385/2801] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Jul 12 14:53:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:53:53.116325 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=40 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:53:53.707812 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=41 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:54:03.872009 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb33c8-b7b5-479d-9269-bb6952f1be0d None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:54:03.872585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb33c8-b7b5-479d-9269-bb6952f1be0d None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:54:03.872585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb33c8-b7b5-479d-9269-bb6952f1be0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:54:03.894036 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-e2cb33c8-b7b5-479d-9269-bb6952f1be0d None None] MFA Rules not processed for user `5ec758ef106b49f4985845b3c106f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:54:03.895269 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e2cb33c8-b7b5-479d-9269-bb6952f1be0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:54:03.903242 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1417/2802] 10.222.0.40 () {58 vars in 967 bytes} [Tue Jul 12 14:54:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:54:03.917269 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812531bf-eb4b-4734-966b-86d0913e05f3 service swift] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:54:03.928585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812531bf-eb4b-4734-966b-86d0913e05f3 service swift] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:54:03.934106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788d7f0-e41a-428b-9751-21d810a7c093 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad12085f356a4f0682bb70ad231a10b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:54:03.934783 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788d7f0-e41a-428b-9751-21d810a7c093 service swift] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:54:03.935068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788d7f0-e41a-428b-9751-21d810a7c093 service swift] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:54:03.935375 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788d7f0-e41a-428b-9751-21d810a7c093 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:54:03.948196 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788d7f0-e41a-428b-9751-21d810a7c093 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:54:03.950458 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788d7f0-e41a-428b-9751-21d810a7c093 service swift] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:54:03.959237 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1386/2803] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Jul 12 14:54:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 14:54:07.671403 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb33c8-b7b5-479d-9269-bb6952f1be0d None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:54:07.673390 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e2cb33c8-b7b5-479d-9269-bb6952f1be0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:54:07.696762 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb33c8-b7b5-479d-9269-bb6952f1be0d None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:54:07.706807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88f1a2-3789-4c15-a6f9-9af7f216127b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a3704fdba154f13ad3bf8ac00c916c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:54:07.708055 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88f1a2-3789-4c15-a6f9-9af7f216127b service placement] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:54:07.708569 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88f1a2-3789-4c15-a6f9-9af7f216127b service placement] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:54:07.709123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88f1a2-3789-4c15-a6f9-9af7f216127b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:54:07.712141 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-cd88f1a2-3789-4c15-a6f9-9af7f216127b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:54:07.732592 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88f1a2-3789-4c15-a6f9-9af7f216127b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:54:07.734524 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88f1a2-3789-4c15-a6f9-9af7f216127b service placement] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:54:07.750208 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1418/2804] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:54:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:54:07.827518 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788d7f0-e41a-428b-9751-21d810a7c093 service swift] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:54:07.829945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-d788d7f0-e41a-428b-9751-21d810a7c093 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:54:07.856338 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788d7f0-e41a-428b-9751-21d810a7c093 service swift] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:54:07.864348 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b187b-8fd0-43d5-90cc-a97cb9054ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:54:07.865875 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b187b-8fd0-43d5-90cc-a97cb9054ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:54:07.866359 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b187b-8fd0-43d5-90cc-a97cb9054ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:54:07.866867 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b187b-8fd0-43d5-90cc-a97cb9054ecc admin admin] PATH_INFO: `/v3/users/18e8f88c8fbe40fb9d19ea1675c37430` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:54:07.869032 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b187b-8fd0-43d5-90cc-a97cb9054ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=18e8f88c8fbe40fb9d19ea1675c37430)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:54:07.872369 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b187b-8fd0-43d5-90cc-a97cb9054ecc admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:54:08.168660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-5d8b187b-8fd0-43d5-90cc-a97cb9054ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18e8f88c8fbe40fb9d19ea1675c37430'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:54:08.184654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-5d8b187b-8fd0-43d5-90cc-a97cb9054ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18e8f88c8fbe40fb9d19ea1675c37430'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:54:08.194782 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-5d8b187b-8fd0-43d5-90cc-a97cb9054ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18e8f88c8fbe40fb9d19ea1675c37430'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:54:08.286808 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-5d8b187b-8fd0-43d5-90cc-a97cb9054ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18e8f88c8fbe40fb9d19ea1675c37430'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:54:08.287494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-5d8b187b-8fd0-43d5-90cc-a97cb9054ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18e8f88c8fbe40fb9d19ea1675c37430'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:54:08.295952 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1387/2805] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:54:07 2022] DELETE /identity/v3/users/18e8f88c8fbe40fb9d19ea1675c37430 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:54:08.592950 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88f1a2-3789-4c15-a6f9-9af7f216127b service placement] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:54:08.610205 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88f1a2-3789-4c15-a6f9-9af7f216127b service placement] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:54:08.692536 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0378621-1714-4df7-ad4c-9a123ca2557f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:54:08.693936 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0378621-1714-4df7-ad4c-9a123ca2557f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:54:08.694394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0378621-1714-4df7-ad4c-9a123ca2557f admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:54:08.694809 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0378621-1714-4df7-ad4c-9a123ca2557f admin admin] PATH_INFO: `/v3/projects/d9bd0c187b0b44c0a77251e60e3b6c20` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:54:08.696589 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0378621-1714-4df7-ad4c-9a123ca2557f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9bd0c187b0b44c0a77251e60e3b6c20)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:54:08.699110 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0378621-1714-4df7-ad4c-9a123ca2557f admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:54:08.853404 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a0378621-1714-4df7-ad4c-9a123ca2557f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9bd0c187b0b44c0a77251e60e3b6c20', 'request_id': 'req-a0378621-1714-4df7-ad4c-9a123ca2557f'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:54:08.921108 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a0378621-1714-4df7-ad4c-9a123ca2557f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9bd0c187b0b44c0a77251e60e3b6c20', 'request_id': 'req-a0378621-1714-4df7-ad4c-9a123ca2557f'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:54:08.929570 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a0378621-1714-4df7-ad4c-9a123ca2557f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9bd0c187b0b44c0a77251e60e3b6c20', 'request_id': 'req-a0378621-1714-4df7-ad4c-9a123ca2557f'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:54:08.944778 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a0378621-1714-4df7-ad4c-9a123ca2557f admin admin] The token cache is being invalidate because project d9bd0c187b0b44c0a77251e60e3b6c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:54:08.945114 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a0378621-1714-4df7-ad4c-9a123ca2557f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:54:08.945995 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-a0378621-1714-4df7-ad4c-9a123ca2557f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:54:08.947911 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1419/2806] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:54:08 2022] DELETE /identity/v3/projects/d9bd0c187b0b44c0a77251e60e3b6c20 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:54:18.290611 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:54:18.940520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:55:41.934539 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b187b-8fd0-43d5-90cc-a97cb9054ecc admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:55:41.936749 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5d8b187b-8fd0-43d5-90cc-a97cb9054ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:55:42.028726 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b187b-8fd0-43d5-90cc-a97cb9054ecc admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:55:42.107030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafe28c-41b0-45bc-94e2-2b6470e8d11e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a3704fdba154f13ad3bf8ac00c916c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:55:42.107973 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafe28c-41b0-45bc-94e2-2b6470e8d11e service placement] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:55:42.108378 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafe28c-41b0-45bc-94e2-2b6470e8d11e service placement] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:55:42.108759 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafe28c-41b0-45bc-94e2-2b6470e8d11e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:55:42.111232 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-efafe28c-41b0-45bc-94e2-2b6470e8d11e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:55:42.124103 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efafe28c-41b0-45bc-94e2-2b6470e8d11e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:55:42.125949 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efafe28c-41b0-45bc-94e2-2b6470e8d11e service placement] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:55:42.138504 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1388/2807] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:55:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:55:52.134077 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=58 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:57:38.926750 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0378621-1714-4df7-ad4c-9a123ca2557f admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:57:38.928714 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a0378621-1714-4df7-ad4c-9a123ca2557f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:57:39.000635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0378621-1714-4df7-ad4c-9a123ca2557f admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:57:39.004916 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacea2f-d1d2-4a19-8edc-c149708bfb9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:57:39.005846 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacea2f-d1d2-4a19-8edc-c149708bfb9a service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:57:39.006166 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacea2f-d1d2-4a19-8edc-c149708bfb9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:57:39.006483 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacea2f-d1d2-4a19-8edc-c149708bfb9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:57:39.008647 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ddacea2f-d1d2-4a19-8edc-c149708bfb9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:57:39.095926 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddacea2f-d1d2-4a19-8edc-c149708bfb9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:57:39.097761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddacea2f-d1d2-4a19-8edc-c149708bfb9a service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:57:39.112561 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1420/2808] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:57:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:57:40.318699 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafe28c-41b0-45bc-94e2-2b6470e8d11e service placement] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:57:40.320573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-efafe28c-41b0-45bc-94e2-2b6470e8d11e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:57:40.374589 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafe28c-41b0-45bc-94e2-2b6470e8d11e service placement] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:57:40.379432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f94da2-86bd-4e32-af45-13713cc5cc54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:57:40.380118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f94da2-86bd-4e32-af45-13713cc5cc54 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:57:40.380405 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f94da2-86bd-4e32-af45-13713cc5cc54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:57:40.380689 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f94da2-86bd-4e32-af45-13713cc5cc54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:57:40.382634 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-74f94da2-86bd-4e32-af45-13713cc5cc54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:57:40.423734 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f94da2-86bd-4e32-af45-13713cc5cc54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:57:40.425210 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f94da2-86bd-4e32-af45-13713cc5cc54 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:57:40.438431 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1389/2809] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:57:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:57:42.599757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacea2f-d1d2-4a19-8edc-c149708bfb9a service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:57:42.602757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-ddacea2f-d1d2-4a19-8edc-c149708bfb9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:57:42.741221 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacea2f-d1d2-4a19-8edc-c149708bfb9a service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:57:42.753498 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff79e9-e7ed-4233-9bb3-79a592547005 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:57:42.755178 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff79e9-e7ed-4233-9bb3-79a592547005 service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:57:42.756030 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff79e9-e7ed-4233-9bb3-79a592547005 service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:57:42.756741 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff79e9-e7ed-4233-9bb3-79a592547005 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:57:42.760053 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-4eff79e9-e7ed-4233-9bb3-79a592547005 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:57:42.776988 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff79e9-e7ed-4233-9bb3-79a592547005 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:57:42.783905 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff79e9-e7ed-4233-9bb3-79a592547005 service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:57:42.795479 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1421/2810] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:57:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:57:47.804522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99368dc-3ccc-44e2-bc6d-279e78a45469 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:57:47.805359 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99368dc-3ccc-44e2-bc6d-279e78a45469 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:57:47.805359 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99368dc-3ccc-44e2-bc6d-279e78a45469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:57:47.827087 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-f99368dc-3ccc-44e2-bc6d-279e78a45469 None None] MFA Rules not processed for user `7d08e122fd77449c9a8c03ecc8e3d3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:57:47.829268 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-f99368dc-3ccc-44e2-bc6d-279e78a45469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:57:47.896840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1390/2811] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:57:52.787968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=82 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:57:57.888859 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=53 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:57:59.482398 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff79e9-e7ed-4233-9bb3-79a592547005 service nova] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:57:59.496778 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff79e9-e7ed-4233-9bb3-79a592547005 service nova] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:57:59.504116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86663f5d-426f-4401-a7c1-1b3c0fa6a128 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:57:59.504807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86663f5d-426f-4401-a7c1-1b3c0fa6a128 service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:57:59.505099 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86663f5d-426f-4401-a7c1-1b3c0fa6a128 service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:57:59.505383 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86663f5d-426f-4401-a7c1-1b3c0fa6a128 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:57:59.507756 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-86663f5d-426f-4401-a7c1-1b3c0fa6a128 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:57:59.521733 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86663f5d-426f-4401-a7c1-1b3c0fa6a128 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:57:59.523609 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86663f5d-426f-4401-a7c1-1b3c0fa6a128 service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:57:59.536262 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1422/2812] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:57:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:58:01.592808 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99368dc-3ccc-44e2-bc6d-279e78a45469 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:58:01.616423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99368dc-3ccc-44e2-bc6d-279e78a45469 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:58:01.620221 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b996526-ccc8-4625-8fbe-bb5dd7d11024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:58:01.625331 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b996526-ccc8-4625-8fbe-bb5dd7d11024 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:58:01.625331 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b996526-ccc8-4625-8fbe-bb5dd7d11024 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:58:01.625331 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b996526-ccc8-4625-8fbe-bb5dd7d11024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:58:01.625331 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2b996526-ccc8-4625-8fbe-bb5dd7d11024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:58:01.653178 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b996526-ccc8-4625-8fbe-bb5dd7d11024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:58:01.654640 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b996526-ccc8-4625-8fbe-bb5dd7d11024 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:58:01.664462 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1391/2813] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:58:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:58:09.529737 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=6 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:58:11.660088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=15 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:59:49.752183 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86663f5d-426f-4401-a7c1-1b3c0fa6a128 service nova] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:59:49.763998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86663f5d-426f-4401-a7c1-1b3c0fa6a128 service nova] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:59:49.768403 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587f75d-9926-4926-bca3-3dd706dda6e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:59:49.769089 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587f75d-9926-4926-bca3-3dd706dda6e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:49.769379 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587f75d-9926-4926-bca3-3dd706dda6e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:49.769669 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587f75d-9926-4926-bca3-3dd706dda6e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:49.771771 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0587f75d-9926-4926-bca3-3dd706dda6e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:59:49.879304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587f75d-9926-4926-bca3-3dd706dda6e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:59:49.880799 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587f75d-9926-4926-bca3-3dd706dda6e9 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:59:49.906257 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1423/2814] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 14:59:54.541888 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b996526-ccc8-4625-8fbe-bb5dd7d11024 service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:59:54.543464 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2b996526-ccc8-4625-8fbe-bb5dd7d11024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:59:54.559933 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b996526-ccc8-4625-8fbe-bb5dd7d11024 service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:59:54.565706 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5b59b-a144-496f-a976-1e58cd1f92a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a3704fdba154f13ad3bf8ac00c916c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:59:54.566392 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5b59b-a144-496f-a976-1e58cd1f92a7 service placement] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:54.566679 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5b59b-a144-496f-a976-1e58cd1f92a7 service placement] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:54.566959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5b59b-a144-496f-a976-1e58cd1f92a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:54.569305 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-99f5b59b-a144-496f-a976-1e58cd1f92a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:59:54.584283 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5b59b-a144-496f-a976-1e58cd1f92a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:59:54.585937 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5b59b-a144-496f-a976-1e58cd1f92a7 service placement] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:59:54.602243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1392/2815] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:59:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:59:54.679087 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587f75d-9926-4926-bca3-3dd706dda6e9 service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:59:54.681311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0587f75d-9926-4926-bca3-3dd706dda6e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:59:54.701538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587f75d-9926-4926-bca3-3dd706dda6e9 service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:59:54.707431 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11676086-b9b9-466f-ba14-bd7227862e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:59:54.708298 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11676086-b9b9-466f-ba14-bd7227862e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:54.708585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11676086-b9b9-466f-ba14-bd7227862e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:54.708984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11676086-b9b9-466f-ba14-bd7227862e0b admin admin] PATH_INFO: `/v3/users/7d08e122fd77449c9a8c03ecc8e3d3ec` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:54.710361 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11676086-b9b9-466f-ba14-bd7227862e0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d08e122fd77449c9a8c03ecc8e3d3ec)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:59:54.712442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11676086-b9b9-466f-ba14-bd7227862e0b admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:59:54.940449 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-11676086-b9b9-466f-ba14-bd7227862e0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d08e122fd77449c9a8c03ecc8e3d3ec'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:59:54.955813 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-11676086-b9b9-466f-ba14-bd7227862e0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d08e122fd77449c9a8c03ecc8e3d3ec'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:59:55.038291 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-11676086-b9b9-466f-ba14-bd7227862e0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d08e122fd77449c9a8c03ecc8e3d3ec'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:59:55.038940 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-11676086-b9b9-466f-ba14-bd7227862e0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d08e122fd77449c9a8c03ecc8e3d3ec'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:59:55.047990 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-11676086-b9b9-466f-ba14-bd7227862e0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d08e122fd77449c9a8c03ecc8e3d3ec'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:59:55.054919 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1424/2816] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 14:59:54 2022] DELETE /identity/v3/users/7d08e122fd77449c9a8c03ecc8e3d3ec => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:59:55.345456 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5b59b-a144-496f-a976-1e58cd1f92a7 service placement] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:59:55.369090 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5b59b-a144-496f-a976-1e58cd1f92a7 service placement] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:59:55.478400 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023faf1-d8f0-49e7-bddd-6a8c0ca1eec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:59:55.479330 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023faf1-d8f0-49e7-bddd-6a8c0ca1eec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:55.479673 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023faf1-d8f0-49e7-bddd-6a8c0ca1eec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:55.480046 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023faf1-d8f0-49e7-bddd-6a8c0ca1eec8 admin admin] PATH_INFO: `/v3/projects/4407782945db444fa28f0af8f2f0a714` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:55.482011 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023faf1-d8f0-49e7-bddd-6a8c0ca1eec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4407782945db444fa28f0af8f2f0a714)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:59:55.484164 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023faf1-d8f0-49e7-bddd-6a8c0ca1eec8 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:59:55.604296 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-7023faf1-d8f0-49e7-bddd-6a8c0ca1eec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4407782945db444fa28f0af8f2f0a714', 'request_id': 'req-7023faf1-d8f0-49e7-bddd-6a8c0ca1eec8'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:59:55.611750 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-7023faf1-d8f0-49e7-bddd-6a8c0ca1eec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4407782945db444fa28f0af8f2f0a714', 'request_id': 'req-7023faf1-d8f0-49e7-bddd-6a8c0ca1eec8'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:59:55.624945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-7023faf1-d8f0-49e7-bddd-6a8c0ca1eec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4407782945db444fa28f0af8f2f0a714', 'request_id': 'req-7023faf1-d8f0-49e7-bddd-6a8c0ca1eec8'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:59:55.705344 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-7023faf1-d8f0-49e7-bddd-6a8c0ca1eec8 admin admin] The token cache is being invalidate because project 4407782945db444fa28f0af8f2f0a714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 14:59:55.705630 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-7023faf1-d8f0-49e7-bddd-6a8c0ca1eec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:59:55.706329 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-7023faf1-d8f0-49e7-bddd-6a8c0ca1eec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 14:59:55.708071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1393/2817] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 14:59:55 2022] DELETE /identity/v3/projects/4407782945db444fa28f0af8f2f0a714 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:59:55.714152 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc62d23-9a24-4845-b4d3-f01d416c32a7 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:55.715106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc62d23-9a24-4845-b4d3-f01d416c32a7 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:55.715106 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc62d23-9a24-4845-b4d3-f01d416c32a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:55.790346 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:59:55.795674 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-1bc62d23-9a24-4845-b4d3-f01d416c32a7 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:59:55.797892 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1bc62d23-9a24-4845-b4d3-f01d416c32a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:59:55.882112 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1425/2818] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 14:59:55.891190 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387132-494f-4452-920b-d314c5505a5f None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:55.891702 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387132-494f-4452-920b-d314c5505a5f None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:55.892077 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387132-494f-4452-920b-d314c5505a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:55.916037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-a3387132-494f-4452-920b-d314c5505a5f None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:59:55.917307 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-a3387132-494f-4452-920b-d314c5505a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:59:55.926596 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1394/2819] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:59:55.932875 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc62d23-9a24-4845-b4d3-f01d416c32a7 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:59:55.943876 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc62d23-9a24-4845-b4d3-f01d416c32a7 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:59:55.950753 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100748ec-6c16-497f-bc8c-bd770e7ee7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:59:55.953337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100748ec-6c16-497f-bc8c-bd770e7ee7de admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:55.953337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100748ec-6c16-497f-bc8c-bd770e7ee7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:55.953337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100748ec-6c16-497f-bc8c-bd770e7ee7de admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:55.953337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100748ec-6c16-497f-bc8c-bd770e7ee7de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 14:59:55.953337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100748ec-6c16-497f-bc8c-bd770e7ee7de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:59:55.954802 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100748ec-6c16-497f-bc8c-bd770e7ee7de admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:59:55.969409 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1426/2820] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 14:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 14:59:55.974284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3387132-494f-4452-920b-d314c5505a5f None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:59:55.984817 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3387132-494f-4452-920b-d314c5505a5f None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:59:55.990832 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f835d-016b-4d8f-93c6-efc0f15fff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:59:55.991547 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f835d-016b-4d8f-93c6-efc0f15fff32 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:55.991831 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f835d-016b-4d8f-93c6-efc0f15fff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:55.992106 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f835d-016b-4d8f-93c6-efc0f15fff32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:55.992802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f835d-016b-4d8f-93c6-efc0f15fff32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:59:55.994771 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f835d-016b-4d8f-93c6-efc0f15fff32 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:59:56.119214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1395/2821] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:59:55 2022] POST /identity/v3/projects => generated 391 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:59:56.124534 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100748ec-6c16-497f-bc8c-bd770e7ee7de admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:59:56.135602 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100748ec-6c16-497f-bc8c-bd770e7ee7de admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:59:56.204967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3d90b-3f45-45b7-8a52-26f4eecace32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:59:56.205683 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3d90b-3f45-45b7-8a52-26f4eecace32 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:56.205963 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3d90b-3f45-45b7-8a52-26f4eecace32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:56.206234 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3d90b-3f45-45b7-8a52-26f4eecace32 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:56.206964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3d90b-3f45-45b7-8a52-26f4eecace32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:59:56.209030 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3d90b-3f45-45b7-8a52-26f4eecace32 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:59:56.325694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1427/2822] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:59:56 2022] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 14:59:56.330350 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f835d-016b-4d8f-93c6-efc0f15fff32 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:59:56.341849 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f835d-016b-4d8f-93c6-efc0f15fff32 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:59:56.347796 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dcc4c-6c5c-452f-a54a-51f1235a1241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:59:56.348522 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dcc4c-6c5c-452f-a54a-51f1235a1241 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:56.348928 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dcc4c-6c5c-452f-a54a-51f1235a1241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:56.349248 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dcc4c-6c5c-452f-a54a-51f1235a1241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:56.350082 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989dcc4c-6c5c-452f-a54a-51f1235a1241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:59:56.352091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989dcc4c-6c5c-452f-a54a-51f1235a1241 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:59:56.365745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1396/2823] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:59:56.370276 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3d90b-3f45-45b7-8a52-26f4eecace32 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:59:56.382871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3d90b-3f45-45b7-8a52-26f4eecace32 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:59:56.388744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5126c53-66b8-4e72-b474-18aa7da32241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:59:56.389518 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5126c53-66b8-4e72-b474-18aa7da32241 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:56.389964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5126c53-66b8-4e72-b474-18aa7da32241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:56.390295 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5126c53-66b8-4e72-b474-18aa7da32241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:56.391209 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5126c53-66b8-4e72-b474-18aa7da32241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:59:56.393046 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5126c53-66b8-4e72-b474-18aa7da32241 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:59:56.406585 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1428/2824] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 14:59:56.411152 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dcc4c-6c5c-452f-a54a-51f1235a1241 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:59:56.423334 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dcc4c-6c5c-452f-a54a-51f1235a1241 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:59:56.428535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a973176-c017-48a8-9fa4-7ea776abe6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:59:56.429513 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a973176-c017-48a8-9fa4-7ea776abe6b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:56.429835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a973176-c017-48a8-9fa4-7ea776abe6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:56.430163 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a973176-c017-48a8-9fa4-7ea776abe6b1 admin admin] PATH_INFO: `/v3/projects/ebc7ce37bacf4fd8a2d47acfe65a408f/users/8668460b3bbb42e0bedeb015e10039bc/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:56.449461 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a973176-c017-48a8-9fa4-7ea776abe6b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc7ce37bacf4fd8a2d47acfe65a408f, user_id=8668460b3bbb42e0bedeb015e10039bc, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:59:56.453276 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a973176-c017-48a8-9fa4-7ea776abe6b1 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:59:56.551608 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1397/2825] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:59:56 2022] PUT /identity/v3/projects/ebc7ce37bacf4fd8a2d47acfe65a408f/users/8668460b3bbb42e0bedeb015e10039bc/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 14:59:56.564299 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ccbfd-d976-4d63-b03d-0ed783e2ff1a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:56.566484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ccbfd-d976-4d63-b03d-0ed783e2ff1a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:56.566484 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ccbfd-d976-4d63-b03d-0ed783e2ff1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:56.596591 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-a72ccbfd-d976-4d63-b03d-0ed783e2ff1a None None] MFA Rules not processed for user `8668460b3bbb42e0bedeb015e10039bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:59:56.598029 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-a72ccbfd-d976-4d63-b03d-0ed783e2ff1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:59:56.671561 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1429/2826] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:59:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:59:56.676550 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a973176-c017-48a8-9fa4-7ea776abe6b1 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:59:56.683064 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:59:56.751761 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a973176-c017-48a8-9fa4-7ea776abe6b1 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:59:56.756812 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb8440-151b-4ddd-9647-d0e3b3b1edd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:59:56.757503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8440-151b-4ddd-9647-d0e3b3b1edd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:56.757789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8440-151b-4ddd-9647-d0e3b3b1edd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:56.758068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8440-151b-4ddd-9647-d0e3b3b1edd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:56.758788 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb8440-151b-4ddd-9647-d0e3b3b1edd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:59:56.760818 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb8440-151b-4ddd-9647-d0e3b3b1edd2 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:59:56.901542 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1398/2827] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 14:59:56 2022] POST /identity/v3/projects => generated 391 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:59:56.908188 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ccbfd-d976-4d63-b03d-0ed783e2ff1a None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:59:56.913935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:59:56.920542 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ccbfd-d976-4d63-b03d-0ed783e2ff1a None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:59:56.994727 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f037dd-e513-4ae4-a90c-95dd695debf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:59:56.995562 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f037dd-e513-4ae4-a90c-95dd695debf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:56.995937 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f037dd-e513-4ae4-a90c-95dd695debf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:56.996343 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f037dd-e513-4ae4-a90c-95dd695debf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:56.997745 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f037dd-e513-4ae4-a90c-95dd695debf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:59:56.999984 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f037dd-e513-4ae4-a90c-95dd695debf7 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:59:57.102574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1430/2828] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 14:59:56 2022] POST /identity/v3/users => generated 302 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 14:59:57.107985 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb8440-151b-4ddd-9647-d0e3b3b1edd2 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:59:57.119492 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb8440-151b-4ddd-9647-d0e3b3b1edd2 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:59:57.124804 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a1075-c85c-48c3-9bcd-ff54f71f5389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:59:57.125506 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a1075-c85c-48c3-9bcd-ff54f71f5389 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:57.125784 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a1075-c85c-48c3-9bcd-ff54f71f5389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:57.126056 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a1075-c85c-48c3-9bcd-ff54f71f5389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:57.126833 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a1075-c85c-48c3-9bcd-ff54f71f5389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:59:57.128513 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a1075-c85c-48c3-9bcd-ff54f71f5389 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:59:57.141615 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1399/2829] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:59:57.147967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f037dd-e513-4ae4-a90c-95dd695debf7 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:59:57.160571 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f037dd-e513-4ae4-a90c-95dd695debf7 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:59:57.165887 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cf0e3-8b0f-44a4-959d-a3f0f703a2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:59:57.166806 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cf0e3-8b0f-44a4-959d-a3f0f703a2d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:57.167092 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cf0e3-8b0f-44a4-959d-a3f0f703a2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:57.167412 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cf0e3-8b0f-44a4-959d-a3f0f703a2d8 admin admin] PATH_INFO: `/v3/projects/c4a56de83d4347fd82990ae9fd282fe6/users/72aab508469b49a9ba6fe015df8b30e3/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:57.186155 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6cf0e3-8b0f-44a4-959d-a3f0f703a2d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a56de83d4347fd82990ae9fd282fe6, user_id=72aab508469b49a9ba6fe015df8b30e3, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:59:57.189126 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6cf0e3-8b0f-44a4-959d-a3f0f703a2d8 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:59:57.271207 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1431/2830] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:59:57 2022] PUT /identity/v3/projects/c4a56de83d4347fd82990ae9fd282fe6/users/72aab508469b49a9ba6fe015df8b30e3/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:59:57.275796 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a1075-c85c-48c3-9bcd-ff54f71f5389 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:59:57.287337 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a1075-c85c-48c3-9bcd-ff54f71f5389 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:59:57.354677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff88519-6685-43a9-82df-3c068fc14620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:59:57.355405 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff88519-6685-43a9-82df-3c068fc14620 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:57.355699 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff88519-6685-43a9-82df-3c068fc14620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:57.355970 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff88519-6685-43a9-82df-3c068fc14620 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:57.356718 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff88519-6685-43a9-82df-3c068fc14620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:59:57.358360 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff88519-6685-43a9-82df-3c068fc14620 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:59:57.369810 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1400/2831] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 14:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 14:59:57.377968 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cf0e3-8b0f-44a4-959d-a3f0f703a2d8 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:59:57.390416 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cf0e3-8b0f-44a4-959d-a3f0f703a2d8 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:59:57.395452 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f0c68-2f56-4293-83bc-25433fdfc7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:59:57.396425 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f0c68-2f56-4293-83bc-25433fdfc7c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:57.396688 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f0c68-2f56-4293-83bc-25433fdfc7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:57.396956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f0c68-2f56-4293-83bc-25433fdfc7c7 admin admin] PATH_INFO: `/v3/projects/c4a56de83d4347fd82990ae9fd282fe6/users/72aab508469b49a9ba6fe015df8b30e3/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:57.399159 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f0c68-2f56-4293-83bc-25433fdfc7c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a56de83d4347fd82990ae9fd282fe6, user_id=72aab508469b49a9ba6fe015df8b30e3, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:59:57.402155 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f0c68-2f56-4293-83bc-25433fdfc7c7 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:59:57.414735 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1432/2832] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 14:59:57 2022] PUT /identity/v3/projects/c4a56de83d4347fd82990ae9fd282fe6/users/72aab508469b49a9ba6fe015df8b30e3/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 14:59:57.425295 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46592394-998f-4b6e-8e55-6e7cba6c61c6 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:57.425616 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46592394-998f-4b6e-8e55-6e7cba6c61c6 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:57.425857 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46592394-998f-4b6e-8e55-6e7cba6c61c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:57.457664 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-46592394-998f-4b6e-8e55-6e7cba6c61c6 None None] MFA Rules not processed for user `72aab508469b49a9ba6fe015df8b30e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 14:59:57.458913 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-46592394-998f-4b6e-8e55-6e7cba6c61c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:59:57.570955 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 14:59:57.575959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1401/2833] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 14:59:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 14:59:57.589543 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f0c68-2f56-4293-83bc-25433fdfc7c7 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:59:57.591997 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-962f0c68-2f56-4293-83bc-25433fdfc7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:59:57.694910 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f0c68-2f56-4293-83bc-25433fdfc7c7 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:59:57.702030 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37a473-02de-4e3a-9cd2-e2fec572476f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:59:57.703117 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37a473-02de-4e3a-9cd2-e2fec572476f service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:57.703677 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37a473-02de-4e3a-9cd2-e2fec572476f service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:57.704187 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37a473-02de-4e3a-9cd2-e2fec572476f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:57.720848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37a473-02de-4e3a-9cd2-e2fec572476f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:59:57.722442 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37a473-02de-4e3a-9cd2-e2fec572476f service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:59:57.734310 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1433/2834] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:59:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 14:59:57.788482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46592394-998f-4b6e-8e55-6e7cba6c61c6 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 14:59:57.790176 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-46592394-998f-4b6e-8e55-6e7cba6c61c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 14:59:57.804058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46592394-998f-4b6e-8e55-6e7cba6c61c6 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 14:59:57.807845 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5eb52-6658-4023-b25d-a8ba49fa15cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 14:59:57.808519 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5eb52-6658-4023-b25d-a8ba49fa15cf service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 14:59:57.808799 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5eb52-6658-4023-b25d-a8ba49fa15cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 14:59:57.809071 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5eb52-6658-4023-b25d-a8ba49fa15cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 14:59:57.878029 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5eb52-6658-4023-b25d-a8ba49fa15cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 14:59:57.879548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5eb52-6658-4023-b25d-a8ba49fa15cf service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 14:59:57.891802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1402/2835] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 14:59:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 15:00:04.103340 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37a473-02de-4e3a-9cd2-e2fec572476f service cinder] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:04.165284 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:04.192826 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37a473-02de-4e3a-9cd2-e2fec572476f service cinder] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:04.200653 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc378f9e-c098-4bf5-9078-bb1b382ea311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:04.201622 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc378f9e-c098-4bf5-9078-bb1b382ea311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:04.201908 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc378f9e-c098-4bf5-9078-bb1b382ea311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:04.202194 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc378f9e-c098-4bf5-9078-bb1b382ea311 admin admin] PATH_INFO: `/v3/users/8668460b3bbb42e0bedeb015e10039bc` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:04.203815 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc378f9e-c098-4bf5-9078-bb1b382ea311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8668460b3bbb42e0bedeb015e10039bc)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:04.205993 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc378f9e-c098-4bf5-9078-bb1b382ea311 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:04.460054 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-fc378f9e-c098-4bf5-9078-bb1b382ea311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8668460b3bbb42e0bedeb015e10039bc'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:04.480938 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-fc378f9e-c098-4bf5-9078-bb1b382ea311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8668460b3bbb42e0bedeb015e10039bc'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:04.575766 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-fc378f9e-c098-4bf5-9078-bb1b382ea311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8668460b3bbb42e0bedeb015e10039bc'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:04.576773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-fc378f9e-c098-4bf5-9078-bb1b382ea311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8668460b3bbb42e0bedeb015e10039bc'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:04.590548 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-fc378f9e-c098-4bf5-9078-bb1b382ea311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8668460b3bbb42e0bedeb015e10039bc'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:04.601712 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1434/2836] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 15:00:04 2022] DELETE /identity/v3/users/8668460b3bbb42e0bedeb015e10039bc => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 15:00:04.606708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce74a9-3023-4724-bdeb-5be72b985240 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:04.607320 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce74a9-3023-4724-bdeb-5be72b985240 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:04.607320 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce74a9-3023-4724-bdeb-5be72b985240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:04.626679 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-60ce74a9-3023-4724-bdeb-5be72b985240 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:04.628010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-60ce74a9-3023-4724-bdeb-5be72b985240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:04.700637 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1403/2837] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 15:00:04.712873 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc378f9e-c098-4bf5-9078-bb1b382ea311 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:04.714459 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-fc378f9e-c098-4bf5-9078-bb1b382ea311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:04.789254 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc378f9e-c098-4bf5-9078-bb1b382ea311 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:04.794439 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32b781-7e3c-41f9-a06f-f8fabc3db6c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:04.799104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32b781-7e3c-41f9-a06f-f8fabc3db6c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:04.799104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32b781-7e3c-41f9-a06f-f8fabc3db6c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:04.799104 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32b781-7e3c-41f9-a06f-f8fabc3db6c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:04.806857 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32b781-7e3c-41f9-a06f-f8fabc3db6c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:04.808451 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32b781-7e3c-41f9-a06f-f8fabc3db6c9 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:04.820062 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1435/2838] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 15:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 15:00:05.317252 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce74a9-3023-4724-bdeb-5be72b985240 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:05.323548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-60ce74a9-3023-4724-bdeb-5be72b985240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:05.340934 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce74a9-3023-4724-bdeb-5be72b985240 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:05.346341 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82264f72-1243-43a5-a424-70f09fa03351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:05.347351 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82264f72-1243-43a5-a424-70f09fa03351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:05.352116 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82264f72-1243-43a5-a424-70f09fa03351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:05.352116 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82264f72-1243-43a5-a424-70f09fa03351 admin admin] PATH_INFO: `/v3/projects/ebc7ce37bacf4fd8a2d47acfe65a408f` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:05.352116 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82264f72-1243-43a5-a424-70f09fa03351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc7ce37bacf4fd8a2d47acfe65a408f)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:05.352116 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82264f72-1243-43a5-a424-70f09fa03351 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:05.465923 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-82264f72-1243-43a5-a424-70f09fa03351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc7ce37bacf4fd8a2d47acfe65a408f', 'request_id': 'req-82264f72-1243-43a5-a424-70f09fa03351'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:05.476423 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-82264f72-1243-43a5-a424-70f09fa03351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc7ce37bacf4fd8a2d47acfe65a408f', 'request_id': 'req-82264f72-1243-43a5-a424-70f09fa03351'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:05.489067 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-82264f72-1243-43a5-a424-70f09fa03351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc7ce37bacf4fd8a2d47acfe65a408f', 'request_id': 'req-82264f72-1243-43a5-a424-70f09fa03351'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:05.581437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-82264f72-1243-43a5-a424-70f09fa03351 admin admin] The token cache is being invalidate because project ebc7ce37bacf4fd8a2d47acfe65a408f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 15:00:05.581731 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-82264f72-1243-43a5-a424-70f09fa03351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:05.582433 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-82264f72-1243-43a5-a424-70f09fa03351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:05.584163 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1404/2839] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 15:00:05 2022] DELETE /identity/v3/projects/ebc7ce37bacf4fd8a2d47acfe65a408f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 15:00:05.588576 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32b781-7e3c-41f9-a06f-f8fabc3db6c9 service neutron] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:05.600412 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32b781-7e3c-41f9-a06f-f8fabc3db6c9 service neutron] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:05.669939 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90d884-76f2-44f4-9049-5ecc9e3ad3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:05.670997 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90d884-76f2-44f4-9049-5ecc9e3ad3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:05.671311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90d884-76f2-44f4-9049-5ecc9e3ad3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:05.671606 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90d884-76f2-44f4-9049-5ecc9e3ad3a4 admin admin] PATH_INFO: `/v3/users/72aab508469b49a9ba6fe015df8b30e3` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:05.672930 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90d884-76f2-44f4-9049-5ecc9e3ad3a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72aab508469b49a9ba6fe015df8b30e3)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:05.674954 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90d884-76f2-44f4-9049-5ecc9e3ad3a4 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:05.676862 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:05.902213 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-bd90d884-76f2-44f4-9049-5ecc9e3ad3a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72aab508469b49a9ba6fe015df8b30e3'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:05.917405 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-bd90d884-76f2-44f4-9049-5ecc9e3ad3a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72aab508469b49a9ba6fe015df8b30e3'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:06.014917 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-bd90d884-76f2-44f4-9049-5ecc9e3ad3a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72aab508469b49a9ba6fe015df8b30e3'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:06.015703 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-bd90d884-76f2-44f4-9049-5ecc9e3ad3a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72aab508469b49a9ba6fe015df8b30e3'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:06.026515 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-bd90d884-76f2-44f4-9049-5ecc9e3ad3a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72aab508469b49a9ba6fe015df8b30e3'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:06.034803 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1436/2840] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 15:00:05 2022] DELETE /identity/v3/users/72aab508469b49a9ba6fe015df8b30e3 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 15:00:06.565174 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82264f72-1243-43a5-a424-70f09fa03351 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:06.567791 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-82264f72-1243-43a5-a424-70f09fa03351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:06.591575 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82264f72-1243-43a5-a424-70f09fa03351 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:06.619185 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:06.669009 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ac5bd-f32c-4edb-a087-81dcd6cb761c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:06.669804 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ac5bd-f32c-4edb-a087-81dcd6cb761c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:06.670091 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ac5bd-f32c-4edb-a087-81dcd6cb761c admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:06.670370 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ac5bd-f32c-4edb-a087-81dcd6cb761c admin admin] PATH_INFO: `/v3/projects/c4a56de83d4347fd82990ae9fd282fe6` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:06.671795 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ac5bd-f32c-4edb-a087-81dcd6cb761c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4a56de83d4347fd82990ae9fd282fe6)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:06.673757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ac5bd-f32c-4edb-a087-81dcd6cb761c admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:06.801992 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-da6ac5bd-f32c-4edb-a087-81dcd6cb761c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4a56de83d4347fd82990ae9fd282fe6', 'request_id': 'req-da6ac5bd-f32c-4edb-a087-81dcd6cb761c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:06.809687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-da6ac5bd-f32c-4edb-a087-81dcd6cb761c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4a56de83d4347fd82990ae9fd282fe6', 'request_id': 'req-da6ac5bd-f32c-4edb-a087-81dcd6cb761c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:06.817028 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-da6ac5bd-f32c-4edb-a087-81dcd6cb761c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4a56de83d4347fd82990ae9fd282fe6', 'request_id': 'req-da6ac5bd-f32c-4edb-a087-81dcd6cb761c'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:06.907869 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-da6ac5bd-f32c-4edb-a087-81dcd6cb761c admin admin] The token cache is being invalidate because project c4a56de83d4347fd82990ae9fd282fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 15:00:06.908313 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-da6ac5bd-f32c-4edb-a087-81dcd6cb761c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:06.909159 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-da6ac5bd-f32c-4edb-a087-81dcd6cb761c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:06.911034 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1405/2841] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 15:00:06 2022] DELETE /identity/v3/projects/c4a56de83d4347fd82990ae9fd282fe6 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 15:00:06.917085 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c98d7-fd4f-4da5-9d82-a2be180655dc None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:06.917728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c98d7-fd4f-4da5-9d82-a2be180655dc None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:06.917848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c98d7-fd4f-4da5-9d82-a2be180655dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:06.939094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-882c98d7-fd4f-4da5-9d82-a2be180655dc None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:06.940407 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-882c98d7-fd4f-4da5-9d82-a2be180655dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:07.019007 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1437/2842] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 15:00:07.030357 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2aed6-3816-42c9-84ae-8c507948e3ba None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:07.030693 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2aed6-3816-42c9-84ae-8c507948e3ba None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:07.031010 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2aed6-3816-42c9-84ae-8c507948e3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:07.051571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-46b2aed6-3816-42c9-84ae-8c507948e3ba None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:07.055902 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-46b2aed6-3816-42c9-84ae-8c507948e3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:07.062213 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1406/2843] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 15:00:07.066866 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c98d7-fd4f-4da5-9d82-a2be180655dc None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:07.078831 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c98d7-fd4f-4da5-9d82-a2be180655dc None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:07.083948 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a3f1d-ae34-4401-b112-89483c2d3981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:07.084651 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a3f1d-ae34-4401-b112-89483c2d3981 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:07.084945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a3f1d-ae34-4401-b112-89483c2d3981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:07.085223 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a3f1d-ae34-4401-b112-89483c2d3981 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:07.085991 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a3f1d-ae34-4401-b112-89483c2d3981 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 15:00:07.086304 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a3f1d-ae34-4401-b112-89483c2d3981 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:07.088093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a3f1d-ae34-4401-b112-89483c2d3981 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:07.103215 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1438/2844] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 15:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 15:00:07.108471 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2aed6-3816-42c9-84ae-8c507948e3ba None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:07.127610 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2aed6-3816-42c9-84ae-8c507948e3ba None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:07.134605 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c474ce5-3f42-4f76-92fb-5b0876660b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:07.135446 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c474ce5-3f42-4f76-92fb-5b0876660b4d admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:07.135803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c474ce5-3f42-4f76-92fb-5b0876660b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:07.136132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c474ce5-3f42-4f76-92fb-5b0876660b4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:07.137606 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c474ce5-3f42-4f76-92fb-5b0876660b4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:07.139828 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c474ce5-3f42-4f76-92fb-5b0876660b4d admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:07.263676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1407/2845] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 15:00:07 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 15:00:07.268416 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a3f1d-ae34-4401-b112-89483c2d3981 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:07.280595 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a3f1d-ae34-4401-b112-89483c2d3981 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:07.348200 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546be014-8e41-4295-b99c-94d8caaf72a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:07.348793 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546be014-8e41-4295-b99c-94d8caaf72a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:07.349090 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546be014-8e41-4295-b99c-94d8caaf72a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:07.349352 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546be014-8e41-4295-b99c-94d8caaf72a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:07.350063 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546be014-8e41-4295-b99c-94d8caaf72a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:07.352085 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546be014-8e41-4295-b99c-94d8caaf72a3 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:07.363390 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:07.524757 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1439/2846] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 15:00:07 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 15:00:07.532171 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c474ce5-3f42-4f76-92fb-5b0876660b4d admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:07.550981 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c474ce5-3f42-4f76-92fb-5b0876660b4d admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:07.559449 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e6edd-efc4-4e65-9dc7-0b1cc2af720a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:07.560744 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e6edd-efc4-4e65-9dc7-0b1cc2af720a admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:07.561236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e6edd-efc4-4e65-9dc7-0b1cc2af720a admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:07.561731 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e6edd-efc4-4e65-9dc7-0b1cc2af720a admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:07.563138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e6edd-efc4-4e65-9dc7-0b1cc2af720a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:07.566336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e6edd-efc4-4e65-9dc7-0b1cc2af720a admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:07.581283 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1408/2847] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 15:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 15:00:07.587123 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546be014-8e41-4295-b99c-94d8caaf72a3 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:07.599840 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546be014-8e41-4295-b99c-94d8caaf72a3 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:07.605475 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188e3d4-19f2-4769-9d02-5dad3251b73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:07.606236 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188e3d4-19f2-4769-9d02-5dad3251b73e admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:07.606523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188e3d4-19f2-4769-9d02-5dad3251b73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:07.607044 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188e3d4-19f2-4769-9d02-5dad3251b73e admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:07.607915 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188e3d4-19f2-4769-9d02-5dad3251b73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:07.609724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188e3d4-19f2-4769-9d02-5dad3251b73e admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:07.622298 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1440/2848] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 15:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 15:00:07.626980 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e6edd-efc4-4e65-9dc7-0b1cc2af720a admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:07.639084 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e6edd-efc4-4e65-9dc7-0b1cc2af720a admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:07.644080 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6af472-3c85-4d2a-896c-3d137a595452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:07.645003 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6af472-3c85-4d2a-896c-3d137a595452 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:07.645284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6af472-3c85-4d2a-896c-3d137a595452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:07.645559 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6af472-3c85-4d2a-896c-3d137a595452 admin admin] PATH_INFO: `/v3/projects/fa13a85e2abe4c38a9ae67ddee307199/users/1eda79d355b84bc5a41ed2b6799740f7/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:07.664576 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6af472-3c85-4d2a-896c-3d137a595452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa13a85e2abe4c38a9ae67ddee307199, user_id=1eda79d355b84bc5a41ed2b6799740f7, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:07.667691 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6af472-3c85-4d2a-896c-3d137a595452 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:07.763935 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1409/2849] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 15:00:07 2022] PUT /identity/v3/projects/fa13a85e2abe4c38a9ae67ddee307199/users/1eda79d355b84bc5a41ed2b6799740f7/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 15:00:07.780127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7dacc-f0bd-4f24-b6be-60b79ea94c9a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:07.780464 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7dacc-f0bd-4f24-b6be-60b79ea94c9a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:07.780806 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7dacc-f0bd-4f24-b6be-60b79ea94c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:07.814240 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-4eb7dacc-f0bd-4f24-b6be-60b79ea94c9a None None] MFA Rules not processed for user `1eda79d355b84bc5a41ed2b6799740f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:07.815730 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-4eb7dacc-f0bd-4f24-b6be-60b79ea94c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:07.894419 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1441/2850] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 15:00:07.899884 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6af472-3c85-4d2a-896c-3d137a595452 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:07.958834 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:07.975111 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6af472-3c85-4d2a-896c-3d137a595452 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:07.981169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20dc90-de21-431c-9bc2-bf57513cea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:07.982020 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20dc90-de21-431c-9bc2-bf57513cea67 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:07.982401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20dc90-de21-431c-9bc2-bf57513cea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:07.982789 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20dc90-de21-431c-9bc2-bf57513cea67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:07.983654 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20dc90-de21-431c-9bc2-bf57513cea67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:07.985873 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20dc90-de21-431c-9bc2-bf57513cea67 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:08.095630 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1410/2851] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 15:00:07 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 15:00:08.100467 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7dacc-f0bd-4f24-b6be-60b79ea94c9a None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:08.114235 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7dacc-f0bd-4f24-b6be-60b79ea94c9a None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:08.184349 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f850e-ba8b-4487-ad27-7e8ae1ab21e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:08.185113 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f850e-ba8b-4487-ad27-7e8ae1ab21e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:08.185807 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f850e-ba8b-4487-ad27-7e8ae1ab21e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:08.186291 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f850e-ba8b-4487-ad27-7e8ae1ab21e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:08.187116 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f850e-ba8b-4487-ad27-7e8ae1ab21e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:08.189337 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f850e-ba8b-4487-ad27-7e8ae1ab21e1 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:08.348374 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1442/2852] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 15:00:08 2022] POST /identity/v3/users => generated 299 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 15:00:08.352984 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20dc90-de21-431c-9bc2-bf57513cea67 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:08.366882 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20dc90-de21-431c-9bc2-bf57513cea67 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:08.373588 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a5c9a-915b-49eb-9a6a-b62cb9250cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:08.374370 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a5c9a-915b-49eb-9a6a-b62cb9250cac admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:08.374660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a5c9a-915b-49eb-9a6a-b62cb9250cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:08.374944 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a5c9a-915b-49eb-9a6a-b62cb9250cac admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:08.375745 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a5c9a-915b-49eb-9a6a-b62cb9250cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:08.377429 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a5c9a-915b-49eb-9a6a-b62cb9250cac admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:08.391118 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1411/2853] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 15:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 15:00:08.395906 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f850e-ba8b-4487-ad27-7e8ae1ab21e1 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:08.407971 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f850e-ba8b-4487-ad27-7e8ae1ab21e1 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:08.415208 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408009a-c303-4f17-85a6-70b0892e421e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:08.416572 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408009a-c303-4f17-85a6-70b0892e421e admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:08.417012 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408009a-c303-4f17-85a6-70b0892e421e admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:08.417454 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408009a-c303-4f17-85a6-70b0892e421e admin admin] PATH_INFO: `/v3/projects/808af49316e743318f90c993cd212bd9/users/a12ffab5257e4c558c05db53df057f8a/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:08.440801 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408009a-c303-4f17-85a6-70b0892e421e admin admin] RBAC: Authorizing `identity:create_grant(project_id=808af49316e743318f90c993cd212bd9, user_id=a12ffab5257e4c558c05db53df057f8a, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:08.444149 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408009a-c303-4f17-85a6-70b0892e421e admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:08.543694 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1443/2854] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 15:00:08 2022] PUT /identity/v3/projects/808af49316e743318f90c993cd212bd9/users/a12ffab5257e4c558c05db53df057f8a/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 15:00:08.549533 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a5c9a-915b-49eb-9a6a-b62cb9250cac admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:08.566707 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a5c9a-915b-49eb-9a6a-b62cb9250cac admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:08.681117 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3df3b8-323d-4938-b157-dead1ea493aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:08.682286 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3df3b8-323d-4938-b157-dead1ea493aa admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:08.682801 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3df3b8-323d-4938-b157-dead1ea493aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:08.683310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3df3b8-323d-4938-b157-dead1ea493aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:08.684776 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3df3b8-323d-4938-b157-dead1ea493aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:08.687982 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3df3b8-323d-4938-b157-dead1ea493aa admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:08.706614 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1412/2855] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 15:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 15:00:08.711350 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408009a-c303-4f17-85a6-70b0892e421e admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:08.726761 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408009a-c303-4f17-85a6-70b0892e421e admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:08.734893 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811600c7-0167-4b56-a5e2-fe596ba3877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:08.736066 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811600c7-0167-4b56-a5e2-fe596ba3877b admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:08.736451 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811600c7-0167-4b56-a5e2-fe596ba3877b admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:08.736964 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811600c7-0167-4b56-a5e2-fe596ba3877b admin admin] PATH_INFO: `/v3/projects/808af49316e743318f90c993cd212bd9/users/a12ffab5257e4c558c05db53df057f8a/roles/ae530119fc5c42358179521ce865b5d7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:08.739667 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811600c7-0167-4b56-a5e2-fe596ba3877b admin admin] RBAC: Authorizing `identity:create_grant(project_id=808af49316e743318f90c993cd212bd9, user_id=a12ffab5257e4c558c05db53df057f8a, role_id=ae530119fc5c42358179521ce865b5d7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:08.742599 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811600c7-0167-4b56-a5e2-fe596ba3877b admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:08.759966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1444/2856] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 15:00:08 2022] PUT /identity/v3/projects/808af49316e743318f90c993cd212bd9/users/a12ffab5257e4c558c05db53df057f8a/roles/ae530119fc5c42358179521ce865b5d7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 15:00:08.773653 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b8fda-3ad0-4e91-8e6a-c60382e4f5fc None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:08.773992 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b8fda-3ad0-4e91-8e6a-c60382e4f5fc None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:08.774219 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b8fda-3ad0-4e91-8e6a-c60382e4f5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:08.818561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-711b8fda-3ad0-4e91-8e6a-c60382e4f5fc None None] MFA Rules not processed for user `a12ffab5257e4c558c05db53df057f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:08.818561 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-711b8fda-3ad0-4e91-8e6a-c60382e4f5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:08.944282 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1413/2857] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 15:00:08.963670 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811600c7-0167-4b56-a5e2-fe596ba3877b admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:08.966245 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-811600c7-0167-4b56-a5e2-fe596ba3877b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:09.016486 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:09.069577 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811600c7-0167-4b56-a5e2-fe596ba3877b admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:09.074784 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51581564-7493-4b3c-8881-e0a9c4be2355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:09.075821 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51581564-7493-4b3c-8881-e0a9c4be2355 service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:09.076590 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51581564-7493-4b3c-8881-e0a9c4be2355 service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:09.076985 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51581564-7493-4b3c-8881-e0a9c4be2355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:09.094167 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51581564-7493-4b3c-8881-e0a9c4be2355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:09.095728 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51581564-7493-4b3c-8881-e0a9c4be2355 service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:09.111557 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1445/2858] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 15:00:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 15:00:10.502727 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b8fda-3ad0-4e91-8e6a-c60382e4f5fc None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:10.581817 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:10.609021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b8fda-3ad0-4e91-8e6a-c60382e4f5fc None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:10.616425 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a34aa-42ce-4a1f-a0bd-474dbcc9bf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:10.617895 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a34aa-42ce-4a1f-a0bd-474dbcc9bf4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:10.618353 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a34aa-42ce-4a1f-a0bd-474dbcc9bf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:10.618808 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a34aa-42ce-4a1f-a0bd-474dbcc9bf4f admin admin] PATH_INFO: `/v3/users/1eda79d355b84bc5a41ed2b6799740f7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:10.621002 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a34aa-42ce-4a1f-a0bd-474dbcc9bf4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eda79d355b84bc5a41ed2b6799740f7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:10.624480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a34aa-42ce-4a1f-a0bd-474dbcc9bf4f admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:10.858687 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-966a34aa-42ce-4a1f-a0bd-474dbcc9bf4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eda79d355b84bc5a41ed2b6799740f7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:10.875401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-966a34aa-42ce-4a1f-a0bd-474dbcc9bf4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eda79d355b84bc5a41ed2b6799740f7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:10.888814 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-966a34aa-42ce-4a1f-a0bd-474dbcc9bf4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eda79d355b84bc5a41ed2b6799740f7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:10.991088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-966a34aa-42ce-4a1f-a0bd-474dbcc9bf4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eda79d355b84bc5a41ed2b6799740f7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:10.991988 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-966a34aa-42ce-4a1f-a0bd-474dbcc9bf4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eda79d355b84bc5a41ed2b6799740f7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:11.001827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1414/2859] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 15:00:10 2022] DELETE /identity/v3/users/1eda79d355b84bc5a41ed2b6799740f7 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 15:00:11.008101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fd310-eedc-45a8-871d-e251eb467f5d None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:11.008867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fd310-eedc-45a8-871d-e251eb467f5d None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:11.008867 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fd310-eedc-45a8-871d-e251eb467f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:11.032712 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-dc0fd310-eedc-45a8-871d-e251eb467f5d None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:11.034584 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-dc0fd310-eedc-45a8-871d-e251eb467f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:11.148431 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1446/2860] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 15:00:11.162404 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a34aa-42ce-4a1f-a0bd-474dbcc9bf4f admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:11.164803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-966a34aa-42ce-4a1f-a0bd-474dbcc9bf4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:11.254666 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a34aa-42ce-4a1f-a0bd-474dbcc9bf4f admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:11.261145 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc9055-e49b-4ae5-907e-e44322046c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:11.262677 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc9055-e49b-4ae5-907e-e44322046c6c service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:11.263941 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc9055-e49b-4ae5-907e-e44322046c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:11.264401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc9055-e49b-4ae5-907e-e44322046c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:11.283569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc9055-e49b-4ae5-907e-e44322046c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:11.286503 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc9055-e49b-4ae5-907e-e44322046c6c service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:11.306545 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1415/2861] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 15:00:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 15:00:11.951383 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fd310-eedc-45a8-871d-e251eb467f5d None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:11.953078 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-dc0fd310-eedc-45a8-871d-e251eb467f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:11.973675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fd310-eedc-45a8-871d-e251eb467f5d None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:11.983256 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfd951-5476-4045-977e-87cf43b7380d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:11.984883 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfd951-5476-4045-977e-87cf43b7380d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:11.985402 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfd951-5476-4045-977e-87cf43b7380d admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:11.985927 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfd951-5476-4045-977e-87cf43b7380d admin admin] PATH_INFO: `/v3/projects/fa13a85e2abe4c38a9ae67ddee307199` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:11.988371 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfd951-5476-4045-977e-87cf43b7380d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa13a85e2abe4c38a9ae67ddee307199)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:11.992615 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfd951-5476-4045-977e-87cf43b7380d admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:12.149406 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-19dfd951-5476-4045-977e-87cf43b7380d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa13a85e2abe4c38a9ae67ddee307199', 'request_id': 'req-19dfd951-5476-4045-977e-87cf43b7380d'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:12.232956 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-19dfd951-5476-4045-977e-87cf43b7380d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa13a85e2abe4c38a9ae67ddee307199', 'request_id': 'req-19dfd951-5476-4045-977e-87cf43b7380d'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:12.245672 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-19dfd951-5476-4045-977e-87cf43b7380d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa13a85e2abe4c38a9ae67ddee307199', 'request_id': 'req-19dfd951-5476-4045-977e-87cf43b7380d'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:12.262233 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-19dfd951-5476-4045-977e-87cf43b7380d admin admin] The token cache is being invalidate because project fa13a85e2abe4c38a9ae67ddee307199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 15:00:12.263216 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-19dfd951-5476-4045-977e-87cf43b7380d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:12.264241 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-19dfd951-5476-4045-977e-87cf43b7380d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:12.266204 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1447/2862] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 15:00:11 2022] DELETE /identity/v3/projects/fa13a85e2abe4c38a9ae67ddee307199 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 15:00:12.270559 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc9055-e49b-4ae5-907e-e44322046c6c service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:12.281944 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc9055-e49b-4ae5-907e-e44322046c6c service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:12.358141 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189fb34-a1b6-4c6d-acef-2f6d0cd640e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:12.359103 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189fb34-a1b6-4c6d-acef-2f6d0cd640e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:12.359477 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189fb34-a1b6-4c6d-acef-2f6d0cd640e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:12.359805 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189fb34-a1b6-4c6d-acef-2f6d0cd640e4 admin admin] PATH_INFO: `/v3/users/a12ffab5257e4c558c05db53df057f8a` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:12.361230 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189fb34-a1b6-4c6d-acef-2f6d0cd640e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a12ffab5257e4c558c05db53df057f8a)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:12.363785 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189fb34-a1b6-4c6d-acef-2f6d0cd640e4 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:12.371597 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:12.612387 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-2189fb34-a1b6-4c6d-acef-2f6d0cd640e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a12ffab5257e4c558c05db53df057f8a'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:12.634741 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-2189fb34-a1b6-4c6d-acef-2f6d0cd640e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a12ffab5257e4c558c05db53df057f8a'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:12.647650 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-2189fb34-a1b6-4c6d-acef-2f6d0cd640e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a12ffab5257e4c558c05db53df057f8a'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:12.773571 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-2189fb34-a1b6-4c6d-acef-2f6d0cd640e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a12ffab5257e4c558c05db53df057f8a'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:12.774708 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-2189fb34-a1b6-4c6d-acef-2f6d0cd640e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a12ffab5257e4c558c05db53df057f8a'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:12.785479 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1416/2863] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 15:00:12 2022] DELETE /identity/v3/users/a12ffab5257e4c558c05db53df057f8a => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 15:00:13.423181 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfd951-5476-4045-977e-87cf43b7380d admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:13.425448 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-19dfd951-5476-4045-977e-87cf43b7380d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:13.443138 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfd951-5476-4045-977e-87cf43b7380d admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:13.666768 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:13.679935 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d614002-765f-49b3-9352-7de3d63bb6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:13.681192 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d614002-765f-49b3-9352-7de3d63bb6d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:13.681587 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d614002-765f-49b3-9352-7de3d63bb6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:13.681987 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d614002-765f-49b3-9352-7de3d63bb6d0 admin admin] PATH_INFO: `/v3/projects/808af49316e743318f90c993cd212bd9` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:13.683919 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d614002-765f-49b3-9352-7de3d63bb6d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=808af49316e743318f90c993cd212bd9)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:13.687641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d614002-765f-49b3-9352-7de3d63bb6d0 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:13.829006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-6d614002-765f-49b3-9352-7de3d63bb6d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '808af49316e743318f90c993cd212bd9', 'request_id': 'req-6d614002-765f-49b3-9352-7de3d63bb6d0'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:13.940836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-6d614002-765f-49b3-9352-7de3d63bb6d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '808af49316e743318f90c993cd212bd9', 'request_id': 'req-6d614002-765f-49b3-9352-7de3d63bb6d0'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:13.950453 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-6d614002-765f-49b3-9352-7de3d63bb6d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '808af49316e743318f90c993cd212bd9', 'request_id': 'req-6d614002-765f-49b3-9352-7de3d63bb6d0'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:13.968909 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-6d614002-765f-49b3-9352-7de3d63bb6d0 admin admin] The token cache is being invalidate because project 808af49316e743318f90c993cd212bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 15:00:13.969311 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-6d614002-765f-49b3-9352-7de3d63bb6d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:13.970212 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-6d614002-765f-49b3-9352-7de3d63bb6d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:13.972430 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1448/2864] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 15:00:13 2022] DELETE /identity/v3/projects/808af49316e743318f90c993cd212bd9 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 15:00:13.978311 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d53cfa-efff-42e4-8ae8-043bfffc4f28 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:13.978911 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d53cfa-efff-42e4-8ae8-043bfffc4f28 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:13.979094 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d53cfa-efff-42e4-8ae8-043bfffc4f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:14.002877 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-08d53cfa-efff-42e4-8ae8-043bfffc4f28 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:14.004314 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-08d53cfa-efff-42e4-8ae8-043bfffc4f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:14.098583 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1417/2865] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 15:00:14.108555 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2662f-1b6d-4172-8b8a-412c27c17f22 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:14.108892 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2662f-1b6d-4172-8b8a-412c27c17f22 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:14.109191 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2662f-1b6d-4172-8b8a-412c27c17f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:14.130962 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-62d2662f-1b6d-4172-8b8a-412c27c17f22 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:14.132525 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-62d2662f-1b6d-4172-8b8a-412c27c17f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:14.150613 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1449/2866] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 15:00:14.158960 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d53cfa-efff-42e4-8ae8-043bfffc4f28 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:14.170187 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d53cfa-efff-42e4-8ae8-043bfffc4f28 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:14.175209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a18ffe-9d44-4e4e-9cbb-cf07185733f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:14.175917 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a18ffe-9d44-4e4e-9cbb-cf07185733f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:14.176209 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a18ffe-9d44-4e4e-9cbb-cf07185733f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:14.176491 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a18ffe-9d44-4e4e-9cbb-cf07185733f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:14.177243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a18ffe-9d44-4e4e-9cbb-cf07185733f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 15:00:14.177557 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a18ffe-9d44-4e4e-9cbb-cf07185733f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:14.179204 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a18ffe-9d44-4e4e-9cbb-cf07185733f7 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:14.193606 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1418/2867] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 15:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 15:00:14.198736 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2662f-1b6d-4172-8b8a-412c27c17f22 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:14.215432 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2662f-1b6d-4172-8b8a-412c27c17f22 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:14.223444 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffdbd5-d6e0-4c84-9a4d-c1d14bc41049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:14.224517 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffdbd5-d6e0-4c84-9a4d-c1d14bc41049 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:14.225027 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffdbd5-d6e0-4c84-9a4d-c1d14bc41049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:14.225529 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffdbd5-d6e0-4c84-9a4d-c1d14bc41049 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:14.226816 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffdbd5-d6e0-4c84-9a4d-c1d14bc41049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:14.230960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffdbd5-d6e0-4c84-9a4d-c1d14bc41049 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:14.349261 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1450/2868] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 15:00:14 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 15:00:14.353787 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a18ffe-9d44-4e4e-9cbb-cf07185733f7 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:14.365411 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a18ffe-9d44-4e4e-9cbb-cf07185733f7 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:14.435356 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a5dac-4438-411a-b839-5b02c7410850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:14.436068 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a5dac-4438-411a-b839-5b02c7410850 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:14.436354 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a5dac-4438-411a-b839-5b02c7410850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:14.436635 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a5dac-4438-411a-b839-5b02c7410850 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:14.437366 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a5dac-4438-411a-b839-5b02c7410850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:14.439427 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a5dac-4438-411a-b839-5b02c7410850 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:14.570291 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1419/2869] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 15:00:14 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 15:00:14.575133 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffdbd5-d6e0-4c84-9a4d-c1d14bc41049 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:14.586607 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffdbd5-d6e0-4c84-9a4d-c1d14bc41049 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:14.592517 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997afad6-68ed-4844-94d4-c24b4febc66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:14.593229 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997afad6-68ed-4844-94d4-c24b4febc66c admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:14.593509 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997afad6-68ed-4844-94d4-c24b4febc66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:14.593791 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997afad6-68ed-4844-94d4-c24b4febc66c admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:14.594542 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997afad6-68ed-4844-94d4-c24b4febc66c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:14.596456 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997afad6-68ed-4844-94d4-c24b4febc66c admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:14.608545 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1451/2870] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 15:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 15:00:14.612987 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a5dac-4438-411a-b839-5b02c7410850 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:14.618548 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:14.625310 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a5dac-4438-411a-b839-5b02c7410850 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:14.630336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc60c99-bfa9-4d93-8b5c-c98d9559ef86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:14.631053 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc60c99-bfa9-4d93-8b5c-c98d9559ef86 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:14.636171 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc60c99-bfa9-4d93-8b5c-c98d9559ef86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:14.636171 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc60c99-bfa9-4d93-8b5c-c98d9559ef86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:14.636171 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc60c99-bfa9-4d93-8b5c-c98d9559ef86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:14.636171 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc60c99-bfa9-4d93-8b5c-c98d9559ef86 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:14.648113 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1420/2871] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 15:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 15:00:14.653504 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997afad6-68ed-4844-94d4-c24b4febc66c admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:14.669367 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997afad6-68ed-4844-94d4-c24b4febc66c admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:14.675051 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141b5d7-3aed-4d92-b78b-97b03d457860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:14.676198 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141b5d7-3aed-4d92-b78b-97b03d457860 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:14.676580 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141b5d7-3aed-4d92-b78b-97b03d457860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:14.676902 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141b5d7-3aed-4d92-b78b-97b03d457860 admin admin] PATH_INFO: `/v3/projects/86451c5f45ae4979aa6219ebd869485f/users/44aaea2bcedc4c9e84c3495ee6a6a4d5/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:14.695053 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141b5d7-3aed-4d92-b78b-97b03d457860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86451c5f45ae4979aa6219ebd869485f, user_id=44aaea2bcedc4c9e84c3495ee6a6a4d5, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:14.698365 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141b5d7-3aed-4d92-b78b-97b03d457860 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:14.788708 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1452/2872] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 15:00:14 2022] PUT /identity/v3/projects/86451c5f45ae4979aa6219ebd869485f/users/44aaea2bcedc4c9e84c3495ee6a6a4d5/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 15:00:14.799945 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac1e46-2f97-42ee-b653-aed715d2bb4a None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:14.800275 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac1e46-2f97-42ee-b653-aed715d2bb4a None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:14.800602 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac1e46-2f97-42ee-b653-aed715d2bb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:14.834278 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-efac1e46-2f97-42ee-b653-aed715d2bb4a None None] MFA Rules not processed for user `44aaea2bcedc4c9e84c3495ee6a6a4d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:14.835649 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-efac1e46-2f97-42ee-b653-aed715d2bb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:14.916573 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1421/2873] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 15:00:14.928635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141b5d7-3aed-4d92-b78b-97b03d457860 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:14.930487 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-0141b5d7-3aed-4d92-b78b-97b03d457860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:15.001726 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141b5d7-3aed-4d92-b78b-97b03d457860 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:15.006092 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4031c03-1fbf-47dc-8e63-bd17aa38ba18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:15.006918 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4031c03-1fbf-47dc-8e63-bd17aa38ba18 service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:15.007403 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4031c03-1fbf-47dc-8e63-bd17aa38ba18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:15.007790 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4031c03-1fbf-47dc-8e63-bd17aa38ba18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:15.019899 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4031c03-1fbf-47dc-8e63-bd17aa38ba18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:15.024718 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4031c03-1fbf-47dc-8e63-bd17aa38ba18 service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:15.033268 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1453/2874] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 15:00:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 15:00:15.056620 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac1e46-2f97-42ee-b653-aed715d2bb4a None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:15.180681 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac1e46-2f97-42ee-b653-aed715d2bb4a None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:15.188711 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad730e7-3329-4384-bc4b-c855ef6dbe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:15.190247 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad730e7-3329-4384-bc4b-c855ef6dbe0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:15.190757 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad730e7-3329-4384-bc4b-c855ef6dbe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:15.191247 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad730e7-3329-4384-bc4b-c855ef6dbe0b admin admin] PATH_INFO: `/v3/users/44aaea2bcedc4c9e84c3495ee6a6a4d5` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:15.193473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad730e7-3329-4384-bc4b-c855ef6dbe0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=44aaea2bcedc4c9e84c3495ee6a6a4d5)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:15.197256 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad730e7-3329-4384-bc4b-c855ef6dbe0b admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:15.431499 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9ad730e7-3329-4384-bc4b-c855ef6dbe0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44aaea2bcedc4c9e84c3495ee6a6a4d5'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:15.460420 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9ad730e7-3329-4384-bc4b-c855ef6dbe0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44aaea2bcedc4c9e84c3495ee6a6a4d5'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:15.472496 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9ad730e7-3329-4384-bc4b-c855ef6dbe0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44aaea2bcedc4c9e84c3495ee6a6a4d5'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:15.586406 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9ad730e7-3329-4384-bc4b-c855ef6dbe0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44aaea2bcedc4c9e84c3495ee6a6a4d5'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:15.587104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9ad730e7-3329-4384-bc4b-c855ef6dbe0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44aaea2bcedc4c9e84c3495ee6a6a4d5'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:15.590964 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:15.596440 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1422/2875] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 15:00:15 2022] DELETE /identity/v3/users/44aaea2bcedc4c9e84c3495ee6a6a4d5 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 15:00:15.601857 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d39d9-9387-4401-920d-70c4e6a8307a None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:15.602533 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d39d9-9387-4401-920d-70c4e6a8307a None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:15.602662 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d39d9-9387-4401-920d-70c4e6a8307a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:15.623343 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-e33d39d9-9387-4401-920d-70c4e6a8307a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:15.624600 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e33d39d9-9387-4401-920d-70c4e6a8307a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:15.645900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:15.698126 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1454/2876] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 15:00:15.710206 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad730e7-3329-4384-bc4b-c855ef6dbe0b admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:15.711858 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-9ad730e7-3329-4384-bc4b-c855ef6dbe0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:15.784389 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad730e7-3329-4384-bc4b-c855ef6dbe0b admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:15.788432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9360410-45fb-48f7-bf4c-ca5d52c49355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:15.789183 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9360410-45fb-48f7-bf4c-ca5d52c49355 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:15.789525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9360410-45fb-48f7-bf4c-ca5d52c49355 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:15.789807 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9360410-45fb-48f7-bf4c-ca5d52c49355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:15.801552 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9360410-45fb-48f7-bf4c-ca5d52c49355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:15.803995 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9360410-45fb-48f7-bf4c-ca5d52c49355 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:15.817320 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1423/2877] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 15:00:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 15:00:16.315171 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d39d9-9387-4401-920d-70c4e6a8307a None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:16.322133 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e33d39d9-9387-4401-920d-70c4e6a8307a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:16.339219 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d39d9-9387-4401-920d-70c4e6a8307a None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:16.348523 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5194f4-cab7-4359-8087-8712e81d0be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:16.350368 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5194f4-cab7-4359-8087-8712e81d0be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:16.350898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5194f4-cab7-4359-8087-8712e81d0be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:16.351461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5194f4-cab7-4359-8087-8712e81d0be8 admin admin] PATH_INFO: `/v3/projects/86451c5f45ae4979aa6219ebd869485f` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:16.353720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5194f4-cab7-4359-8087-8712e81d0be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86451c5f45ae4979aa6219ebd869485f)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:16.356819 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5194f4-cab7-4359-8087-8712e81d0be8 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:16.506090 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-ab5194f4-cab7-4359-8087-8712e81d0be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86451c5f45ae4979aa6219ebd869485f', 'request_id': 'req-ab5194f4-cab7-4359-8087-8712e81d0be8'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:16.578974 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-ab5194f4-cab7-4359-8087-8712e81d0be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86451c5f45ae4979aa6219ebd869485f', 'request_id': 'req-ab5194f4-cab7-4359-8087-8712e81d0be8'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:16.586466 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-ab5194f4-cab7-4359-8087-8712e81d0be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86451c5f45ae4979aa6219ebd869485f', 'request_id': 'req-ab5194f4-cab7-4359-8087-8712e81d0be8'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:16.600622 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-ab5194f4-cab7-4359-8087-8712e81d0be8 admin admin] The token cache is being invalidate because project 86451c5f45ae4979aa6219ebd869485f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 15:00:16.600901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-ab5194f4-cab7-4359-8087-8712e81d0be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:16.601583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-ab5194f4-cab7-4359-8087-8712e81d0be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:16.603174 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1455/2878] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 15:00:16 2022] DELETE /identity/v3/projects/86451c5f45ae4979aa6219ebd869485f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 15:00:16.608951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dedbf2-16e8-4205-bb9c-07d5c866e74a None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:16.609809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dedbf2-16e8-4205-bb9c-07d5c866e74a None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:16.609809 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dedbf2-16e8-4205-bb9c-07d5c866e74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:16.630030 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-63dedbf2-16e8-4205-bb9c-07d5c866e74a None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:16.631516 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-63dedbf2-16e8-4205-bb9c-07d5c866e74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:16.707445 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1424/2879] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 15:00:16.715913 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1f93b-968d-4e8b-b119-675082016a36 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:16.716233 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1f93b-968d-4e8b-b119-675082016a36 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:16.716520 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1f93b-968d-4e8b-b119-675082016a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:16.737591 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-aaf1f93b-968d-4e8b-b119-675082016a36 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:16.738955 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-aaf1f93b-968d-4e8b-b119-675082016a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:16.751773 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1456/2880] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 15:00:16.756469 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dedbf2-16e8-4205-bb9c-07d5c866e74a None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:16.768437 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dedbf2-16e8-4205-bb9c-07d5c866e74a None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:16.773696 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667be3ab-3600-486f-b192-328d08ec05ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:16.774487 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667be3ab-3600-486f-b192-328d08ec05ee admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:16.774810 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667be3ab-3600-486f-b192-328d08ec05ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:16.775126 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667be3ab-3600-486f-b192-328d08ec05ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:16.776372 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667be3ab-3600-486f-b192-328d08ec05ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 15:00:16.776721 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667be3ab-3600-486f-b192-328d08ec05ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:16.779550 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667be3ab-3600-486f-b192-328d08ec05ee admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:16.794538 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1425/2881] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 15:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 15:00:16.801239 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1f93b-968d-4e8b-b119-675082016a36 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:16.815255 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1f93b-968d-4e8b-b119-675082016a36 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:16.820630 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e514cf6-95aa-45bd-ace6-d907c5a00521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:16.821317 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e514cf6-95aa-45bd-ace6-d907c5a00521 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:16.821617 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e514cf6-95aa-45bd-ace6-d907c5a00521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:16.821893 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e514cf6-95aa-45bd-ace6-d907c5a00521 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:16.822617 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e514cf6-95aa-45bd-ace6-d907c5a00521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:16.825447 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e514cf6-95aa-45bd-ace6-d907c5a00521 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:16.914901 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1457/2882] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 15:00:16 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 15:00:16.920226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667be3ab-3600-486f-b192-328d08ec05ee admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:16.932270 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667be3ab-3600-486f-b192-328d08ec05ee admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:17.003877 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1376c-5fac-493c-a078-099c6e17dd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:17.004581 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1376c-5fac-493c-a078-099c6e17dd62 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:17.004870 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1376c-5fac-493c-a078-099c6e17dd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:17.005153 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1376c-5fac-493c-a078-099c6e17dd62 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:17.005889 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1376c-5fac-493c-a078-099c6e17dd62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:17.008021 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1376c-5fac-493c-a078-099c6e17dd62 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:17.200007 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1426/2883] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 15:00:16 2022] POST /identity/v3/users => generated 289 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 15:00:17.204087 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e514cf6-95aa-45bd-ace6-d907c5a00521 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:17.216120 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e514cf6-95aa-45bd-ace6-d907c5a00521 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:17.220952 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098fce0-2912-4749-a052-45c148a0aecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:17.221641 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098fce0-2912-4749-a052-45c148a0aecf admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:17.221931 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098fce0-2912-4749-a052-45c148a0aecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:17.222193 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098fce0-2912-4749-a052-45c148a0aecf admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:17.222941 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098fce0-2912-4749-a052-45c148a0aecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:17.224734 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098fce0-2912-4749-a052-45c148a0aecf admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:17.241823 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1458/2884] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 15:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 15:00:17.248838 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1376c-5fac-493c-a078-099c6e17dd62 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:17.263696 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1376c-5fac-493c-a078-099c6e17dd62 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:17.269363 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63088061-165a-4740-9b42-e9bd69dee2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:17.270107 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63088061-165a-4740-9b42-e9bd69dee2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:17.270439 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63088061-165a-4740-9b42-e9bd69dee2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:17.270802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63088061-165a-4740-9b42-e9bd69dee2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:17.271694 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63088061-165a-4740-9b42-e9bd69dee2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:17.273474 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63088061-165a-4740-9b42-e9bd69dee2d3 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:17.285656 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1427/2885] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 15:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 15:00:17.291825 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098fce0-2912-4749-a052-45c148a0aecf admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:17.310663 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098fce0-2912-4749-a052-45c148a0aecf admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:17.315634 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b2347-ec54-484e-8a2d-c089a778a144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:17.316561 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b2347-ec54-484e-8a2d-c089a778a144 admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:17.317028 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b2347-ec54-484e-8a2d-c089a778a144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:17.317314 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b2347-ec54-484e-8a2d-c089a778a144 admin admin] PATH_INFO: `/v3/projects/567d1511247b45a490b5723b994ce0a7/users/366ccc397a8047b7b705b2135663fc90/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:17.344480 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b2347-ec54-484e-8a2d-c089a778a144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=567d1511247b45a490b5723b994ce0a7, user_id=366ccc397a8047b7b705b2135663fc90, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:17.349825 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b2347-ec54-484e-8a2d-c089a778a144 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:17.426781 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1459/2886] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 15:00:17 2022] PUT /identity/v3/projects/567d1511247b45a490b5723b994ce0a7/users/366ccc397a8047b7b705b2135663fc90/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 15:00:17.496193 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a425e64-b4ef-46f1-a836-c73485f1c5a9 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:17.496441 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a425e64-b4ef-46f1-a836-c73485f1c5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:17.496753 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a425e64-b4ef-46f1-a836-c73485f1c5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:17.519175 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:17.530558 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-3a425e64-b4ef-46f1-a836-c73485f1c5a9 None None] MFA Rules not processed for user `366ccc397a8047b7b705b2135663fc90`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:17.534835 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-3a425e64-b4ef-46f1-a836-c73485f1c5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:17.609100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1428/2887] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 15:00:17.623566 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b2347-ec54-484e-8a2d-c089a778a144 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:17.625729 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-730b2347-ec54-484e-8a2d-c089a778a144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:17.681177 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:17.721747 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b2347-ec54-484e-8a2d-c089a778a144 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:17.726354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e21aac-f226-42ef-9aa9-76f4bde36584 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37932500740c4ccb96358bd751d01598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:17.727143 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e21aac-f226-42ef-9aa9-76f4bde36584 service glance] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:17.727530 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e21aac-f226-42ef-9aa9-76f4bde36584 service glance] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:17.727869 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e21aac-f226-42ef-9aa9-76f4bde36584 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:17.738336 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e21aac-f226-42ef-9aa9-76f4bde36584 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:17.739998 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e21aac-f226-42ef-9aa9-76f4bde36584 service glance] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:17.751848 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1460/2888] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 15:00:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 15:00:27.613373 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=28 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:27.786263 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=16 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:38.514894 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a425e64-b4ef-46f1-a836-c73485f1c5a9 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:38.600713 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a425e64-b4ef-46f1-a836-c73485f1c5a9 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:38.608347 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ff7cc-5f17-49db-870c-d393854000ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:38.609795 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ff7cc-5f17-49db-870c-d393854000ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:38.610250 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ff7cc-5f17-49db-870c-d393854000ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:38.610701 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ff7cc-5f17-49db-870c-d393854000ab admin admin] PATH_INFO: `/v3/users/366ccc397a8047b7b705b2135663fc90` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:38.612961 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ff7cc-5f17-49db-870c-d393854000ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=366ccc397a8047b7b705b2135663fc90)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:38.616621 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ff7cc-5f17-49db-870c-d393854000ab admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:38.862150 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-035ff7cc-5f17-49db-870c-d393854000ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366ccc397a8047b7b705b2135663fc90'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:38.878020 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-035ff7cc-5f17-49db-870c-d393854000ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366ccc397a8047b7b705b2135663fc90'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:38.887352 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-035ff7cc-5f17-49db-870c-d393854000ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366ccc397a8047b7b705b2135663fc90'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:39.013906 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-035ff7cc-5f17-49db-870c-d393854000ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366ccc397a8047b7b705b2135663fc90'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:39.014674 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-035ff7cc-5f17-49db-870c-d393854000ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366ccc397a8047b7b705b2135663fc90'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:39.022813 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1429/2889] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 15:00:38 2022] DELETE /identity/v3/users/366ccc397a8047b7b705b2135663fc90 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 15:00:39.030744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acb334-a14e-42b5-9237-b59b2529a289 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:39.031406 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acb334-a14e-42b5-9237-b59b2529a289 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:39.031795 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acb334-a14e-42b5-9237-b59b2529a289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:39.060649 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-e6acb334-a14e-42b5-9237-b59b2529a289 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:39.062737 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e6acb334-a14e-42b5-9237-b59b2529a289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:39.145686 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1461/2890] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 15:00:39.156969 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ff7cc-5f17-49db-870c-d393854000ab admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:39.158490 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-035ff7cc-5f17-49db-870c-d393854000ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:39.226401 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ff7cc-5f17-49db-870c-d393854000ab admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:39.231432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0811d18-e434-49d2-a1ed-0af2785af910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:39.234662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0811d18-e434-49d2-a1ed-0af2785af910 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:39.234662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0811d18-e434-49d2-a1ed-0af2785af910 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:39.234662 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0811d18-e434-49d2-a1ed-0af2785af910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:39.249100 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0811d18-e434-49d2-a1ed-0af2785af910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:39.250781 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0811d18-e434-49d2-a1ed-0af2785af910 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:39.263946 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1430/2891] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 15:00:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 15:00:39.816898 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acb334-a14e-42b5-9237-b59b2529a289 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:39.821423 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-e6acb334-a14e-42b5-9237-b59b2529a289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:39.833248 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acb334-a14e-42b5-9237-b59b2529a289 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:39.845091 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15520784-3861-42bd-8d8f-b86f704700c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:39.847094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15520784-3861-42bd-8d8f-b86f704700c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:39.847094 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15520784-3861-42bd-8d8f-b86f704700c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:39.847510 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15520784-3861-42bd-8d8f-b86f704700c7 admin admin] PATH_INFO: `/v3/projects/567d1511247b45a490b5723b994ce0a7` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:39.849552 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15520784-3861-42bd-8d8f-b86f704700c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=567d1511247b45a490b5723b994ce0a7)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:39.853783 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15520784-3861-42bd-8d8f-b86f704700c7 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:39.988406 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-15520784-3861-42bd-8d8f-b86f704700c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '567d1511247b45a490b5723b994ce0a7', 'request_id': 'req-15520784-3861-42bd-8d8f-b86f704700c7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:40.094119 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-15520784-3861-42bd-8d8f-b86f704700c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '567d1511247b45a490b5723b994ce0a7', 'request_id': 'req-15520784-3861-42bd-8d8f-b86f704700c7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:40.101359 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-15520784-3861-42bd-8d8f-b86f704700c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '567d1511247b45a490b5723b994ce0a7', 'request_id': 'req-15520784-3861-42bd-8d8f-b86f704700c7'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:40.119137 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-15520784-3861-42bd-8d8f-b86f704700c7 admin admin] The token cache is being invalidate because project 567d1511247b45a490b5723b994ce0a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 15:00:40.119950 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-15520784-3861-42bd-8d8f-b86f704700c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:40.121540 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-15520784-3861-42bd-8d8f-b86f704700c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:40.123720 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1462/2892] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 15:00:39 2022] DELETE /identity/v3/projects/567d1511247b45a490b5723b994ce0a7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 15:00:40.130163 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbd65e-d4ea-4a9c-939a-edc6fdeb1d29 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:40.130770 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbd65e-d4ea-4a9c-939a-edc6fdeb1d29 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:40.130770 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbd65e-d4ea-4a9c-939a-edc6fdeb1d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:40.152201 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-3cbbd65e-d4ea-4a9c-939a-edc6fdeb1d29 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:40.153480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-3cbbd65e-d4ea-4a9c-939a-edc6fdeb1d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:40.174688 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:40.228251 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1431/2893] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 15:00:40.241413 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff99a71-e99c-4f6e-98c4-0f7258c2447c None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:40.241915 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff99a71-e99c-4f6e-98c4-0f7258c2447c None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:40.242412 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff99a71-e99c-4f6e-98c4-0f7258c2447c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:40.275051 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-4ff99a71-e99c-4f6e-98c4-0f7258c2447c None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:40.277032 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-4ff99a71-e99c-4f6e-98c4-0f7258c2447c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:40.290569 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1463/2894] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 15:00:40.295180 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbd65e-d4ea-4a9c-939a-edc6fdeb1d29 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:40.305832 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbd65e-d4ea-4a9c-939a-edc6fdeb1d29 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:40.311541 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37678726-a086-4dc6-a016-a4442a61feaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:40.312236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37678726-a086-4dc6-a016-a4442a61feaa admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:40.312535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37678726-a086-4dc6-a016-a4442a61feaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:40.312808 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37678726-a086-4dc6-a016-a4442a61feaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:40.313552 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37678726-a086-4dc6-a016-a4442a61feaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80634) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 15:00:40.313858 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37678726-a086-4dc6-a016-a4442a61feaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:40.315592 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37678726-a086-4dc6-a016-a4442a61feaa admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:40.329343 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1432/2895] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 15:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 15:00:40.335093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff99a71-e99c-4f6e-98c4-0f7258c2447c None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:40.346224 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff99a71-e99c-4f6e-98c4-0f7258c2447c None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:40.351059 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f455c6-04c2-4cc2-bc48-b8abcc6705b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:40.351766 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f455c6-04c2-4cc2-bc48-b8abcc6705b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:40.352051 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f455c6-04c2-4cc2-bc48-b8abcc6705b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:40.352325 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f455c6-04c2-4cc2-bc48-b8abcc6705b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:40.353041 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f455c6-04c2-4cc2-bc48-b8abcc6705b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:40.355528 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f455c6-04c2-4cc2-bc48-b8abcc6705b3 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:40.468835 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1464/2896] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 15:00:40 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 15:00:40.475744 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37678726-a086-4dc6-a016-a4442a61feaa admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:40.487795 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37678726-a086-4dc6-a016-a4442a61feaa admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:40.554850 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f8c60-ac99-4549-8ccd-4d7f513272f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:40.555581 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f8c60-ac99-4549-8ccd-4d7f513272f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:40.555891 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f8c60-ac99-4549-8ccd-4d7f513272f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:40.556169 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f8c60-ac99-4549-8ccd-4d7f513272f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:40.556890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f8c60-ac99-4549-8ccd-4d7f513272f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:40.560050 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f8c60-ac99-4549-8ccd-4d7f513272f5 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:40.656763 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1433/2897] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 15:00:40 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 15:00:40.660889 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f455c6-04c2-4cc2-bc48-b8abcc6705b3 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:40.672118 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f455c6-04c2-4cc2-bc48-b8abcc6705b3 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:40.676988 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24284f60-94bb-4b1e-ad9b-6a90b47e051e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:40.677667 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24284f60-94bb-4b1e-ad9b-6a90b47e051e admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:40.677950 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24284f60-94bb-4b1e-ad9b-6a90b47e051e admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:40.678225 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24284f60-94bb-4b1e-ad9b-6a90b47e051e admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:40.678966 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24284f60-94bb-4b1e-ad9b-6a90b47e051e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:40.680616 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24284f60-94bb-4b1e-ad9b-6a90b47e051e admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:40.692185 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1465/2898] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 15:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 15:00:40.696240 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f8c60-ac99-4549-8ccd-4d7f513272f5 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:40.707432 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f8c60-ac99-4549-8ccd-4d7f513272f5 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:40.712351 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88448663-2af8-4047-a4e6-3dfd714ad446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:40.713037 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88448663-2af8-4047-a4e6-3dfd714ad446 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:40.713322 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88448663-2af8-4047-a4e6-3dfd714ad446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:40.713599 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88448663-2af8-4047-a4e6-3dfd714ad446 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:40.715015 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88448663-2af8-4047-a4e6-3dfd714ad446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:40.716827 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88448663-2af8-4047-a4e6-3dfd714ad446 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:40.728394 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1434/2899] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 15:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 15:00:40.733591 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24284f60-94bb-4b1e-ad9b-6a90b47e051e admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:40.744414 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24284f60-94bb-4b1e-ad9b-6a90b47e051e admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:40.751950 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b386a4-544e-4abb-b15d-c2307a6e434f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:40.752878 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b386a4-544e-4abb-b15d-c2307a6e434f admin admin] REQUEST_METHOD: `PUT` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:40.753160 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b386a4-544e-4abb-b15d-c2307a6e434f admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:40.753434 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b386a4-544e-4abb-b15d-c2307a6e434f admin admin] PATH_INFO: `/v3/projects/ef8ff66e29e2405fb0f1527cab89b4f0/users/56f630ed407a487fbff0c7639e8bf6f1/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:40.786156 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b386a4-544e-4abb-b15d-c2307a6e434f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8ff66e29e2405fb0f1527cab89b4f0, user_id=56f630ed407a487fbff0c7639e8bf6f1, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:40.788852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b386a4-544e-4abb-b15d-c2307a6e434f admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:40.917697 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1466/2900] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 15:00:40 2022] PUT /identity/v3/projects/ef8ff66e29e2405fb0f1527cab89b4f0/users/56f630ed407a487fbff0c7639e8bf6f1/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 15:00:40.929253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843849dd-b846-4cdd-9a07-adf125794b6f None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:40.929518 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843849dd-b846-4cdd-9a07-adf125794b6f None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:40.929801 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843849dd-b846-4cdd-9a07-adf125794b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:40.959840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-843849dd-b846-4cdd-9a07-adf125794b6f None None] MFA Rules not processed for user `56f630ed407a487fbff0c7639e8bf6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:40.961076 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-843849dd-b846-4cdd-9a07-adf125794b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:41.031123 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1435/2901] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 15:00:41.042528 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b386a4-544e-4abb-b15d-c2307a6e434f admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:41.045675 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-50b386a4-544e-4abb-b15d-c2307a6e434f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:41.070746 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:41.112652 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b386a4-544e-4abb-b15d-c2307a6e434f admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:41.116626 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0b9b8-183d-49fa-bd21-ff5e3eca1234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:41.117290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0b9b8-183d-49fa-bd21-ff5e3eca1234 service cinder] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:41.117574 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0b9b8-183d-49fa-bd21-ff5e3eca1234 service cinder] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:41.117852 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0b9b8-183d-49fa-bd21-ff5e3eca1234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:41.128388 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0b9b8-183d-49fa-bd21-ff5e3eca1234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:41.129851 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0b9b8-183d-49fa-bd21-ff5e3eca1234 service cinder] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:41.140145 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1467/2902] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 15:00:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 15:00:45.025983 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843849dd-b846-4cdd-9a07-adf125794b6f None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:45.027959 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-843849dd-b846-4cdd-9a07-adf125794b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:45.054125 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:45.139732 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843849dd-b846-4cdd-9a07-adf125794b6f None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:45.146458 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe7dd9-4eca-4bf4-b101-c448020fe116 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a3704fdba154f13ad3bf8ac00c916c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:45.147139 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe7dd9-4eca-4bf4-b101-c448020fe116 service placement] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:45.147465 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe7dd9-4eca-4bf4-b101-c448020fe116 service placement] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:45.147752 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe7dd9-4eca-4bf4-b101-c448020fe116 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:45.149772 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-f8fe7dd9-4eca-4bf4-b101-c448020fe116 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:45.163892 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe7dd9-4eca-4bf4-b101-c448020fe116 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:45.165709 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe7dd9-4eca-4bf4-b101-c448020fe116 service placement] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:45.178013 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1436/2903] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 15:00:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 15:00:45.363862 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0b9b8-183d-49fa-bd21-ff5e3eca1234 service cinder] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:45.452202 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0b9b8-183d-49fa-bd21-ff5e3eca1234 service cinder] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:45.456838 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440df84-8d86-47af-9827-1ded59eca477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:45.457724 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440df84-8d86-47af-9827-1ded59eca477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:45.458008 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440df84-8d86-47af-9827-1ded59eca477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:45.458284 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440df84-8d86-47af-9827-1ded59eca477 admin admin] PATH_INFO: `/v3/users/56f630ed407a487fbff0c7639e8bf6f1` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:45.459714 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440df84-8d86-47af-9827-1ded59eca477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56f630ed407a487fbff0c7639e8bf6f1)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:45.461636 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440df84-8d86-47af-9827-1ded59eca477 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:45.650765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1440df84-8d86-47af-9827-1ded59eca477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56f630ed407a487fbff0c7639e8bf6f1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:45.663673 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1440df84-8d86-47af-9827-1ded59eca477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56f630ed407a487fbff0c7639e8bf6f1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:45.728243 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1440df84-8d86-47af-9827-1ded59eca477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56f630ed407a487fbff0c7639e8bf6f1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:45.728881 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1440df84-8d86-47af-9827-1ded59eca477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56f630ed407a487fbff0c7639e8bf6f1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:45.738495 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-1440df84-8d86-47af-9827-1ded59eca477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56f630ed407a487fbff0c7639e8bf6f1'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:45.746805 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1468/2904] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 15:00:45 2022] DELETE /identity/v3/users/56f630ed407a487fbff0c7639e8bf6f1 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 15:00:45.751676 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf3d20-76ad-4db6-b339-08b78b8b8613 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:45.751974 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf3d20-76ad-4db6-b339-08b78b8b8613 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:45.752262 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf3d20-76ad-4db6-b339-08b78b8b8613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:45.772802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-e6bf3d20-76ad-4db6-b339-08b78b8b8613 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:45.774046 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-e6bf3d20-76ad-4db6-b339-08b78b8b8613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:45.841599 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1437/2905] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 15:00:45.851991 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440df84-8d86-47af-9827-1ded59eca477 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:45.853668 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1440df84-8d86-47af-9827-1ded59eca477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:45.903764 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:45.915680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440df84-8d86-47af-9827-1ded59eca477 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:45.919897 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc741d-ca15-4f60-a48c-1a435e204387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:45.920635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc741d-ca15-4f60-a48c-1a435e204387 service neutron] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:45.920857 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc741d-ca15-4f60-a48c-1a435e204387 service neutron] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:45.921144 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc741d-ca15-4f60-a48c-1a435e204387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:45.931381 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc741d-ca15-4f60-a48c-1a435e204387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:45.932961 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc741d-ca15-4f60-a48c-1a435e204387 service neutron] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:45.943786 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1469/2906] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 15:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 15:00:46.411031 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf3d20-76ad-4db6-b339-08b78b8b8613 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:46.412577 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-e6bf3d20-76ad-4db6-b339-08b78b8b8613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:46.425832 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf3d20-76ad-4db6-b339-08b78b8b8613 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:46.431703 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619bda1-94d0-474e-a73e-c3a8ef0ada14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:46.432460 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619bda1-94d0-474e-a73e-c3a8ef0ada14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:46.432943 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619bda1-94d0-474e-a73e-c3a8ef0ada14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:46.433226 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619bda1-94d0-474e-a73e-c3a8ef0ada14 admin admin] PATH_INFO: `/v3/projects/ef8ff66e29e2405fb0f1527cab89b4f0` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:46.434542 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619bda1-94d0-474e-a73e-c3a8ef0ada14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef8ff66e29e2405fb0f1527cab89b4f0)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:46.452660 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619bda1-94d0-474e-a73e-c3a8ef0ada14 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:46.551652 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9619bda1-94d0-474e-a73e-c3a8ef0ada14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef8ff66e29e2405fb0f1527cab89b4f0', 'request_id': 'req-9619bda1-94d0-474e-a73e-c3a8ef0ada14'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:46.557484 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9619bda1-94d0-474e-a73e-c3a8ef0ada14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef8ff66e29e2405fb0f1527cab89b4f0', 'request_id': 'req-9619bda1-94d0-474e-a73e-c3a8ef0ada14'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:46.564020 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9619bda1-94d0-474e-a73e-c3a8ef0ada14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef8ff66e29e2405fb0f1527cab89b4f0', 'request_id': 'req-9619bda1-94d0-474e-a73e-c3a8ef0ada14'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:46.655140 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9619bda1-94d0-474e-a73e-c3a8ef0ada14 admin admin] The token cache is being invalidate because project ef8ff66e29e2405fb0f1527cab89b4f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80634) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 15:00:46.655438 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9619bda1-94d0-474e-a73e-c3a8ef0ada14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:46.656104 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-9619bda1-94d0-474e-a73e-c3a8ef0ada14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:00:46.657659 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1438/2907] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 15:00:46 2022] DELETE /identity/v3/projects/ef8ff66e29e2405fb0f1527cab89b4f0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 15:00:46.662501 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2648c8-a74d-409b-9d11-0a0997eeb702 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:46.663005 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2648c8-a74d-409b-9d11-0a0997eeb702 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:46.663127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2648c8-a74d-409b-9d11-0a0997eeb702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:46.682765 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-fb2648c8-a74d-409b-9d11-0a0997eeb702 None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:46.684409 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-fb2648c8-a74d-409b-9d11-0a0997eeb702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:46.748345 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1470/2908] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 15:00:46.756514 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904139d0-e45c-426d-9a81-4234da21ac8b None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:46.756951 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904139d0-e45c-426d-9a81-4234da21ac8b None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:46.757336 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904139d0-e45c-426d-9a81-4234da21ac8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:46.777586 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-904139d0-e45c-426d-9a81-4234da21ac8b None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:46.778802 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-904139d0-e45c-426d-9a81-4234da21ac8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:46.786993 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1439/2909] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 15:00:46.791538 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2648c8-a74d-409b-9d11-0a0997eeb702 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:46.801714 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2648c8-a74d-409b-9d11-0a0997eeb702 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:46.806419 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94500f-9a45-41c2-bf82-579aae6225b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:46.807078 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94500f-9a45-41c2-bf82-579aae6225b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:46.807394 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94500f-9a45-41c2-bf82-579aae6225b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:46.808157 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94500f-9a45-41c2-bf82-579aae6225b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:46.808974 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94500f-9a45-41c2-bf82-579aae6225b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 15:00:46.809281 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94500f-9a45-41c2-bf82-579aae6225b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:46.810871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94500f-9a45-41c2-bf82-579aae6225b9 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:46.823853 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1471/2910] 10.222.0.40 () {58 vars in 1152 bytes} [Tue Jul 12 15:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 15:00:46.828379 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904139d0-e45c-426d-9a81-4234da21ac8b None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:46.834236 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:46.838243 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904139d0-e45c-426d-9a81-4234da21ac8b None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:46.844172 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98e110-abc3-47ef-aeeb-8927a8e07d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:46.848696 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98e110-abc3-47ef-aeeb-8927a8e07d4b admin admin] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:46.848696 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98e110-abc3-47ef-aeeb-8927a8e07d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:46.848696 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98e110-abc3-47ef-aeeb-8927a8e07d4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:46.848696 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98e110-abc3-47ef-aeeb-8927a8e07d4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:46.848696 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98e110-abc3-47ef-aeeb-8927a8e07d4b admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:46.936909 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1440/2911] 10.222.0.40 () {60 vars in 1152 bytes} [Tue Jul 12 15:00:46 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 15:00:46.943746 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94500f-9a45-41c2-bf82-579aae6225b9 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:46.954865 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94500f-9a45-41c2-bf82-579aae6225b9 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:47.016667 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722c7c9-9766-47cb-b031-f6e46d3f0873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:47.017354 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722c7c9-9766-47cb-b031-f6e46d3f0873 admin admin] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:47.017676 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722c7c9-9766-47cb-b031-f6e46d3f0873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:47.017960 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722c7c9-9766-47cb-b031-f6e46d3f0873 admin admin] PATH_INFO: `/v3/users` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:47.018690 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722c7c9-9766-47cb-b031-f6e46d3f0873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:47.020681 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722c7c9-9766-47cb-b031-f6e46d3f0873 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:47.146093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1472/2912] 10.222.0.40 () {60 vars in 1143 bytes} [Tue Jul 12 15:00:46 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 15:00:47.151632 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98e110-abc3-47ef-aeeb-8927a8e07d4b admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:47.167845 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98e110-abc3-47ef-aeeb-8927a8e07d4b admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:47.173142 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e375d6-97cc-427d-971e-bdc8e7d98ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:47.173840 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e375d6-97cc-427d-971e-bdc8e7d98ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:47.174132 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e375d6-97cc-427d-971e-bdc8e7d98ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:47.174419 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e375d6-97cc-427d-971e-bdc8e7d98ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:47.175233 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e375d6-97cc-427d-971e-bdc8e7d98ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:47.176906 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e375d6-97cc-427d-971e-bdc8e7d98ff6 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:47.190213 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1441/2913] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 15:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 15:00:47.196223 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722c7c9-9766-47cb-b031-f6e46d3f0873 admin admin] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:47.207744 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722c7c9-9766-47cb-b031-f6e46d3f0873 admin admin] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:47.212671 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeecea7-b126-4ad9-87db-27cb6b594491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:47.213421 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeecea7-b126-4ad9-87db-27cb6b594491 admin admin] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:47.214101 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeecea7-b126-4ad9-87db-27cb6b594491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:47.214393 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeecea7-b126-4ad9-87db-27cb6b594491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:47.215146 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeecea7-b126-4ad9-87db-27cb6b594491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:47.216827 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeecea7-b126-4ad9-87db-27cb6b594491 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:47.228077 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1473/2914] 10.222.0.40 () {58 vars in 1121 bytes} [Tue Jul 12 15:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 15:00:47.233208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e375d6-97cc-427d-971e-bdc8e7d98ff6 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:47.245695 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e375d6-97cc-427d-971e-bdc8e7d98ff6 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:47.250332 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e785d9-1139-4258-9fc1-b5f3706a0415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:47.251347 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e785d9-1139-4258-9fc1-b5f3706a0415 admin admin] REQUEST_METHOD: `PUT` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:47.251626 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e785d9-1139-4258-9fc1-b5f3706a0415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:47.251900 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e785d9-1139-4258-9fc1-b5f3706a0415 admin admin] PATH_INFO: `/v3/projects/b071ae5228544f52820689eb91d44d0a/users/42a7b03f76b347edacee891eb83e47f7/roles/5444412a1f604ebaa9282a244859c051` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:47.270530 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e785d9-1139-4258-9fc1-b5f3706a0415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b071ae5228544f52820689eb91d44d0a, user_id=42a7b03f76b347edacee891eb83e47f7, role_id=5444412a1f604ebaa9282a244859c051)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:47.273290 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e785d9-1139-4258-9fc1-b5f3706a0415 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:47.346482 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1442/2915] 10.222.0.40 () {60 vars in 1482 bytes} [Tue Jul 12 15:00:47 2022] PUT /identity/v3/projects/b071ae5228544f52820689eb91d44d0a/users/42a7b03f76b347edacee891eb83e47f7/roles/5444412a1f604ebaa9282a244859c051 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 15:00:47.357871 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04943d92-cb08-4657-b219-f03c78ef19a4 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:47.358140 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04943d92-cb08-4657-b219-f03c78ef19a4 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:47.358413 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04943d92-cb08-4657-b219-f03c78ef19a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:47.387808 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-04943d92-cb08-4657-b219-f03c78ef19a4 None None] MFA Rules not processed for user `42a7b03f76b347edacee891eb83e47f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:47.389045 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-04943d92-cb08-4657-b219-f03c78ef19a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:47.434768 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:00:47.470095 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1474/2916] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 15:00:47.483214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e785d9-1139-4258-9fc1-b5f3706a0415 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:47.485062 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-f5e785d9-1139-4258-9fc1-b5f3706a0415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:47.549754 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e785d9-1139-4258-9fc1-b5f3706a0415 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:47.553585 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6368be-f57b-4a75-b8c3-54bb9a1828b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb6850303f54a16bb23f05165844dda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:47.554253 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6368be-f57b-4a75-b8c3-54bb9a1828b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:47.554536 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6368be-f57b-4a75-b8c3-54bb9a1828b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:47.554811 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6368be-f57b-4a75-b8c3-54bb9a1828b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:47.564293 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6368be-f57b-4a75-b8c3-54bb9a1828b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:47.565760 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6368be-f57b-4a75-b8c3-54bb9a1828b7 service cinder] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:47.575764 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1443/2917] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 15:00:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 15:00:49.432453 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3199db-3c5f-4671-8a24-6c929f95a5f2 None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:49.433173 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3199db-3c5f-4671-8a24-6c929f95a5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:49.433173 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3199db-3c5f-4671-8a24-6c929f95a5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:49.452391 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-de3199db-3c5f-4671-8a24-6c929f95a5f2 None None] MFA Rules not processed for user `42a7b03f76b347edacee891eb83e47f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:00:49.453621 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-de3199db-3c5f-4671-8a24-6c929f95a5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:49.461006 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1475/2918] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:00:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 15:00:50.109066 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6368be-f57b-4a75-b8c3-54bb9a1828b7 service cinder] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:00:50.110681 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-2d6368be-f57b-4a75-b8c3-54bb9a1828b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:50.230513 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6368be-f57b-4a75-b8c3-54bb9a1828b7 service cinder] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:00:50.236249 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039645dc-e8c0-447e-940e-8767440a1950 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a3704fdba154f13ad3bf8ac00c916c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:00:50.236944 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039645dc-e8c0-447e-940e-8767440a1950 service placement] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:00:50.237229 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039645dc-e8c0-447e-940e-8767440a1950 service placement] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:00:50.237509 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039645dc-e8c0-447e-940e-8767440a1950 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:00:50.239555 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-039645dc-e8c0-447e-940e-8767440a1950 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:00:50.254276 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039645dc-e8c0-447e-940e-8767440a1950 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:00:50.255948 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039645dc-e8c0-447e-940e-8767440a1950 service placement] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:00:50.268215 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1444/2919] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 15:00:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 15:00:59.445939 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=12 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:01:00.262525 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=80,keystone:INSERT=2 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:01:02.162027 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3199db-3c5f-4671-8a24-6c929f95a5f2 None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:01:02.163916 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-de3199db-3c5f-4671-8a24-6c929f95a5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:01:02.335146 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3199db-3c5f-4671-8a24-6c929f95a5f2 None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:01:02.342476 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9baf3-8687-4a54-b286-01e0e4083ac8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '122fc227de9d4f87a66e4a0d86ff0b16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:01:02.343160 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9baf3-8687-4a54-b286-01e0e4083ac8 service nova] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:01:02.343516 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9baf3-8687-4a54-b286-01e0e4083ac8 service nova] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:01:02.343802 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9baf3-8687-4a54-b286-01e0e4083ac8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:01:02.345886 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1bd9baf3-8687-4a54-b286-01e0e4083ac8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:01:02.361301 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9baf3-8687-4a54-b286-01e0e4083ac8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:01:02.362967 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9baf3-8687-4a54-b286-01e0e4083ac8 service nova] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:01:02.376699 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1476/2920] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 15:01:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 15:01:11.179685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cc75a-3f34-4054-83fb-82ca6dfe8528 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:01:11.179685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cc75a-3f34-4054-83fb-82ca6dfe8528 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:01:11.179685 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cc75a-3f34-4054-83fb-82ca6dfe8528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:01:11.212882 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-e08cc75a-3f34-4054-83fb-82ca6dfe8528 None None] MFA Rules not processed for user `5ec758ef106b49f4985845b3c106f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:01:11.214886 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-e08cc75a-3f34-4054-83fb-82ca6dfe8528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:01:11.292420 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1445/2921] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Jul 12 15:01:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 15:01:11.451583 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9baf3-8687-4a54-b286-01e0e4083ac8 service nova] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:01:11.453818 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-1bd9baf3-8687-4a54-b286-01e0e4083ac8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:01:11.542325 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9baf3-8687-4a54-b286-01e0e4083ac8 service nova] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:01:11.550650 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334c2bd-d6b9-43f4-a519-1142fc4b83e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad12085f356a4f0682bb70ad231a10b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:01:11.551374 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334c2bd-d6b9-43f4-a519-1142fc4b83e2 service swift] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:01:11.551667 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334c2bd-d6b9-43f4-a519-1142fc4b83e2 service swift] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:01:11.551991 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334c2bd-d6b9-43f4-a519-1142fc4b83e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:01:11.563169 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334c2bd-d6b9-43f4-a519-1142fc4b83e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:01:11.565445 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334c2bd-d6b9-43f4-a519-1142fc4b83e2 service swift] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:01:11.578543 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1477/2922] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Jul 12 15:01:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 15:01:12.501911 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ae5ca-19ab-457b-9de5-fccd1b5da7ae None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:01:12.502494 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ae5ca-19ab-457b-9de5-fccd1b5da7ae None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:01:12.502909 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ae5ca-19ab-457b-9de5-fccd1b5da7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:01:12.535816 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-822ae5ca-19ab-457b-9de5-fccd1b5da7ae None None] MFA Rules not processed for user `5ec758ef106b49f4985845b3c106f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:01:12.538025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-822ae5ca-19ab-457b-9de5-fccd1b5da7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:01:12.551932 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1446/2923] 10.222.0.40 () {58 vars in 967 bytes} [Tue Jul 12 15:01:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 15:01:12.564836 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334c2bd-d6b9-43f4-a519-1142fc4b83e2 service swift] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:01:12.578259 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334c2bd-d6b9-43f4-a519-1142fc4b83e2 service swift] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:01:12.586948 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e32ae4-83d0-427a-b22c-083c23c58edd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad12085f356a4f0682bb70ad231a10b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:01:12.588635 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e32ae4-83d0-427a-b22c-083c23c58edd service swift] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:01:12.589165 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e32ae4-83d0-427a-b22c-083c23c58edd service swift] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:01:12.589548 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e32ae4-83d0-427a-b22c-083c23c58edd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:01:12.599164 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e32ae4-83d0-427a-b22c-083c23c58edd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:01:12.600855 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e32ae4-83d0-427a-b22c-083c23c58edd service swift] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:01:12.610982 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1478/2924] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Jul 12 15:01:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 15:01:13.268890 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13989aa-7d47-4436-98b3-98cf9f237cd6 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:01:13.269294 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13989aa-7d47-4436-98b3-98cf9f237cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:01:13.269606 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13989aa-7d47-4436-98b3-98cf9f237cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:01:13.291869 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-e13989aa-7d47-4436-98b3-98cf9f237cd6 None None] MFA Rules not processed for user `5ec758ef106b49f4985845b3c106f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:01:13.293406 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-e13989aa-7d47-4436-98b3-98cf9f237cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:01:13.301241 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1447/2925] 10.222.0.40 () {58 vars in 1009 bytes} [Tue Jul 12 15:01:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 15:01:13.314335 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e32ae4-83d0-427a-b22c-083c23c58edd service swift] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:01:13.326290 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e32ae4-83d0-427a-b22c-083c23c58edd service swift] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:01:13.331920 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c668f-7587-452a-a366-4a7b93bc33ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad12085f356a4f0682bb70ad231a10b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:01:13.332614 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c668f-7587-452a-a366-4a7b93bc33ff service swift] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:01:13.332900 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c668f-7587-452a-a366-4a7b93bc33ff service swift] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:01:13.333177 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c668f-7587-452a-a366-4a7b93bc33ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:01:13.343127 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c668f-7587-452a-a366-4a7b93bc33ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:01:13.344831 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c668f-7587-452a-a366-4a7b93bc33ff service swift] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:01:13.355680 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1479/2926] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Jul 12 15:01:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 15:01:14.055466 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff5c3a-d9d5-457b-800c-123d261df7b9 None None] REQUEST_METHOD: `POST` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:01:14.056174 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff5c3a-d9d5-457b-800c-123d261df7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:01:14.056174 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff5c3a-d9d5-457b-800c-123d261df7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:01:14.077794 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.auth.core [None req-b9ff5c3a-d9d5-457b-800c-123d261df7b9 None None] MFA Rules not processed for user `5ec758ef106b49f4985845b3c106f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80634) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:01:14.079044 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-b9ff5c3a-d9d5-457b-800c-123d261df7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:01:14.086651 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1448/2927] 10.222.0.40 () {58 vars in 967 bytes} [Tue Jul 12 15:01:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 15:01:14.099945 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c668f-7587-452a-a366-4a7b93bc33ff service swift] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:01:14.112093 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c668f-7587-452a-a366-4a7b93bc33ff service swift] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:01:14.117534 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a8180-6be7-4c98-b2f7-25ff20d121fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad12085f356a4f0682bb70ad231a10b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:01:14.118207 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a8180-6be7-4c98-b2f7-25ff20d121fa service swift] REQUEST_METHOD: `GET` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:01:14.118546 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a8180-6be7-4c98-b2f7-25ff20d121fa service swift] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:01:14.118858 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a8180-6be7-4c98-b2f7-25ff20d121fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:01:14.129708 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a8180-6be7-4c98-b2f7-25ff20d121fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:01:14.131429 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a8180-6be7-4c98-b2f7-25ff20d121fa service swift] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:01:14.141882 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1480/2928] 10.222.0.40 () {60 vars in 1384 bytes} [Tue Jul 12 15:01:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 15:01:17.091569 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff5c3a-d9d5-457b-800c-123d261df7b9 None None] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:01:17.185093 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff5c3a-d9d5-457b-800c-123d261df7b9 None None] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:01:17.190222 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73f028-ebea-41ef-832f-99b7d4386867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:01:17.191141 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73f028-ebea-41ef-832f-99b7d4386867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:01:17.191480 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73f028-ebea-41ef-832f-99b7d4386867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:01:17.191767 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73f028-ebea-41ef-832f-99b7d4386867 admin admin] PATH_INFO: `/v3/users/42a7b03f76b347edacee891eb83e47f7` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:01:17.193255 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73f028-ebea-41ef-832f-99b7d4386867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a7b03f76b347edacee891eb83e47f7)` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:01:17.195322 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73f028-ebea-41ef-832f-99b7d4386867 admin admin] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:01:17.356524 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-5a73f028-ebea-41ef-832f-99b7d4386867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a7b03f76b347edacee891eb83e47f7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:01:17.372148 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-5a73f028-ebea-41ef-832f-99b7d4386867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a7b03f76b347edacee891eb83e47f7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:01:17.381186 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-5a73f028-ebea-41ef-832f-99b7d4386867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a7b03f76b347edacee891eb83e47f7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:01:17.386532 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:01:17.476531 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-5a73f028-ebea-41ef-832f-99b7d4386867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a7b03f76b347edacee891eb83e47f7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:01:17.477298 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.notifications [None req-5a73f028-ebea-41ef-832f-99b7d4386867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a7b03f76b347edacee891eb83e47f7'} {{(pid=80634) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:01:17.484967 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1449/2929] 10.222.0.40 () {58 vars in 1223 bytes} [Tue Jul 12 15:01:17 2022] DELETE /identity/v3/users/42a7b03f76b347edacee891eb83e47f7 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 15:01:17.490435 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630922eb-ec30-4896-a7ac-55f7c560b6bf None None] REQUEST_METHOD: `POST` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:01:17.506113 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630922eb-ec30-4896-a7ac-55f7c560b6bf None None] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:01:17.506113 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630922eb-ec30-4896-a7ac-55f7c560b6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:01:17.510461 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.auth.core [None req-630922eb-ec30-4896-a7ac-55f7c560b6bf None None] MFA Rules not processed for user `6f66109ae90a4460b768c8db1b53b02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 15:01:17.511845 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-630922eb-ec30-4896-a7ac-55f7c560b6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:01:17.516400 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=100 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:01:17.584375 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1481/2930] 10.222.0.40 () {58 vars in 957 bytes} [Tue Jul 12 15:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 15:01:17.595088 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73f028-ebea-41ef-832f-99b7d4386867 admin admin] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:01:17.596698 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-5a73f028-ebea-41ef-832f-99b7d4386867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:01:17.666397 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73f028-ebea-41ef-832f-99b7d4386867 admin admin] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:01:17.670405 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce934724-29ac-4908-aead-c4fdac04ebb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af2d348fc984ed897fd58196b433b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:01:17.671214 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce934724-29ac-4908-aead-c4fdac04ebb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:01:17.671588 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce934724-29ac-4908-aead-c4fdac04ebb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:01:17.671928 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce934724-29ac-4908-aead-c4fdac04ebb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:01:17.683420 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce934724-29ac-4908-aead-c4fdac04ebb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:01:17.685025 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce934724-29ac-4908-aead-c4fdac04ebb9 service neutron] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:01:17.696138 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1450/2931] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 15:01:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 15:01:17.998899 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630922eb-ec30-4896-a7ac-55f7c560b6bf None None] Authenticating user token {{(pid=80633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:01:18.000930 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.fernet_utils [None req-630922eb-ec30-4896-a7ac-55f7c560b6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:01:18.018434 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630922eb-ec30-4896-a7ac-55f7c560b6bf None None] Validating token access rules against request {{(pid=80633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:01:18.025815 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f77ff-0de6-4eea-8701-51638bd51a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f66109ae90a4460b768c8db1b53b02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e19a2306c9b043c3b84bdeaf0a418bdb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:01:18.027208 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f77ff-0de6-4eea-8701-51638bd51a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:01:18.027608 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f77ff-0de6-4eea-8701-51638bd51a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:01:18.027948 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f77ff-0de6-4eea-8701-51638bd51a42 admin admin] PATH_INFO: `/v3/projects/b071ae5228544f52820689eb91d44d0a` {{(pid=80633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:01:18.029986 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f77ff-0de6-4eea-8701-51638bd51a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b071ae5228544f52820689eb91d44d0a)` {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:01:18.033904 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f77ff-0de6-4eea-8701-51638bd51a42 admin admin] RBAC: Authorization granted {{(pid=80633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:01:18.202246 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-159f77ff-0de6-4eea-8701-51638bd51a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b071ae5228544f52820689eb91d44d0a', 'request_id': 'req-159f77ff-0de6-4eea-8701-51638bd51a42'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:01:18.298947 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-159f77ff-0de6-4eea-8701-51638bd51a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b071ae5228544f52820689eb91d44d0a', 'request_id': 'req-159f77ff-0de6-4eea-8701-51638bd51a42'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:01:18.307135 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-159f77ff-0de6-4eea-8701-51638bd51a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b071ae5228544f52820689eb91d44d0a', 'request_id': 'req-159f77ff-0de6-4eea-8701-51638bd51a42'} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:01:18.320180 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-159f77ff-0de6-4eea-8701-51638bd51a42 admin admin] The token cache is being invalidate because project b071ae5228544f52820689eb91d44d0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 15:01:18.320528 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-159f77ff-0de6-4eea-8701-51638bd51a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:01:18.321358 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG keystone.notifications [None req-159f77ff-0de6-4eea-8701-51638bd51a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 15:01:18.324096 dv-cinder-820027-12-smb devstack@keystone.service[80633]: [pid: 80633|app: 0|req: 1482/2932] 10.222.0.40 () {58 vars in 1232 bytes} [Tue Jul 12 15:01:17 2022] DELETE /identity/v3/projects/b071ae5228544f52820689eb91d44d0a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 15:01:27.691208 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=28 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:01:28.316578 dv-cinder-820027-12-smb devstack@keystone.service[80633]: DEBUG dbcounter [-] [80633] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 15:05:48.982058 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce934724-29ac-4908-aead-c4fdac04ebb9 service neutron] Authenticating user token {{(pid=80634) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 15:05:48.983815 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-ce934724-29ac-4908-aead-c4fdac04ebb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:05:49.070284 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce934724-29ac-4908-aead-c4fdac04ebb9 service neutron] Validating token access rules against request {{(pid=80634) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 15:05:49.144855 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37bdfc-5605-4c10-9343-c91273227279 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a3704fdba154f13ad3bf8ac00c916c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00424b6950d14cd4854e4add3e3d7705', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80634) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 15:05:49.145535 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37bdfc-5605-4c10-9343-c91273227279 service placement] REQUEST_METHOD: `GET` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 15:05:49.145824 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37bdfc-5605-4c10-9343-c91273227279 service placement] SCRIPT_NAME: `/identity` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 15:05:49.146105 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37bdfc-5605-4c10-9343-c91273227279 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80634) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 15:05:49.148297 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.fernet_utils [None req-de37bdfc-5605-4c10-9343-c91273227279 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80634) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 15:05:49.163026 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37bdfc-5605-4c10-9343-c91273227279 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 15:05:49.164803 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37bdfc-5605-4c10-9343-c91273227279 service placement] RBAC: Authorization granted {{(pid=80634) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 15:05:49.176921 dv-cinder-820027-12-smb devstack@keystone.service[80634]: [pid: 80634|app: 0|req: 1451/2933] 10.222.0.40 () {60 vars in 1365 bytes} [Tue Jul 12 15:05:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 15:05:59.171473 dv-cinder-820027-12-smb devstack@keystone.service[80634]: DEBUG dbcounter [-] [80634] Writing DB stats keystone:SELECT=58 {{(pid=80634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}